-- Logs begin at Thu 2022-10-20 14:01:40 UTC, end at Thu 2022-10-20 14:57:02 UTC. -- Oct 20 14:27:22.814915 dv-cinder-779233-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 20 14:27:22.827015 dv-cinder-779233-7-smb devstack@keystone.service[81787]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 20 14:27:22.827015 dv-cinder-779233-7-smb devstack@keystone.service[81787]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 20 14:27:22 2022] *** Oct 20 14:27:22.827015 dv-cinder-779233-7-smb devstack@keystone.service[81787]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 20 14:27:22.827015 dv-cinder-779233-7-smb devstack@keystone.service[81787]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 20 14:27:22.827015 dv-cinder-779233-7-smb devstack@keystone.service[81787]: nodename: dv-cinder-779233-7-smb Oct 20 14:27:22.827015 dv-cinder-779233-7-smb devstack@keystone.service[81787]: machine: x86_64 Oct 20 14:27:22.827015 dv-cinder-779233-7-smb devstack@keystone.service[81787]: clock source: unix Oct 20 14:27:22.827015 dv-cinder-779233-7-smb devstack@keystone.service[81787]: pcre jit disabled Oct 20 14:27:22.827015 dv-cinder-779233-7-smb devstack@keystone.service[81787]: detected number of CPU cores: 4 Oct 20 14:27:22.827015 dv-cinder-779233-7-smb devstack@keystone.service[81787]: current working directory: / Oct 20 14:27:22.827015 dv-cinder-779233-7-smb devstack@keystone.service[81787]: detected binary path: /usr/bin/uwsgi-core Oct 20 14:27:22.827015 dv-cinder-779233-7-smb devstack@keystone.service[81787]: your processes number limit is 47680 Oct 20 14:27:22.827015 dv-cinder-779233-7-smb devstack@keystone.service[81787]: your memory page size is 4096 bytes Oct 20 14:27:22.827015 dv-cinder-779233-7-smb devstack@keystone.service[81787]: detected max file descriptor number: 2048 Oct 20 14:27:22.827015 dv-cinder-779233-7-smb devstack@keystone.service[81787]: lock engine: pthread robust mutexes Oct 20 14:27:22.827015 dv-cinder-779233-7-smb devstack@keystone.service[81787]: thunder lock: enabled Oct 20 14:27:22.827015 dv-cinder-779233-7-smb devstack@keystone.service[81787]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 20 14:27:22.827015 dv-cinder-779233-7-smb devstack@keystone.service[81787]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 20 14:27:22.865419 dv-cinder-779233-7-smb devstack@keystone.service[81787]: Python main interpreter initialized at 0x5568cecf79c0 Oct 20 14:27:22.865419 dv-cinder-779233-7-smb devstack@keystone.service[81787]: python threads support enabled Oct 20 14:27:22.865419 dv-cinder-779233-7-smb devstack@keystone.service[81787]: your server socket listen backlog is limited to 100 connections Oct 20 14:27:22.865419 dv-cinder-779233-7-smb devstack@keystone.service[81787]: your mercy for graceful operations on workers is 90 seconds Oct 20 14:27:22.865766 dv-cinder-779233-7-smb devstack@keystone.service[81787]: mapped 403077 bytes (393 KB) for 2 cores Oct 20 14:27:22.865894 dv-cinder-779233-7-smb devstack@keystone.service[81787]: *** Operational MODE: preforking *** Oct 20 14:27:22.866146 dv-cinder-779233-7-smb devstack@keystone.service[81787]: *** uWSGI is running in multiple interpreter mode *** Oct 20 14:27:22.866146 dv-cinder-779233-7-smb devstack@keystone.service[81787]: spawned uWSGI master process (pid: 81787) Oct 20 14:27:22.866386 dv-cinder-779233-7-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 20 14:27:22.873695 dv-cinder-779233-7-smb devstack@keystone.service[81787]: spawned uWSGI worker 1 (pid: 81801, cores: 1) Oct 20 14:27:22.873695 dv-cinder-779233-7-smb devstack@keystone.service[81787]: spawned uWSGI worker 2 (pid: 81802, cores: 1) Oct 20 14:27:22.873695 dv-cinder-779233-7-smb devstack@keystone.service[81787]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 20 14:27:27.140084 dv-cinder-779233-7-smb devstack@keystone.service[81802]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 14:27:27.140084 dv-cinder-779233-7-smb devstack@keystone.service[81802]: from cryptography.utils import int_from_bytes Oct 20 14:27:27.140824 dv-cinder-779233-7-smb devstack@keystone.service[81801]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 14:27:27.140824 dv-cinder-779233-7-smb devstack@keystone.service[81801]: from cryptography.utils import int_from_bytes Oct 20 14:27:27.141275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 14:27:27.141275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: from cryptography.utils import int_from_bytes Oct 20 14:27:27.141416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 14:27:27.141416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: from cryptography.utils import int_from_bytes Oct 20 14:27:27.190950 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 20 14:27:27.191119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 20 14:27:27.191220 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 20 14:27:27.191304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 20 14:27:27.191381 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] command line args: [] {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 20 14:27:27.191498 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] command line args: [] {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 20 14:27:27.191590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 20 14:27:27.191742 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ================================================================================ {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 20 14:27:27.191833 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 20 14:27:27.191936 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ================================================================================ {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 20 14:27:27.192019 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] admin_token = **** {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.192195 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] admin_token = **** {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.192284 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] config_dir = [] {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.192395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.192472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] config_dir = [] {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.192595 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] config_source = [] {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.192684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.192755 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] debug = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.192836 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] config_source = [] {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.192943 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.194825 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] debug = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.194825 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.195045 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.195213 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.195280 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.195338 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.195394 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.195451 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.195517 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.195576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.195632 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] list_limit = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.195692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] list_limit = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.195749 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] log_config_append = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.195805 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] log_config_append = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.195868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.195931 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.195987 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] log_dir = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.196042 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] log_dir = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.196097 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] log_file = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.196157 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] log_file = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.196222 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.196280 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.196335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.196391 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.196451 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.196513 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.196577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.196635 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.196697 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.196759 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.196817 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.196882 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.196940 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.197002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.197205 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.197512 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.197657 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.197761 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.197837 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.197945 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.198060 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.198139 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.198215 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.198337 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.198416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.198496 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.198614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.198687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.198801 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.198906 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.199290 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.199399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.199529 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] publish_errors = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.199603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] publish_errors = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.199720 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.199798 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.199907 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.200030 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.200106 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.200216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.200323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.200447 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.200558 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.200673 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.200788 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] standard_threads = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.200901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] standard_threads = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.201009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.201124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.201232 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.201351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.201471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.201578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.201687 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] use_journal = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.201687 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] use_json = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.201981 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] use_journal = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.202090 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] use_stderr = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.202208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] use_json = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.202318 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] use_syslog = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.202432 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] use_stderr = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.202432 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] use_syslog = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.202651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.202766 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:27:27.202875 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.202988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.203097 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.203222 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.203332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.203446 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.203555 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.203662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.203776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.203895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.204004 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.204111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.204218 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.204325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.204432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.204547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.204656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.204764 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.204877 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.204986 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.205097 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.205213 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.205328 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.205437 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.205550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.205550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.205752 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.205752 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.206011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.206011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.206221 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.206329 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.206436 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.206552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.206661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.206768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.206876 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.206983 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.207164 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.207276 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.207383 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.207498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.207605 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.207712 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.207831 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.207946 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.208060 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.208174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.208283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.208395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.208511 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.208620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.208727 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.208834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.208940 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.209049 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.209163 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.209271 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.209384 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.209499 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.209639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.209760 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.209928 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.210042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.210157 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.210270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.210379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.210486 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.210604 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.210753 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.210862 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.210970 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.211085 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.211223 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.211346 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.211481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.211600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.211710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.211818 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.211926 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.212046 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.212158 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.212266 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.212374 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.212488 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.212597 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.212781 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.212894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.213003 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.213110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.213225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.213335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.213452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.213562 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.213701 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.213819 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.213953 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.214064 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.214185 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.214298 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.214406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.214514 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.214622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.214730 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.214846 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.214956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.215064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.215175 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.215285 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.215392 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.215508 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.215618 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.215726 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.215853 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.215957 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.216057 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.216156 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.216248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.216346 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.216438 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.216535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.216635 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.216729 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.216850 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.216963 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.217072 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.217181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.217301 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.217413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.217541 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.217661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.217763 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.217894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.218009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.218118 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.218239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.218351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.218462 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.218570 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.218670 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.218845 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.218972 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.219091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.219192 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.219323 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.219443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.219554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.219670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.219781 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.219896 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.220011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.220121 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.220237 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.220355 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.220466 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.220576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.220685 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.220794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.220924 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.221047 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.221158 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.221267 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.221382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.221499 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.221610 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.221727 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.221877 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.221993 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.222104 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.222212 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.222321 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.222442 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.222554 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.222664 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.222773 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.222882 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.223023 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.223146 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.223258 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.223366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.223475 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.223582 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.223698 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.223886 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.224000 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.224110 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.224219 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.224323 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.224440 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.224559 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.224678 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.224796 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.224907 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.225022 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.225132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.225783 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.225972 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.226087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.226197 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.226323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.226490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.226608 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.226727 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.226841 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.226951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.227060 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.227170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.227287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.227407 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.227526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] auth.external = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.227637 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.227747 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.227858 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.227994 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.228115 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.228228 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.228346 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.228457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] auth.password = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.228575 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.228687 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] auth.token = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.228797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] auth.external = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.228908 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.229026 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.229138 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.229248 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.229359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.229469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.229586 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.229706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] auth.password = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.229818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.229942 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] auth.token = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.230053 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.230174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.230286 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.230405 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.230516 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] credential.caching = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.230627 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.230737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.230848 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.230957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.231077 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.231189 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.231299 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.231409 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.231519 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.231629 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.231749 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] credential.caching = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.231860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.231971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.232082 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.232192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.232301 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.232419 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.232530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.232647 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.232758 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.232868 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.232978 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.233098 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.233210 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.233320 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.233430 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.233540 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.233649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.233767 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.233940 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.234055 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.234165 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] federation.caching = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.234309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.234437 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.234563 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.234676 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.234808 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.234924 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.235034 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.235143 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.235265 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.235378 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.235488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.235597 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] federation.caching = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.235732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.235855 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.235968 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.236078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.236209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.236325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.236435 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.236553 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.236673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.236784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.236894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] identity.caching = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.237004 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.237137 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.237261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.237374 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.237484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.237632 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.237750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.237881 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.238077 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.238192 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.238303 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.238415 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.238525 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] identity.caching = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.238636 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.238754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.238866 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.238976 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.239086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.239196 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.239307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.239426 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.239537 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.239648 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.239758 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.239868 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.239978 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.240100 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.240213 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.240324 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.240441 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.240553 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.240663 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.240781 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.241014 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.241633 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.241745 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.241950 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.242081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.242203 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.242314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.242426 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.242537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.242648 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.242759 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.242877 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.242990 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.243101 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.243212 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.243323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.243433 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.243551 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.243665 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.243776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.243886 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.243996 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.244106 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.244225 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.244337 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.244489 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.244606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.244717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.244827 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.244947 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.245059 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.245169 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.245280 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.245390 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.245583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.245701 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.245816 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.245954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.246093 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.246208 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.246331 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.246442 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.246552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.246662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.246773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.246882 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.247003 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.247121 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.247233 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.247343 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.247482 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.247604 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.247724 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.247836 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.247947 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.248057 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.248167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.248276 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.248394 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.248506 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.248616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.248726 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.248837 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.248947 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.249069 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.249181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.249291 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.user = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.249401 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.249511 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.249620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.249738 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.249913 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.250030 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.250141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.250251 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.250361 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.250480 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.250592 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.250702 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.250812 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.250923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.251033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.251151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.251263 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.user = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.251373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.251484 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.251686 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.251808 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.251929 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.252043 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.252153 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.252263 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.252372 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.252481 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.252599 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.252711 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.252822 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.252933 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.253044 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.253154 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.253272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.253383 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.253499 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.253611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.253721 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.253830 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.253973 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.254087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.254197 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.254307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.254416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.254526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.254644 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.254756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.254865 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.254975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.255084 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.255194 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.255311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.255423 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.255533 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.255642 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.255755 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.255866 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.255983 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.256095 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.256206 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.256316 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.256426 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.256553 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.256730 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.256848 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.256960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.257124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.257247 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.257358 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.257478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.257590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.257700 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.257810 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.257977 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] resource.caching = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.258088 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.258211 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.258325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.258436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.258545 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.258655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.258765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.258882 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.258994 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.259104 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.259214 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.259324 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.259434 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.259552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.259664 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.259773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.259883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] resource.caching = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.259993 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.260102 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] role.caching = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.260219 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.260331 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] role.driver = sql {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.260442 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.260552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.260661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.260851 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.260966 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.261076 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.261187 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.261296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.261491 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.261610 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.261722 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.261832 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.261964 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.262074 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.262183 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.262304 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.262417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] role.caching = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.262528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.262637 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] role.driver = sql {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.262746 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.262856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.262973 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.263085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.263195 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.263305 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.263415 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.263532 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.263651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.263764 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.263874 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.263983 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.264092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.264202 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.264319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.264430 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.264540 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.264650 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.264760 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.264868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.264986 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.265098 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.265208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.265318 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.265428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.265537 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.265656 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.265773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.265987 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.266102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.266213 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.266335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.266449 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.266559 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.266671 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.266780 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.266890 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.267008 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.267120 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.267260 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.267376 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.267486 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.267596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.267745 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.267861 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.268006 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.268120 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.268252 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.268366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] token.caching = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.268484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.268596 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.268706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.268815 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.268925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.269034 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.269182 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.269295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.269406 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.269515 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.269624 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.269734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.269941 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.270058 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.270168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.270277 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.270386 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.270495 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.270732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.270854 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] token.caching = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.270965 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.271075 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.271186 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.271296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.271414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.271526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.271636 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.271746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.271856 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.271976 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.272096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.272233 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.272347 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.272458 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.272568 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] database.connection = **** {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.272678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.272788 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.272939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.273057 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.273174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.273287 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.273396 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.273507 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.273624 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.273736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.273904 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.274021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.274132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.274242 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.274364 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.274477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.274595 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.274715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.274827 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.274937 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.275048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.275203 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] database.connection = **** {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.275327 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.275439 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.275548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.275657 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.275767 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.275881 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.275999 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.276113 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.276223 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.276333 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.276443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.276552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.276670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.276782 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 20 14:27:27.276892 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.277053 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.277302 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.277543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.277790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.278057 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.278309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.278548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.278799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.279034 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.279282 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.279521 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:27:27.279692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 20 14:27:27.306645 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.306876 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.307100 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.309133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.309370 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.309602 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.315719 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.317989 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.343896 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.344124 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.346035 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.346270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.397913 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.398620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.447796 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.448028 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.448500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.448736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.604595 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.604828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.604918 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.605044 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.605127 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.605263 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.605355 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.605481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.605562 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.605698 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.605788 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.605982 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.628692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.628929 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.629117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.629201 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.629353 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.629436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.629579 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.629659 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.629793 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.629901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.630033 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.630115 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.630257 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.630475 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.641271 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.641568 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.654571 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.654753 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.654836 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.654981 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.655063 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.655207 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.655288 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.655428 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.655508 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.655734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.655813 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.655885 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81801) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.655957 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.656089 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81802) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 14:27:27.672468 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.672677 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 20 14:27:27.672760 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.672944 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 20 14:27:27.673024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.673205 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 20 14:27:27.673300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.673474 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 20 14:27:27.673555 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.673734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.673813 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.674027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.674108 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.674285 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.674363 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.674544 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.684770 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.685049 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.685268 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.685349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.685549 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.685628 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.685821 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.686132 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.692476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81801) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.693020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81802) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.696077 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81801) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.696359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.696647 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.696935 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.697065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81802) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.697222 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.697357 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.697487 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.697637 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.697762 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.697944 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.698065 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.698232 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.698341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.698494 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.698617 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.698767 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.698887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.699040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.699311 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.699585 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.699861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.721145 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.722601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.722685 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81801) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.722896 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.724058 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81802) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.724344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.727666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81801) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.727955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.728240 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.729445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81802) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.729737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.730045 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.734539 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81801) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.734829 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.736297 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81802) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.736588 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.740372 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81801) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.740673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.741505 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.742010 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.742298 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.742576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.742851 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.743122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.743202 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81802) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.743429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.743723 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.744016 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.744292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.744568 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.744841 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.745112 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.758660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.758938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.760906 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.761182 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.762758 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81801) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.764983 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81802) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.765998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.766298 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.768218 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.768517 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.770475 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81801) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.773778 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81802) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.774169 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81801) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.776959 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81802) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.777353 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.777656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.777969 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.778257 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.778547 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.778835 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.780186 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.780495 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.780785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.781071 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.781351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.781632 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.794577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81801) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.794868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.795141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.795409 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.797744 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81802) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.798063 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.798341 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.798605 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.802209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.804238 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.805744 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.806063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.806474 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.808269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.809024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81801) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.809308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.809591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.809792 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.809890 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.810177 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.810287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.812875 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81802) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.813169 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.813453 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.813734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.814148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.821985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81801) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.822273 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.822556 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.822841 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.823223 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.823524 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.823809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.826231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81802) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.826519 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.826801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.827085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.827467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.827756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.828043 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.839079 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81801) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.841967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81801) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.843800 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81802) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.844808 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.846298 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.846715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81802) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.847751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81801) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.848036 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.848445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.849577 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.851566 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.853020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81802) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.853307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.853714 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.854805 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.856256 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81801) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.859131 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.859525 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.859813 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.860014 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.860094 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.861472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81802) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.864364 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.864763 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.865053 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.865335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.868487 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81801) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.868782 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.869067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.874235 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81802) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.874541 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.874826 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.875871 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81801) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.876159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.876451 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.876732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.877024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.877299 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.877576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.877874 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.878157 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.878438 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.878807 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.879076 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.879345 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.879616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81801) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.882593 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81802) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 14:27:27.882886 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.883172 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.883453 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.883732 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.884016 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.884294 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.884586 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.884867 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.885148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.885435 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.885707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.886000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.886281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81802) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 14:27:27.913688 dv-cinder-779233-7-smb devstack@keystone.service[81801]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5568cecf79c0 pid: 81801 (default app) Oct 20 14:27:27.916898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047de26-927c-4a87-8d78-2db6283fdd5b None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:27.917185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047de26-927c-4a87-8d78-2db6283fdd5b None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:27.917458 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047de26-927c-4a87-8d78-2db6283fdd5b None None] PATH_INFO: `/v3` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:27.920698 dv-cinder-779233-7-smb devstack@keystone.service[81802]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5568cecf79c0 pid: 81802 (default app) Oct 20 14:27:27.921623 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Thu Oct 20 14:27:27 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:34.726277 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddaaeb-b2d6-478d-b040-5effc5ac5a9e None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:34.726784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddaaeb-b2d6-478d-b040-5effc5ac5a9e None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:34.726887 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddaaeb-b2d6-478d-b040-5effc5ac5a9e None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:34.731120 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:27:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:27:34.736377 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a002c-0749-4689-b97e-0a89f8a9dc6a None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:34.736913 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a002c-0749-4689-b97e-0a89f8a9dc6a None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:34.736913 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a002c-0749-4689-b97e-0a89f8a9dc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:34.806999 dv-cinder-779233-7-smb devstack@keystone.service[81801]: INFO dbcounter [None req-ce2a002c-0749-4689-b97e-0a89f8a9dc6a None None] Registered counter for database keystone Oct 20 14:27:34.828918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG oslo_db.sqlalchemy.engines [None req-ce2a002c-0749-4689-b97e-0a89f8a9dc6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 14:27:34.837460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writer thread running {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 14:27:35.017780 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG passlib.handlers.bcrypt [None req-ce2a002c-0749-4689-b97e-0a89f8a9dc6a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81801) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 20 14:27:35.018135 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG passlib.handlers.bcrypt [None req-ce2a002c-0749-4689-b97e-0a89f8a9dc6a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81801) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 20 14:27:35.076490 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-ce2a002c-0749-4689-b97e-0a89f8a9dc6a None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:27:35.078131 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ce2a002c-0749-4689-b97e-0a89f8a9dc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:27:35.203400 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:27:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 14:27:35.655345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddaaeb-b2d6-478d-b040-5effc5ac5a9e None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:35.726278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: INFO dbcounter [None req-67ddaaeb-b2d6-478d-b040-5effc5ac5a9e None None] Registered counter for database keystone Oct 20 14:27:35.747274 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG oslo_db.sqlalchemy.engines [None req-67ddaaeb-b2d6-478d-b040-5effc5ac5a9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81802) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 14:27:35.753411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writer thread running {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 14:27:35.873709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddaaeb-b2d6-478d-b040-5effc5ac5a9e None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:35.877927 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2440d2-51ae-42e6-971d-8de00fd3701f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:35.878544 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2440d2-51ae-42e6-971d-8de00fd3701f admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:35.878821 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2440d2-51ae-42e6-971d-8de00fd3701f admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:35.879088 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2440d2-51ae-42e6-971d-8de00fd3701f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:35.887276 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2440d2-51ae-42e6-971d-8de00fd3701f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:35.939246 dv-cinder-779233-7-smb devstack@keystone.service[81802]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fd2440d2-51ae-42e6-971d-8de00fd3701f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 20 14:27:35.939542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2440d2-51ae-42e6-971d-8de00fd3701f admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:35.948718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1324 bytes} [Thu Oct 20 14:27:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 14:27:35.954634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a002c-0749-4689-b97e-0a89f8a9dc6a None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:35.971353 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a002c-0749-4689-b97e-0a89f8a9dc6a None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:35.976302 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778c5f9-8b5f-42c3-86a6-9ad483db1ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:35.977386 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778c5f9-8b5f-42c3-86a6-9ad483db1ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:35.977662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778c5f9-8b5f-42c3-86a6-9ad483db1ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:35.977963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778c5f9-8b5f-42c3-86a6-9ad483db1ea8 admin admin] PATH_INFO: `/v3/projects/e7ff2453910940f2bc733ed16c90677b` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:35.979529 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778c5f9-8b5f-42c3-86a6-9ad483db1ea8 admin admin] RBAC: Authorizing `identity:get_project(project_id=e7ff2453910940f2bc733ed16c90677b)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:36.032077 dv-cinder-779233-7-smb devstack@keystone.service[81801]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1778c5f9-8b5f-42c3-86a6-9ad483db1ea8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 20 14:27:36.032425 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778c5f9-8b5f-42c3-86a6-9ad483db1ea8 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:36.036986 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 3/5] 10.222.0.17 () {56 vars in 1207 bytes} [Thu Oct 20 14:27:35 2022] GET /identity/v3/projects/e7ff2453910940f2bc733ed16c90677b => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:38.157081 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0711a38-1a07-405e-9c43-dc32a8669cc6 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:38.157591 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0711a38-1a07-405e-9c43-dc32a8669cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:38.157690 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0711a38-1a07-405e-9c43-dc32a8669cc6 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:38.162471 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 3/6] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:27:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:27:38.167863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ec473-9e46-4514-817e-ead04abd6710 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:38.168295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ec473-9e46-4514-817e-ead04abd6710 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:38.168469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ec473-9e46-4514-817e-ead04abd6710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:38.189256 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-f53ec473-9e46-4514-817e-ead04abd6710 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:27:38.190784 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-f53ec473-9e46-4514-817e-ead04abd6710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:27:38.199283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:27:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 14:27:38.465878 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0711a38-1a07-405e-9c43-dc32a8669cc6 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:38.477628 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0711a38-1a07-405e-9c43-dc32a8669cc6 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:38.481730 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50ddf7-aa6d-4602-b1f2-f109ff28cde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:38.482348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50ddf7-aa6d-4602-b1f2-f109ff28cde7 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:38.482628 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50ddf7-aa6d-4602-b1f2-f109ff28cde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:38.482900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50ddf7-aa6d-4602-b1f2-f109ff28cde7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:38.490312 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50ddf7-aa6d-4602-b1f2-f109ff28cde7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:38.492130 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50ddf7-aa6d-4602-b1f2-f109ff28cde7 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:38.500551 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1324 bytes} [Thu Oct 20 14:27:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 14:27:38.506194 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ec473-9e46-4514-817e-ead04abd6710 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:38.515150 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ec473-9e46-4514-817e-ead04abd6710 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:38.519453 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfad93-1bdf-46e0-937d-b8ab2a44ab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:38.520074 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfad93-1bdf-46e0-937d-b8ab2a44ab4c admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:38.520354 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfad93-1bdf-46e0-937d-b8ab2a44ab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:38.520629 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfad93-1bdf-46e0-937d-b8ab2a44ab4c admin admin] PATH_INFO: `/v3/users/f686928c27964f8785160333577196ba` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:38.522530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfad93-1bdf-46e0-937d-b8ab2a44ab4c admin admin] RBAC: Authorizing `identity:get_user(user_id=f686928c27964f8785160333577196ba)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:38.524372 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfad93-1bdf-46e0-937d-b8ab2a44ab4c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:38.525894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 5/9] 10.222.0.17 () {56 vars in 1198 bytes} [Thu Oct 20 14:27:38 2022] GET /identity/v3/users/f686928c27964f8785160333577196ba => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:40.703102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ea220-dfb1-4c1c-88d6-b151ec87f90a None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:40.703641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ea220-dfb1-4c1c-88d6-b151ec87f90a None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:40.703641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ea220-dfb1-4c1c-88d6-b151ec87f90a None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:40.704970 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:27:40.709956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833cccd-daf2-4d32-85ad-57bfd2205211 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:40.710332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833cccd-daf2-4d32-85ad-57bfd2205211 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:40.710509 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833cccd-daf2-4d32-85ad-57bfd2205211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:40.728584 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-9833cccd-daf2-4d32-85ad-57bfd2205211 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:27:40.729758 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-9833cccd-daf2-4d32-85ad-57bfd2205211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:27:40.766559 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43968e34-7fef-4151-9982-816a0b7b29c8 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:40.766847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43968e34-7fef-4151-9982-816a0b7b29c8 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:40.767127 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43968e34-7fef-4151-9982-816a0b7b29c8 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:40.768672 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 6/11] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:27:40.773529 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575cee5-5bd2-4edd-a8c4-32af478ba76b None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:40.773818 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575cee5-5bd2-4edd-a8c4-32af478ba76b None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:40.774120 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575cee5-5bd2-4edd-a8c4-32af478ba76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:40.810471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:27:40.817443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG passlib.handlers.bcrypt [None req-a575cee5-5bd2-4edd-a8c4-32af478ba76b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81802) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 20 14:27:40.817864 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG passlib.handlers.bcrypt [None req-a575cee5-5bd2-4edd-a8c4-32af478ba76b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81802) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 20 14:27:40.868853 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-a575cee5-5bd2-4edd-a8c4-32af478ba76b None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:27:40.870505 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a575cee5-5bd2-4edd-a8c4-32af478ba76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:27:40.973877 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:27:41.082492 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833cccd-daf2-4d32-85ad-57bfd2205211 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:41.107522 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:41.187574 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833cccd-daf2-4d32-85ad-57bfd2205211 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:41.220535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cececb-9839-431c-98be-efdcf3e37c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:41.221168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cececb-9839-431c-98be-efdcf3e37c80 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:41.221451 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cececb-9839-431c-98be-efdcf3e37c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:41.221726 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cececb-9839-431c-98be-efdcf3e37c80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:41.232791 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cececb-9839-431c-98be-efdcf3e37c80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:27:41.242154 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575cee5-5bd2-4edd-a8c4-32af478ba76b None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:41.242356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-f9cececb-9839-431c-98be-efdcf3e37c80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:27:41.242356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:27:41.242356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:27:41.242356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:27:41.242356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:27:41.242356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:27:41.242356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:27:41.242356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:27:41.242356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:27:41.242356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:27:41.242356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:27:41.242356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:27:41.242356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:27:41.242356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:27:41.242356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:27:41.242356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:27:41.244476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:27:41.244476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:27:41.244476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:27:41.244476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:27:41.244476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:27:41.244476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:27:41.244476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:27:41.244476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:27:41.244476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:27:41.244476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:27:41.244476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:27:41.244476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:27:41.244476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:27:41.244476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:27:41.244476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:27:41.244476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:27:41.245954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:27:41.245954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:27:41.245954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:27:41.245954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:27:41.245954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:27:41.245954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:27:41.245954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:27:41.245954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:27:41.245954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:27:41.245954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:27:41.245954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:27:41.245954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:27:41.245954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 7/14] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:27:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:27:41.249388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cececb-9839-431c-98be-efdcf3e37c80 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:41.331099 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:41.348346 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575cee5-5bd2-4edd-a8c4-32af478ba76b None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:41.350719 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:41.352094 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cececb-9839-431c-98be-efdcf3e37c80 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:41.386698 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e50680-f3c0-41bc-bdd6-8cb318dc9e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:41.386950 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec2eab-2321-4632-a121-9ba5ae3add2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:41.387557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec2eab-2321-4632-a121-9ba5ae3add2e None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:41.387664 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e50680-f3c0-41bc-bdd6-8cb318dc9e1a None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:41.387836 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e50680-f3c0-41bc-bdd6-8cb318dc9e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:41.387931 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec2eab-2321-4632-a121-9ba5ae3add2e None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:41.388106 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec2eab-2321-4632-a121-9ba5ae3add2e None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:41.388199 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e50680-f3c0-41bc-bdd6-8cb318dc9e1a None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:41.388769 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec2eab-2321-4632-a121-9ba5ae3add2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:27:41.389072 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec2eab-2321-4632-a121-9ba5ae3add2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:41.389161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e50680-f3c0-41bc-bdd6-8cb318dc9e1a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:41.390506 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec2eab-2321-4632-a121-9ba5ae3add2e None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:41.390609 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e50680-f3c0-41bc-bdd6-8cb318dc9e1a None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:41.401820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.sql.core [None req-b5e50680-f3c0-41bc-bdd6-8cb318dc9e1a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 14:27:41.401820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 14:27:41.401820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [parameters: {'id': '29de1f8f1dff40fb9dcbe35c4275be26', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 20 14:27:41.401820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81802) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 20 14:27:41.402407 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 8/15] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:27:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:27:41.408040 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec2eab-2321-4632-a121-9ba5ae3add2e None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:41.420607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-b5e50680-f3c0-41bc-bdd6-8cb318dc9e1a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 20 14:27:41.420607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:27:41.420607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 14:27:41.420607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 14:27:41.420607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 14:27:41.420607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 14:27:41.420607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 14:27:41.420607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 14:27:41.420607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 14:27:41.420607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application conn.query(q) Oct 20 14:27:41.420607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 14:27:41.420607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 14:27:41.420607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 14:27:41.420607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application result.read() Oct 20 14:27:41.421463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 14:27:41.421463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 14:27:41.421463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 14:27:41.421463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 14:27:41.421463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 14:27:41.421463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 14:27:41.421463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 14:27:41.421463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 14:27:41.421463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 14:27:41.421463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:27:41.421463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 20 14:27:41.421463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:27:41.421463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:27:41.421463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 20 14:27:41.421463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 20 14:27:41.421463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 20 14:27:41.421463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 20 14:27:41.421463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 14:27:41.422417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application next(self.gen) Oct 20 14:27:41.422417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 20 14:27:41.422417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application yield resource Oct 20 14:27:41.422417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 14:27:41.422417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application next(self.gen) Oct 20 14:27:41.422417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 20 14:27:41.422417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self.session.rollback() Oct 20 14:27:41.422417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 20 14:27:41.422417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self.force_reraise() Oct 20 14:27:41.422417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 20 14:27:41.422417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise self.value Oct 20 14:27:41.422417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 20 14:27:41.422417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 20 14:27:41.422417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 20 14:27:41.422417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application session.commit() Oct 20 14:27:41.422417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 20 14:27:41.422417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 20 14:27:41.423256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 20 14:27:41.423256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._prepare_impl() Oct 20 14:27:41.423256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 20 14:27:41.423256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self.session.flush() Oct 20 14:27:41.423256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 20 14:27:41.423256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._flush(objects) Oct 20 14:27:41.423256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 20 14:27:41.423256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 20 14:27:41.423256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 20 14:27:41.423256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application compat.raise_( Oct 20 14:27:41.423256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 14:27:41.423256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception Oct 20 14:27:41.423256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 20 14:27:41.423256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application flush_context.execute() Oct 20 14:27:41.423256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 20 14:27:41.423256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rec.execute(self) Oct 20 14:27:41.423256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 20 14:27:41.424102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 20 14:27:41.424102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 20 14:27:41.424102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 20 14:27:41.424102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 20 14:27:41.424102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 20 14:27:41.424102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 20 14:27:41.424102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 20 14:27:41.424102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 20 14:27:41.424102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 20 14:27:41.424102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 20 14:27:41.424102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 20 14:27:41.424102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 20 14:27:41.424102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 20 14:27:41.424102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 20 14:27:41.424102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 20 14:27:41.424861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 14:27:41.424861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception Oct 20 14:27:41.424861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 14:27:41.424861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 14:27:41.424861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 14:27:41.424861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 14:27:41.424861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 14:27:41.424861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 14:27:41.424861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 14:27:41.424861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application conn.query(q) Oct 20 14:27:41.424861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 14:27:41.424861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 14:27:41.424861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 14:27:41.424861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application result.read() Oct 20 14:27:41.424861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 14:27:41.424861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 14:27:41.424861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 14:27:41.425644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 14:27:41.425644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 14:27:41.425644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 14:27:41.425644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 14:27:41.425644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 14:27:41.425644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 14:27:41.425644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 14:27:41.425644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [parameters: {'id': '29de1f8f1dff40fb9dcbe35c4275be26', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 20 14:27:41.425644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 20 14:27:41.425644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:27:41.425644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:27:41.425644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:27:41.425644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:27:41.425644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 20 14:27:41.425644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 20 14:27:41.426402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 20 14:27:41.426402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 20 14:27:41.426402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 20 14:27:41.426402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:27:41.426402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:27:41.426402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:27:41.426402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:27:41.426402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:27:41.426402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:27:41.426402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:27:41.426402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:27:41.426402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:27:41.426402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:27:41.426402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:27:41.426402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:27:41.426402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:27:41.426402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:27:41.427770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 20 14:27:41.427770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 20 14:27:41.427770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:27:41.427770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:27:41.427770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 20 14:27:41.427770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 20 14:27:41.427770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:27:41.427770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:27:41.427770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 20 14:27:41.427770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 20 14:27:41.427770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 20 14:27:41.427770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:27:41.427770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 8/16] 10.222.0.17 () {60 vars in 1137 bytes} [Thu Oct 20 14:27:41 2022] POST /identity/v3/domains => generated 190 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:27:41.428411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e50680-f3c0-41bc-bdd6-8cb318dc9e1a None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:41.516655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec2eab-2321-4632-a121-9ba5ae3add2e None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:41.531217 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e50680-f3c0-41bc-bdd6-8cb318dc9e1a None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:41.549296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffddee6-9f8c-4c64-8ed3-80589cb47850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:41.549953 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffddee6-9f8c-4c64-8ed3-80589cb47850 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:41.550234 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffddee6-9f8c-4c64-8ed3-80589cb47850 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:41.550501 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffddee6-9f8c-4c64-8ed3-80589cb47850 None admin] PATH_INFO: `/v3/users/f686928c27964f8785160333577196ba` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:41.551617 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffddee6-9f8c-4c64-8ed3-80589cb47850 None admin] RBAC: Authorizing `identity:get_user(user_id=f686928c27964f8785160333577196ba)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:41.553682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffddee6-9f8c-4c64-8ed3-80589cb47850 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:41.555251 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 9/17] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:27:41 2022] GET /identity/v3/users/f686928c27964f8785160333577196ba => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:27:41.560867 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffddee6-9f8c-4c64-8ed3-80589cb47850 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:41.565075 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f259e4-6d77-42bd-8391-d2a1ede3da09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:41.565951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f259e4-6d77-42bd-8391-d2a1ede3da09 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:41.566239 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f259e4-6d77-42bd-8391-d2a1ede3da09 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:41.566518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f259e4-6d77-42bd-8391-d2a1ede3da09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:41.575019 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:41.584352 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f259e4-6d77-42bd-8391-d2a1ede3da09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:41.585830 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f259e4-6d77-42bd-8391-d2a1ede3da09 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:41.602231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-e2f259e4-6d77-42bd-8391-d2a1ede3da09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:27:41.602231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:27:41.602231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:27:41.602231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:27:41.602231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:27:41.602231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:27:41.602231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:27:41.602231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:27:41.602231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:27:41.602231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:27:41.602231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:27:41.602231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:27:41.602231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:27:41.602231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:27:41.602231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:27:41.602231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:27:41.603076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:27:41.603076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:27:41.603076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:27:41.603076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:27:41.603076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:27:41.603076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:27:41.603076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:27:41.603076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:27:41.603076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:27:41.603076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:27:41.603076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:27:41.603076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:27:41.603076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:27:41.603076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:27:41.603076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:27:41.603076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:27:41.603076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:27:41.603863 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:27:41.603863 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:27:41.603863 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:27:41.603863 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 9/18] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:27:41.609041 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f259e4-6d77-42bd-8391-d2a1ede3da09 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:41.630940 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:41.660754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffddee6-9f8c-4c64-8ed3-80589cb47850 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:41.695395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d11884-d627-4528-bb20-66d4141ebf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:41.696023 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d11884-d627-4528-bb20-66d4141ebf21 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:41.696300 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d11884-d627-4528-bb20-66d4141ebf21 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:41.696647 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d11884-d627-4528-bb20-66d4141ebf21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:41.697741 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d11884-d627-4528-bb20-66d4141ebf21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:41.699221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d11884-d627-4528-bb20-66d4141ebf21 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:41.700906 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 10/19] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:27:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:27:41.706279 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d11884-d627-4528-bb20-66d4141ebf21 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:41.708455 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f259e4-6d77-42bd-8391-d2a1ede3da09 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:41.744700 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0bce8-dfdd-4494-a981-30f1171c9791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:41.745305 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0bce8-dfdd-4494-a981-30f1171c9791 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:41.745587 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0bce8-dfdd-4494-a981-30f1171c9791 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:41.745881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0bce8-dfdd-4494-a981-30f1171c9791 None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:41.746532 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0bce8-dfdd-4494-a981-30f1171c9791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:27:41.746834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0bce8-dfdd-4494-a981-30f1171c9791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:41.748221 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0bce8-dfdd-4494-a981-30f1171c9791 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:41.765400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 10/20] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:27:41.788880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:41.810114 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d11884-d627-4528-bb20-66d4141ebf21 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:41.845227 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0f414-65c9-41d1-bde8-ef459eb75254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:41.845934 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0f414-65c9-41d1-bde8-ef459eb75254 None admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:41.846239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0f414-65c9-41d1-bde8-ef459eb75254 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:41.846517 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0f414-65c9-41d1-bde8-ef459eb75254 None admin] PATH_INFO: `/v3/domains/default/users/f686928c27964f8785160333577196ba/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:41.848487 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0f414-65c9-41d1-bde8-ef459eb75254 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f686928c27964f8785160333577196ba, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:41.850518 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0f414-65c9-41d1-bde8-ef459eb75254 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:41.965394 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 11/21] 10.222.0.17 () {58 vars in 1361 bytes} [Thu Oct 20 14:27:41 2022] PUT /identity/v3/domains/default/users/f686928c27964f8785160333577196ba/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:27:44.435953 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6177a-d778-4de5-946f-8fd08eaf6dc1 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:44.436433 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6177a-d778-4de5-946f-8fd08eaf6dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:44.436433 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6177a-d778-4de5-946f-8fd08eaf6dc1 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:44.437900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 11/22] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:27:44.444585 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4429c-1238-462f-b234-123b30ab6e92 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:44.445092 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4429c-1238-462f-b234-123b30ab6e92 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:44.445162 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4429c-1238-462f-b234-123b30ab6e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:44.472519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-61a4429c-1238-462f-b234-123b30ab6e92 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:27:44.474657 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-61a4429c-1238-462f-b234-123b30ab6e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:27:44.566505 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 12/23] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:27:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:27:44.623190 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180d7d6-f431-42e0-a2bd-9f385fe5e0cf None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:44.623368 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf91d6-50ac-436b-8c77-0fb07876d328 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:44.623571 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180d7d6-f431-42e0-a2bd-9f385fe5e0cf None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:44.623662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf91d6-50ac-436b-8c77-0fb07876d328 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:44.623843 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf91d6-50ac-436b-8c77-0fb07876d328 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:44.623930 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180d7d6-f431-42e0-a2bd-9f385fe5e0cf None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:44.625292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 12/24] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:27:44.628281 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 13/25] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:27:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:27:44.630964 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fa649-dca0-457a-bb8e-fb002826dcfc None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:44.631212 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fa649-dca0-457a-bb8e-fb002826dcfc None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:44.631400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fa649-dca0-457a-bb8e-fb002826dcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:44.635021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c1dd3-f7d9-46e1-af7c-5407248578ae None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:44.635311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c1dd3-f7d9-46e1-af7c-5407248578ae None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:44.635588 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c1dd3-f7d9-46e1-af7c-5407248578ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:44.658113 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-be6c1dd3-f7d9-46e1-af7c-5407248578ae None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:27:44.658808 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-665fa649-dca0-457a-bb8e-fb002826dcfc None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:27:44.659331 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-be6c1dd3-f7d9-46e1-af7c-5407248578ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:27:44.659968 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-665fa649-dca0-457a-bb8e-fb002826dcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:27:44.796530 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 13/26] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:27:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:27:44.799840 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:44.807642 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 14/27] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:27:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:27:44.861967 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70476d11-cf77-4081-acba-ce5ae0e6bf1b None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:44.862390 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70476d11-cf77-4081-acba-ce5ae0e6bf1b None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:44.862674 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70476d11-cf77-4081-acba-ce5ae0e6bf1b None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:44.864129 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 14/28] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:27:44.870369 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bd208-b3ad-43c6-afe3-99bcd129f9ed None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:44.870755 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bd208-b3ad-43c6-afe3-99bcd129f9ed None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:44.871002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bd208-b3ad-43c6-afe3-99bcd129f9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:44.899641 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-9f6bd208-b3ad-43c6-afe3-99bcd129f9ed None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:27:44.900833 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-9f6bd208-b3ad-43c6-afe3-99bcd129f9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:27:44.902331 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70476d11-cf77-4081-acba-ce5ae0e6bf1b None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:44.919170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:45.036590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 15/29] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:27:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:27:45.092784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70476d11-cf77-4081-acba-ce5ae0e6bf1b None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:45.138541 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3fa5b-2964-48c3-8032-3dfdc5c12206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:45.139174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3fa5b-2964-48c3-8032-3dfdc5c12206 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:45.139450 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3fa5b-2964-48c3-8032-3dfdc5c12206 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:45.139718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3fa5b-2964-48c3-8032-3dfdc5c12206 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:45.162688 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3fa5b-2964-48c3-8032-3dfdc5c12206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:27:45.183606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-5cf3fa5b-2964-48c3-8032-3dfdc5c12206 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:27:45.183606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:27:45.183606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:27:45.183606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:27:45.183606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:27:45.183606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:27:45.183606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:27:45.183606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:27:45.183606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:27:45.183606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:27:45.183606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:27:45.183606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:27:45.183606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:27:45.183606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:27:45.183606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:27:45.183606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:27:45.184415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:27:45.184415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:27:45.184415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:27:45.184415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:27:45.184415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:27:45.184415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:27:45.184415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:27:45.184415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:27:45.184415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:27:45.184415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:27:45.184415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:27:45.184415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:27:45.184415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:27:45.184415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:27:45.184415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:27:45.184415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:27:45.185161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:27:45.185161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:27:45.185161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:27:45.185161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:27:45.185161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:27:45.185161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:27:45.185161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:27:45.185161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:27:45.185161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:27:45.185161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:27:45.185161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:27:45.185161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:27:45.185161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 15/30] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:27:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:27:45.191803 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bd208-b3ad-43c6-afe3-99bcd129f9ed None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:45.224447 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3fa5b-2964-48c3-8032-3dfdc5c12206 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:45.342987 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:45.363426 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bd208-b3ad-43c6-afe3-99bcd129f9ed None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:45.402698 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3fa5b-2964-48c3-8032-3dfdc5c12206 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:45.426226 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:45.439091 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a68f8-55bb-45a3-bae2-f8818615686b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:45.439730 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a68f8-55bb-45a3-bae2-f8818615686b None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:45.440013 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a68f8-55bb-45a3-bae2-f8818615686b None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:45.440373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a68f8-55bb-45a3-bae2-f8818615686b None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:45.441000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995d3d3-d8c1-4152-aea2-c4e1094bc9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:45.441635 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995d3d3-d8c1-4152-aea2-c4e1094bc9cf None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:45.441905 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a68f8-55bb-45a3-bae2-f8818615686b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:27:45.442011 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995d3d3-d8c1-4152-aea2-c4e1094bc9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:45.442203 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995d3d3-d8c1-4152-aea2-c4e1094bc9cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:45.443108 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a68f8-55bb-45a3-bae2-f8818615686b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:45.444889 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a68f8-55bb-45a3-bae2-f8818615686b None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:45.455581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995d3d3-d8c1-4152-aea2-c4e1094bc9cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:45.456577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 16/31] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:27:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:45.457130 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995d3d3-d8c1-4152-aea2-c4e1094bc9cf None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:45.458080 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a68f8-55bb-45a3-bae2-f8818615686b None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:45.472547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-2995d3d3-d8c1-4152-aea2-c4e1094bc9cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:27:45.472547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:27:45.472547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:27:45.472547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:27:45.472547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:27:45.472547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:27:45.472547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:27:45.472547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:27:45.472547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:27:45.472547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:27:45.472547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:27:45.472547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:27:45.472547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:27:45.472547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:27:45.472547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:27:45.472547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:27:45.473428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:27:45.473428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:27:45.473428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:27:45.473428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:27:45.473428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:27:45.473428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:27:45.473428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:27:45.473428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:27:45.473428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:27:45.473428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:27:45.473428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:27:45.473428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:27:45.473428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:27:45.473428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:27:45.473428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:27:45.473428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:27:45.473428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:27:45.474279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:27:45.474279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:27:45.474279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:27:45.474279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 16/32] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:27:45.474561 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995d3d3-d8c1-4152-aea2-c4e1094bc9cf None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:45.580365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a68f8-55bb-45a3-bae2-f8818615686b None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:45.604123 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995d3d3-d8c1-4152-aea2-c4e1094bc9cf None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:45.626470 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c13b7-6022-41fa-b65b-5fa03c8b805e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:45.627313 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c13b7-6022-41fa-b65b-5fa03c8b805e None admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:45.627980 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:45.628681 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c13b7-6022-41fa-b65b-5fa03c8b805e None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:45.629425 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c13b7-6022-41fa-b65b-5fa03c8b805e None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:45.630323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c13b7-6022-41fa-b65b-5fa03c8b805e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:45.632313 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c13b7-6022-41fa-b65b-5fa03c8b805e None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:45.641578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b327c58-1271-47b1-90d5-43fdee26bbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:45.642425 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b327c58-1271-47b1-90d5-43fdee26bbeb None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:45.642742 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b327c58-1271-47b1-90d5-43fdee26bbeb None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:45.643104 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b327c58-1271-47b1-90d5-43fdee26bbeb None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:45.643764 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b327c58-1271-47b1-90d5-43fdee26bbeb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:45.647769 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b327c58-1271-47b1-90d5-43fdee26bbeb None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:45.658167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 17/33] 10.222.0.17 () {60 vars in 1131 bytes} [Thu Oct 20 14:27:45 2022] POST /identity/v3/roles => generated 219 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:27:45.658830 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c13b7-6022-41fa-b65b-5fa03c8b805e None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:45.725716 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:45.778634 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 17/34] 10.222.0.17 () {60 vars in 1131 bytes} [Thu Oct 20 14:27:45 2022] POST /identity/v3/roles => generated 225 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:27:45.779566 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b327c58-1271-47b1-90d5-43fdee26bbeb None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:45.786226 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c13b7-6022-41fa-b65b-5fa03c8b805e None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:45.834281 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3b72c-c966-4b55-a358-d94ef51d24de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:45.835565 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3b72c-c966-4b55-a358-d94ef51d24de None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:45.836059 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3b72c-c966-4b55-a358-d94ef51d24de None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:45.836532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3b72c-c966-4b55-a358-d94ef51d24de None admin] PATH_INFO: `/v3/users/f686928c27964f8785160333577196ba` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:45.838549 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3b72c-c966-4b55-a358-d94ef51d24de None admin] RBAC: Authorizing `identity:get_user(user_id=f686928c27964f8785160333577196ba)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:45.840388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3b72c-c966-4b55-a358-d94ef51d24de None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:45.842481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 18/35] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:27:45 2022] GET /identity/v3/users/f686928c27964f8785160333577196ba => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:45.851581 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3b72c-c966-4b55-a358-d94ef51d24de None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:46.033500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b327c58-1271-47b1-90d5-43fdee26bbeb None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:46.042412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3b72c-c966-4b55-a358-d94ef51d24de None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:46.065541 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:46.079317 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64edec-c365-4cd1-9017-14467982e4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:46.080285 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64edec-c365-4cd1-9017-14467982e4ee None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:46.080769 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64edec-c365-4cd1-9017-14467982e4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:46.081308 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64edec-c365-4cd1-9017-14467982e4ee None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:46.082313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64edec-c365-4cd1-9017-14467982e4ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:27:46.082775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64edec-c365-4cd1-9017-14467982e4ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:46.084074 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a312d4-3ca1-4f78-a064-42e57dcffe9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:46.085167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a312d4-3ca1-4f78-a064-42e57dcffe9f None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:46.085167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a312d4-3ca1-4f78-a064-42e57dcffe9f None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:46.085362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a312d4-3ca1-4f78-a064-42e57dcffe9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:46.086012 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64edec-c365-4cd1-9017-14467982e4ee None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:46.086522 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a312d4-3ca1-4f78-a064-42e57dcffe9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:46.088660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a312d4-3ca1-4f78-a064-42e57dcffe9f None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:46.089633 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 19/36] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:27:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:46.090837 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94641e6-68fd-401c-ab6d-9999a6e3fa88 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:46.091121 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94641e6-68fd-401c-ab6d-9999a6e3fa88 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:46.091398 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94641e6-68fd-401c-ab6d-9999a6e3fa88 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:46.092797 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 20/37] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:27:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:27:46.097515 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94641e6-68fd-401c-ab6d-9999a6e3fa88 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:46.106663 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 18/38] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:46.108483 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60ec27-d905-4684-bc2f-12ccd514f19c None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:46.108956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60ec27-d905-4684-bc2f-12ccd514f19c None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:46.109403 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60ec27-d905-4684-bc2f-12ccd514f19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:46.131546 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-2d60ec27-d905-4684-bc2f-12ccd514f19c None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:27:46.133591 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-2d60ec27-d905-4684-bc2f-12ccd514f19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:27:46.181313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:46.216359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 19/39] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:27:46.217270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60ec27-d905-4684-bc2f-12ccd514f19c None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:46.328433 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94641e6-68fd-401c-ab6d-9999a6e3fa88 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:46.356815 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60ec27-d905-4684-bc2f-12ccd514f19c None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:46.366446 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81ec1f-3130-4de7-8ab3-5396cd973090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:46.367244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81ec1f-3130-4de7-8ab3-5396cd973090 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:46.367352 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81ec1f-3130-4de7-8ab3-5396cd973090 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:46.367597 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81ec1f-3130-4de7-8ab3-5396cd973090 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:46.368327 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81ec1f-3130-4de7-8ab3-5396cd973090 None admin] RBAC: Adding query filter params (role.id=fe3ee5741c6143adb5459b5de54450c8, scope.domain.id=default, user.id=f686928c27964f8785160333577196ba) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:27:46.368631 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81ec1f-3130-4de7-8ab3-5396cd973090 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:46.370328 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81ec1f-3130-4de7-8ab3-5396cd973090 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:46.377740 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 21/40] 10.222.0.17 () {56 vars in 1322 bytes} [Thu Oct 20 14:27:46 2022] GET /identity/v3/role_assignments?user.id=f686928c27964f8785160333577196ba&scope.domain.id=default&role.id=fe3ee5741c6143adb5459b5de54450c8 => generated 530 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:46.401439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fea4a-c3b1-46a5-923e-00f03ae2f256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:46.402507 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fea4a-c3b1-46a5-923e-00f03ae2f256 None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:46.403035 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fea4a-c3b1-46a5-923e-00f03ae2f256 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:46.403509 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fea4a-c3b1-46a5-923e-00f03ae2f256 None admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:46.404390 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fea4a-c3b1-46a5-923e-00f03ae2f256 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:46.406257 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fea4a-c3b1-46a5-923e-00f03ae2f256 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:46.409941 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b459fbc-438e-4a60-9507-0400f6128f0c None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:46.410239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b459fbc-438e-4a60-9507-0400f6128f0c None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:46.410527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b459fbc-438e-4a60-9507-0400f6128f0c None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:46.412172 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 22/41] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:27:46.417884 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898763c-4465-40ce-bb6b-4d9a9497cbdf None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:46.418327 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898763c-4465-40ce-bb6b-4d9a9497cbdf None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:46.418712 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898763c-4465-40ce-bb6b-4d9a9497cbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:46.440071 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-a898763c-4465-40ce-bb6b-4d9a9497cbdf None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:27:46.441591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a898763c-4465-40ce-bb6b-4d9a9497cbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:27:46.443470 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 20/42] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Oct 20 14:27:46 2022] POST /identity/v3/projects => generated 301 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:27:46.492532 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fea4a-c3b1-46a5-923e-00f03ae2f256 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:46.526222 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:46.526779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:46.533448 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 23/43] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:27:46.617884 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fea4a-c3b1-46a5-923e-00f03ae2f256 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:46.657068 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a3676-feb9-482e-ae8b-d0bf2142c2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:46.657687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a3676-feb9-482e-ae8b-d0bf2142c2e7 None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:46.658001 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a3676-feb9-482e-ae8b-d0bf2142c2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:46.658274 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a3676-feb9-482e-ae8b-d0bf2142c2e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:46.658953 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a3676-feb9-482e-ae8b-d0bf2142c2e7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:46.660343 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a3676-feb9-482e-ae8b-d0bf2142c2e7 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:46.679780 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 21/44] 10.222.0.17 () {60 vars in 1131 bytes} [Thu Oct 20 14:27:46 2022] POST /identity/v3/roles => generated 223 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:27:46.812133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898763c-4465-40ce-bb6b-4d9a9497cbdf None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:46.918390 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898763c-4465-40ce-bb6b-4d9a9497cbdf None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:46.951156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2fd32-17e2-42bd-8a42-78ea9d8e8a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:46.951785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2fd32-17e2-42bd-8a42-78ea9d8e8a8d None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:46.952071 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2fd32-17e2-42bd-8a42-78ea9d8e8a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:46.952346 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2fd32-17e2-42bd-8a42-78ea9d8e8a8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:46.953438 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2fd32-17e2-42bd-8a42-78ea9d8e8a8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:46.954916 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2fd32-17e2-42bd-8a42-78ea9d8e8a8d None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:46.956470 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 24/45] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:27:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:46.962860 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a3676-feb9-482e-ae8b-d0bf2142c2e7 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:47.044171 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:47.059965 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a3676-feb9-482e-ae8b-d0bf2142c2e7 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:47.092359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0a39a-4467-4017-a5d5-ab3cd9b06cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:47.092951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0a39a-4467-4017-a5d5-ab3cd9b06cc4 None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:47.093230 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0a39a-4467-4017-a5d5-ab3cd9b06cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:47.093501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0a39a-4467-4017-a5d5-ab3cd9b06cc4 None admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:47.094179 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0a39a-4467-4017-a5d5-ab3cd9b06cc4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:47.095600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0a39a-4467-4017-a5d5-ab3cd9b06cc4 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:47.121023 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 22/46] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Oct 20 14:27:46 2022] POST /identity/v3/projects => generated 312 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:27:49.238309 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845af8c5-17a3-45d4-9e71-3f82fb009bd3 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:49.238785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845af8c5-17a3-45d4-9e71-3f82fb009bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:49.238908 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845af8c5-17a3-45d4-9e71-3f82fb009bd3 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:49.240850 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 25/47] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:27:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:27:49.245975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77679d44-cb34-4fff-ba3f-400255f0ebc1 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:49.246358 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77679d44-cb34-4fff-ba3f-400255f0ebc1 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:49.246538 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77679d44-cb34-4fff-ba3f-400255f0ebc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:49.264327 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-77679d44-cb34-4fff-ba3f-400255f0ebc1 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:27:49.265527 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-77679d44-cb34-4fff-ba3f-400255f0ebc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:27:49.329757 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 23/48] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:27:49.595097 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845af8c5-17a3-45d4-9e71-3f82fb009bd3 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:49.644442 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:49.693694 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845af8c5-17a3-45d4-9e71-3f82fb009bd3 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:49.726379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49061af1-6476-401e-ad17-7af1ce8d5a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:49.727001 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49061af1-6476-401e-ad17-7af1ce8d5a58 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:49.727278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49061af1-6476-401e-ad17-7af1ce8d5a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:49.727549 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49061af1-6476-401e-ad17-7af1ce8d5a58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:49.728633 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49061af1-6476-401e-ad17-7af1ce8d5a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:49.730097 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49061af1-6476-401e-ad17-7af1ce8d5a58 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:49.731615 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 26/49] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:27:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:49.737098 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77679d44-cb34-4fff-ba3f-400255f0ebc1 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:49.799318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:49.835557 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77679d44-cb34-4fff-ba3f-400255f0ebc1 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:49.868051 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3f562-8000-46c5-8829-ba51a3e3dc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:49.868568 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3f562-8000-46c5-8829-ba51a3e3dc61 None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:49.868845 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3f562-8000-46c5-8829-ba51a3e3dc61 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:49.869113 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3f562-8000-46c5-8829-ba51a3e3dc61 None admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:49.869759 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3f562-8000-46c5-8829-ba51a3e3dc61 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:49.871231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3f562-8000-46c5-8829-ba51a3e3dc61 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:49.895209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 24/50] 10.222.0.17 () {60 vars in 1140 bytes} [Thu Oct 20 14:27:49 2022] POST /identity/v3/projects => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:27:52.019694 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac27ff6-a5e5-43c6-b5e8-a2fedd5165e4 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:52.020241 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac27ff6-a5e5-43c6-b5e8-a2fedd5165e4 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:52.020344 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac27ff6-a5e5-43c6-b5e8-a2fedd5165e4 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:52.021659 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 27/51] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:27:52.026746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbede83-8548-4d4e-9c90-ebff9761e3ac None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:52.027138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbede83-8548-4d4e-9c90-ebff9761e3ac None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:52.027307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbede83-8548-4d4e-9c90-ebff9761e3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:52.045600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-bdbede83-8548-4d4e-9c90-ebff9761e3ac None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:27:52.046816 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-bdbede83-8548-4d4e-9c90-ebff9761e3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:27:52.110760 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 25/52] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:27:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:27:52.384118 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac27ff6-a5e5-43c6-b5e8-a2fedd5165e4 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:52.483231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac27ff6-a5e5-43c6-b5e8-a2fedd5165e4 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:52.499787 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:52.516360 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee0e9c-97c0-4ae7-98fb-8ceeeae6a4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:52.516988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee0e9c-97c0-4ae7-98fb-8ceeeae6a4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:52.517271 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee0e9c-97c0-4ae7-98fb-8ceeeae6a4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:52.517547 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee0e9c-97c0-4ae7-98fb-8ceeeae6a4f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:52.518675 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee0e9c-97c0-4ae7-98fb-8ceeeae6a4f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:52.520622 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee0e9c-97c0-4ae7-98fb-8ceeeae6a4f2 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:52.522222 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 28/53] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:27:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:52.527697 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbede83-8548-4d4e-9c90-ebff9761e3ac None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:52.574636 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:52.624586 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbede83-8548-4d4e-9c90-ebff9761e3ac None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:52.656870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db48e6c-3c50-4a91-bfda-8a1926629e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:52.657415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db48e6c-3c50-4a91-bfda-8a1926629e4f None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:52.657696 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db48e6c-3c50-4a91-bfda-8a1926629e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:52.657998 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db48e6c-3c50-4a91-bfda-8a1926629e4f None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:52.658648 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db48e6c-3c50-4a91-bfda-8a1926629e4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:52.660094 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db48e6c-3c50-4a91-bfda-8a1926629e4f None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:52.687352 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 26/54] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Oct 20 14:27:52 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:27:56.002082 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb8a6a-d5a9-4a62-ae13-254d57e34aaa None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:56.003108 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb8a6a-d5a9-4a62-ae13-254d57e34aaa None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:56.003604 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb8a6a-d5a9-4a62-ae13-254d57e34aaa None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:56.006134 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 29/55] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:27:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:27:56.011341 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb24d50-ead8-4c5a-8318-8709cc9d78dc None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:56.012155 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb24d50-ead8-4c5a-8318-8709cc9d78dc None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:56.012641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb24d50-ead8-4c5a-8318-8709cc9d78dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:56.031584 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522ffd8-e3e8-4828-a79f-3f3bbb8cd3ee None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:56.032208 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522ffd8-e3e8-4828-a79f-3f3bbb8cd3ee None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:56.032682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522ffd8-e3e8-4828-a79f-3f3bbb8cd3ee None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:56.034324 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 30/56] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:27:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:27:56.041012 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2463313-8b83-4437-a94b-3137026297a3 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:56.041656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2463313-8b83-4437-a94b-3137026297a3 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:56.042178 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2463313-8b83-4437-a94b-3137026297a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:56.062954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-c2463313-8b83-4437-a94b-3137026297a3 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:27:56.064506 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-c2463313-8b83-4437-a94b-3137026297a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:27:56.141864 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 31/57] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:27:56.151766 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b5198-ec4b-4aae-a7cd-0a7b14a8547c None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:56.152284 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b5198-ec4b-4aae-a7cd-0a7b14a8547c None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:56.152755 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b5198-ec4b-4aae-a7cd-0a7b14a8547c None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:56.154358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 32/58] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:27:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:27:56.159598 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4af43-e78f-48ac-8e23-7e569f810120 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:56.159743 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-0cb24d50-ead8-4c5a-8318-8709cc9d78dc None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:27:56.160310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4af43-e78f-48ac-8e23-7e569f810120 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:56.160870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-0cb24d50-ead8-4c5a-8318-8709cc9d78dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:27:56.160974 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4af43-e78f-48ac-8e23-7e569f810120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:56.194878 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-9af4af43-e78f-48ac-8e23-7e569f810120 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:27:56.196084 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-9af4af43-e78f-48ac-8e23-7e569f810120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:27:56.276589 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 27/59] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:27:56.319177 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 33/60] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:27:56.538748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221adfa-eeb8-4453-8a97-d7fe9054dea2 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:56.539421 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221adfa-eeb8-4453-8a97-d7fe9054dea2 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:56.539899 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221adfa-eeb8-4453-8a97-d7fe9054dea2 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:56.541477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 28/61] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:27:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:27:56.546813 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54558b5d-6695-4b35-9bff-e6cee3f556f9 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:56.547102 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54558b5d-6695-4b35-9bff-e6cee3f556f9 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:56.547382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54558b5d-6695-4b35-9bff-e6cee3f556f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:56.562525 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221adfa-eeb8-4453-8a97-d7fe9054dea2 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:56.573430 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-54558b5d-6695-4b35-9bff-e6cee3f556f9 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:27:56.575022 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-54558b5d-6695-4b35-9bff-e6cee3f556f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:27:56.614000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:56.628803 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:56.656059 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 34/62] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:27:56.657237 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54558b5d-6695-4b35-9bff-e6cee3f556f9 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:56.693516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221adfa-eeb8-4453-8a97-d7fe9054dea2 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:56.731049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc20be-aabb-4845-bcf5-d0a535b1519e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:56.731895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc20be-aabb-4845-bcf5-d0a535b1519e None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:56.732340 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc20be-aabb-4845-bcf5-d0a535b1519e None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:56.732869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc20be-aabb-4845-bcf5-d0a535b1519e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:56.744131 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc20be-aabb-4845-bcf5-d0a535b1519e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:27:56.750269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-4bcc20be-aabb-4845-bcf5-d0a535b1519e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:27:56.750269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:27:56.750269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:27:56.750269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:27:56.750269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:27:56.750269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:27:56.750269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:27:56.750269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:27:56.750269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:27:56.750269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:27:56.750269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:27:56.750269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:27:56.750269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:27:56.750269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:27:56.750269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:27:56.750269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:27:56.751192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:27:56.751192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:27:56.751192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:27:56.751192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:27:56.751192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:27:56.751192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:27:56.751192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:27:56.751192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:27:56.751192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:27:56.751192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:27:56.751192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:27:56.751192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:27:56.751192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:27:56.751192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:27:56.751192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:27:56.751192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:27:56.751922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:27:56.751922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:27:56.751922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:27:56.751922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:27:56.751922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:27:56.751922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:27:56.751922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:27:56.751922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:27:56.751922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:27:56.751922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:27:56.751922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:27:56.751922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:27:56.752486 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 29/63] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:27:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:27:56.756115 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a4a27-5d61-4eca-b806-cd67000c9f5d None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:56.756583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a4a27-5d61-4eca-b806-cd67000c9f5d None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:56.757293 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a4a27-5d61-4eca-b806-cd67000c9f5d None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:56.759743 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 30/64] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:27:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:27:56.760610 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54558b5d-6695-4b35-9bff-e6cee3f556f9 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:56.760841 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a4a27-5d61-4eca-b806-cd67000c9f5d None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:56.795687 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d40395-f382-4c0a-a710-ce0cf139c5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:56.796251 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d40395-f382-4c0a-a710-ce0cf139c5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:56.796535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d40395-f382-4c0a-a710-ce0cf139c5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:56.796809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d40395-f382-4c0a-a710-ce0cf139c5a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:56.808044 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d40395-f382-4c0a-a710-ce0cf139c5a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:27:56.812956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-f3d40395-f382-4c0a-a710-ce0cf139c5a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:27:56.812956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:27:56.812956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:27:56.812956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:27:56.812956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:27:56.812956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:27:56.812956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:27:56.812956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:27:56.812956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:27:56.812956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:27:56.812956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:27:56.812956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:27:56.812956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:27:56.812956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:27:56.812956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:27:56.812956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:27:56.813790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:27:56.813790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:27:56.813790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:27:56.813790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:27:56.813790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:27:56.813790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:27:56.813790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:27:56.813790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:27:56.813790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:27:56.813790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:27:56.813790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:27:56.813790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:27:56.813790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:27:56.813790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:27:56.813790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:27:56.813790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:27:56.814674 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:27:56.814674 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:27:56.814674 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:27:56.814674 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:27:56.814674 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:27:56.814674 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:27:56.814674 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:27:56.814674 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:27:56.814674 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:27:56.814674 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:27:56.814674 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:27:56.814674 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:27:56.814674 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 35/65] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:27:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:27:56.815316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d40395-f382-4c0a-a710-ce0cf139c5a1 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:56.853234 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:56.867178 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:56.875143 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a4a27-5d61-4eca-b806-cd67000c9f5d None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:56.914073 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be543047-7dea-45da-9f37-bf597e2f2bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:56.914713 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be543047-7dea-45da-9f37-bf597e2f2bca None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:56.914994 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be543047-7dea-45da-9f37-bf597e2f2bca None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:56.915274 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be543047-7dea-45da-9f37-bf597e2f2bca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:56.923210 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d40395-f382-4c0a-a710-ce0cf139c5a1 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:56.926710 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be543047-7dea-45da-9f37-bf597e2f2bca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:27:56.931573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-be543047-7dea-45da-9f37-bf597e2f2bca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 14:27:56.931573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:27:56.931573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:27:56.931573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:27:56.931573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:27:56.931573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:27:56.931573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:27:56.931573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:27:56.931573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:27:56.931573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:27:56.931573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:27:56.931573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:27:56.931573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:27:56.931573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:27:56.931573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:27:56.931573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:27:56.932662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:27:56.932662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:27:56.932662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:27:56.932662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:27:56.932662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:27:56.932662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:27:56.932662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:27:56.932662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:27:56.932662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:27:56.932662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:27:56.932662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:27:56.932662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:27:56.932662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:27:56.932662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:27:56.932662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:27:56.932662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:27:56.933417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:27:56.933417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:27:56.933417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:27:56.933417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:27:56.933417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:27:56.933417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:27:56.933417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:27:56.933417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:27:56.933417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:27:56.933417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:27:56.933417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 14:27:56.933417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:27:56.933417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 31/66] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Oct 20 14:27:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:27:56.935013 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28d017-9f70-4155-8b95-98a6801f106f None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:56.935299 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28d017-9f70-4155-8b95-98a6801f106f None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:56.935580 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28d017-9f70-4155-8b95-98a6801f106f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:56.954214 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-7c28d017-9f70-4155-8b95-98a6801f106f None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:27:56.955421 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-7c28d017-9f70-4155-8b95-98a6801f106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:27:56.963243 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2746d-e971-4f79-bcca-66f4c5f80a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:56.963853 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2746d-e971-4f79-bcca-66f4c5f80a08 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:56.964139 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2746d-e971-4f79-bcca-66f4c5f80a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:56.964414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2746d-e971-4f79-bcca-66f4c5f80a08 None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:56.965080 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2746d-e971-4f79-bcca-66f4c5f80a08 None admin] RBAC: Adding query filter params (name=member) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:27:56.965379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2746d-e971-4f79-bcca-66f4c5f80a08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:56.966805 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2746d-e971-4f79-bcca-66f4c5f80a08 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:56.974671 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 36/67] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Oct 20 14:27:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:56.974671 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2746d-e971-4f79-bcca-66f4c5f80a08 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:57.023354 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 32/68] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:27:57.024200 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28d017-9f70-4155-8b95-98a6801f106f None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:57.085522 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:57.090294 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2746d-e971-4f79-bcca-66f4c5f80a08 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:57.115856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:57.125710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc10c4b-4389-437d-9e24-2c523d322544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:57.126432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc10c4b-4389-437d-9e24-2c523d322544 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:57.126714 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc10c4b-4389-437d-9e24-2c523d322544 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:57.126999 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc10c4b-4389-437d-9e24-2c523d322544 None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:57.127670 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc10c4b-4389-437d-9e24-2c523d322544 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:27:57.127990 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc10c4b-4389-437d-9e24-2c523d322544 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:57.129576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc10c4b-4389-437d-9e24-2c523d322544 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:57.133129 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28d017-9f70-4155-8b95-98a6801f106f None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:57.137944 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 37/69] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:27:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:57.142750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc10c4b-4389-437d-9e24-2c523d322544 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:57.174256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a34e5-5a9f-40a4-ade4-1edaed380e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:57.174883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a34e5-5a9f-40a4-ade4-1edaed380e27 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:57.175168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a34e5-5a9f-40a4-ade4-1edaed380e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:57.175448 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a34e5-5a9f-40a4-ade4-1edaed380e27 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:57.176814 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a34e5-5a9f-40a4-ade4-1edaed380e27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:27:57.177172 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a34e5-5a9f-40a4-ade4-1edaed380e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:57.178615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a34e5-5a9f-40a4-ade4-1edaed380e27 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:57.192514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 33/70] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:27:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:57.193673 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a34e5-5a9f-40a4-ade4-1edaed380e27 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:57.251149 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc10c4b-4389-437d-9e24-2c523d322544 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:57.290149 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cc1cb-0a1c-43cb-aeba-df405ac1cf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:57.290798 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cc1cb-0a1c-43cb-aeba-df405ac1cf1a None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:57.291087 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cc1cb-0a1c-43cb-aeba-df405ac1cf1a None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:57.291366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cc1cb-0a1c-43cb-aeba-df405ac1cf1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:57.298654 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a34e5-5a9f-40a4-ade4-1edaed380e27 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:57.301744 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083cc1cb-0a1c-43cb-aeba-df405ac1cf1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:27:57.307365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-083cc1cb-0a1c-43cb-aeba-df405ac1cf1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:27:57.307365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:27:57.307365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:27:57.307365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:27:57.307365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:27:57.307365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:27:57.307365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:27:57.307365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:27:57.307365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:27:57.307365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:27:57.307365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:27:57.307365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:27:57.307365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:27:57.307365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:27:57.307365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:27:57.307365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:27:57.308209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:27:57.308209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:27:57.308209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:27:57.308209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:27:57.308209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:27:57.308209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:27:57.308209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:27:57.308209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:27:57.308209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:27:57.308209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:27:57.308209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:27:57.308209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:27:57.308209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:27:57.308209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:27:57.308209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:27:57.308209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:27:57.308961 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:27:57.308961 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:27:57.308961 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:27:57.308961 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:27:57.308961 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:27:57.308961 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:27:57.308961 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:27:57.308961 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:27:57.308961 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:27:57.308961 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:27:57.308961 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:27:57.308961 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:27:57.308961 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 38/71] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:27:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:27:57.309584 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cc1cb-0a1c-43cb-aeba-df405ac1cf1a None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:57.331594 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:57.333794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730234d7-4a37-4396-b7da-3d4e46a5492e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:57.334467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730234d7-4a37-4396-b7da-3d4e46a5492e None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:57.334803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730234d7-4a37-4396-b7da-3d4e46a5492e None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:57.335048 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730234d7-4a37-4396-b7da-3d4e46a5492e None admin] PATH_INFO: `/v3/users/b2cb9e39aae44ad29f4b41f3797d7ebc` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:57.350149 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730234d7-4a37-4396-b7da-3d4e46a5492e None admin] RBAC: Authorizing `identity:get_user(user_id=b2cb9e39aae44ad29f4b41f3797d7ebc)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:57.351558 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730234d7-4a37-4396-b7da-3d4e46a5492e None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:57.353180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 34/72] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:27:57 2022] GET /identity/v3/users/b2cb9e39aae44ad29f4b41f3797d7ebc => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:57.353973 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730234d7-4a37-4396-b7da-3d4e46a5492e None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:57.357324 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:57.412285 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cc1cb-0a1c-43cb-aeba-df405ac1cf1a None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:57.445393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c19ff-2231-488a-813f-dda0e8afb798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:57.446062 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c19ff-2231-488a-813f-dda0e8afb798 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:57.446354 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c19ff-2231-488a-813f-dda0e8afb798 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:57.446632 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c19ff-2231-488a-813f-dda0e8afb798 None admin] PATH_INFO: `/v3/users/f686928c27964f8785160333577196ba` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:57.447771 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c19ff-2231-488a-813f-dda0e8afb798 None admin] RBAC: Authorizing `identity:get_user(user_id=f686928c27964f8785160333577196ba)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:57.449229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c19ff-2231-488a-813f-dda0e8afb798 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:57.450823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 39/73] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:27:57 2022] GET /identity/v3/users/f686928c27964f8785160333577196ba => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:57.455346 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c19ff-2231-488a-813f-dda0e8afb798 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:57.455461 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730234d7-4a37-4396-b7da-3d4e46a5492e None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:57.487754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b21f27-d541-4d3f-b19f-19045d0ad84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:57.488427 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b21f27-d541-4d3f-b19f-19045d0ad84d None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:57.488717 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b21f27-d541-4d3f-b19f-19045d0ad84d None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:57.488997 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b21f27-d541-4d3f-b19f-19045d0ad84d None admin] PATH_INFO: `/v3/users/b2cb9e39aae44ad29f4b41f3797d7ebc` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:57.490142 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b21f27-d541-4d3f-b19f-19045d0ad84d None admin] RBAC: Authorizing `identity:get_user(user_id=b2cb9e39aae44ad29f4b41f3797d7ebc)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:57.491578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b21f27-d541-4d3f-b19f-19045d0ad84d None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:57.493296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 35/74] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:27:57 2022] GET /identity/v3/users/b2cb9e39aae44ad29f4b41f3797d7ebc => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:57.494000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b21f27-d541-4d3f-b19f-19045d0ad84d None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:57.540088 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:57.552043 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c19ff-2231-488a-813f-dda0e8afb798 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:57.567635 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:57.586175 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab76bf4-50bb-4d07-9171-08ca63f7bd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:57.586807 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab76bf4-50bb-4d07-9171-08ca63f7bd26 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:57.587089 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab76bf4-50bb-4d07-9171-08ca63f7bd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:57.587364 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab76bf4-50bb-4d07-9171-08ca63f7bd26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:57.588471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab76bf4-50bb-4d07-9171-08ca63f7bd26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:57.589965 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab76bf4-50bb-4d07-9171-08ca63f7bd26 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:57.591504 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 40/75] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:27:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:57.594752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab76bf4-50bb-4d07-9171-08ca63f7bd26 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:57.597460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b21f27-d541-4d3f-b19f-19045d0ad84d None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:57.630641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf198c3-580c-454e-8c9e-9e4a0f4c4a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:57.631180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf198c3-580c-454e-8c9e-9e4a0f4c4a6e None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:57.631466 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf198c3-580c-454e-8c9e-9e4a0f4c4a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:57.631743 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf198c3-580c-454e-8c9e-9e4a0f4c4a6e None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:57.632409 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf198c3-580c-454e-8c9e-9e4a0f4c4a6e None admin] RBAC: Adding query filter params (name=member) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:27:57.632714 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf198c3-580c-454e-8c9e-9e4a0f4c4a6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:57.634126 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf198c3-580c-454e-8c9e-9e4a0f4c4a6e None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:57.642362 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 36/76] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Oct 20 14:27:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:57.647706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf198c3-580c-454e-8c9e-9e4a0f4c4a6e None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:57.693510 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab76bf4-50bb-4d07-9171-08ca63f7bd26 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:57.726016 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ca3c9-b6a7-42fd-a5f6-8ea9de2dac62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:57.726641 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ca3c9-b6a7-42fd-a5f6-8ea9de2dac62 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:57.726919 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ca3c9-b6a7-42fd-a5f6-8ea9de2dac62 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:57.727188 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ca3c9-b6a7-42fd-a5f6-8ea9de2dac62 None admin] PATH_INFO: `/v3/projects/81bdccd201354a0081d7dcd17670b72a` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:57.728306 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ca3c9-b6a7-42fd-a5f6-8ea9de2dac62 None admin] RBAC: Authorizing `identity:get_project(project_id=81bdccd201354a0081d7dcd17670b72a)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:57.729795 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ca3c9-b6a7-42fd-a5f6-8ea9de2dac62 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:57.731428 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 41/77] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:27:57 2022] GET /identity/v3/projects/81bdccd201354a0081d7dcd17670b72a => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:57.732181 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ca3c9-b6a7-42fd-a5f6-8ea9de2dac62 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:57.742403 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf198c3-580c-454e-8c9e-9e4a0f4c4a6e None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:57.758380 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:57.776432 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b7d4b-e2b4-439b-9590-54eae3352b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:57.777050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b7d4b-e2b4-439b-9590-54eae3352b5f None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:57.777350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b7d4b-e2b4-439b-9590-54eae3352b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:57.777603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b7d4b-e2b4-439b-9590-54eae3352b5f None admin] PATH_INFO: `/v3/projects/81bdccd201354a0081d7dcd17670b72a` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:57.778764 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b7d4b-e2b4-439b-9590-54eae3352b5f None admin] RBAC: Authorizing `identity:get_project(project_id=81bdccd201354a0081d7dcd17670b72a)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:57.780193 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b7d4b-e2b4-439b-9590-54eae3352b5f None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:57.781788 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 37/78] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:27:57 2022] GET /identity/v3/projects/81bdccd201354a0081d7dcd17670b72a => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:57.782550 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b7d4b-e2b4-439b-9590-54eae3352b5f None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:57.785135 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:57.835828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ca3c9-b6a7-42fd-a5f6-8ea9de2dac62 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:57.868165 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659bfe99-9edd-4635-b896-4043200d6be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:57.868784 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bfe99-9edd-4635-b896-4043200d6be8 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:57.869066 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bfe99-9edd-4635-b896-4043200d6be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:57.869341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bfe99-9edd-4635-b896-4043200d6be8 None admin] PATH_INFO: `/v3/projects/81bdccd201354a0081d7dcd17670b72a` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:57.870461 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659bfe99-9edd-4635-b896-4043200d6be8 None admin] RBAC: Authorizing `identity:get_project(project_id=81bdccd201354a0081d7dcd17670b72a)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:57.871913 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659bfe99-9edd-4635-b896-4043200d6be8 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:57.873510 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 42/79] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:27:57 2022] GET /identity/v3/projects/81bdccd201354a0081d7dcd17670b72a => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:57.874293 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659bfe99-9edd-4635-b896-4043200d6be8 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:57.882371 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b7d4b-e2b4-439b-9590-54eae3352b5f None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:57.916904 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0bdd6-42e8-4058-87b2-b419ed155ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:57.917506 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0bdd6-42e8-4058-87b2-b419ed155ffc None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:57.917793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0bdd6-42e8-4058-87b2-b419ed155ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:57.918102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0bdd6-42e8-4058-87b2-b419ed155ffc None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:57.918756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0bdd6-42e8-4058-87b2-b419ed155ffc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:57.920178 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0bdd6-42e8-4058-87b2-b419ed155ffc None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:57.940603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 38/80] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Oct 20 14:27:57 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:27:57.941414 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0bdd6-42e8-4058-87b2-b419ed155ffc None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:57.979995 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:57.991914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659bfe99-9edd-4635-b896-4043200d6be8 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:58.008620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:58.033552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d443fd-db95-4e36-a24d-4f86aaa6152f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:58.034241 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d443fd-db95-4e36-a24d-4f86aaa6152f None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:58.034523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d443fd-db95-4e36-a24d-4f86aaa6152f None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:58.034795 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d443fd-db95-4e36-a24d-4f86aaa6152f None admin] PATH_INFO: `/v3/users/b2cb9e39aae44ad29f4b41f3797d7ebc` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:58.036055 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d443fd-db95-4e36-a24d-4f86aaa6152f None admin] RBAC: Authorizing `identity:get_user(user_id=b2cb9e39aae44ad29f4b41f3797d7ebc)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:58.037555 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d443fd-db95-4e36-a24d-4f86aaa6152f None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:58.039436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 43/81] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:27:57 2022] GET /identity/v3/users/b2cb9e39aae44ad29f4b41f3797d7ebc => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:58.040031 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d443fd-db95-4e36-a24d-4f86aaa6152f None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:58.064026 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0bdd6-42e8-4058-87b2-b419ed155ffc None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:58.102753 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea5c33-6254-4972-b58c-876424e0ae43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:58.103441 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea5c33-6254-4972-b58c-876424e0ae43 None admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:58.103726 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea5c33-6254-4972-b58c-876424e0ae43 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:58.104006 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea5c33-6254-4972-b58c-876424e0ae43 None admin] PATH_INFO: `/v3/projects/81bdccd201354a0081d7dcd17670b72a/users/b2cb9e39aae44ad29f4b41f3797d7ebc/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:58.106056 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea5c33-6254-4972-b58c-876424e0ae43 None admin] RBAC: Authorizing `identity:create_grant(project_id=81bdccd201354a0081d7dcd17670b72a, user_id=b2cb9e39aae44ad29f4b41f3797d7ebc, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:58.107533 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea5c33-6254-4972-b58c-876424e0ae43 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:58.129657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 39/82] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:27:57 2022] PUT /identity/v3/projects/81bdccd201354a0081d7dcd17670b72a/users/b2cb9e39aae44ad29f4b41f3797d7ebc/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:27:58.134086 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea5c33-6254-4972-b58c-876424e0ae43 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:58.175023 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d443fd-db95-4e36-a24d-4f86aaa6152f None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:58.230860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77b2d9-d00e-443e-8e19-67eed2e432c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:58.231739 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77b2d9-d00e-443e-8e19-67eed2e432c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:58.232025 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77b2d9-d00e-443e-8e19-67eed2e432c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:58.233224 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77b2d9-d00e-443e-8e19-67eed2e432c5 None admin] PATH_INFO: `/v3/projects/81bdccd201354a0081d7dcd17670b72a/users/f686928c27964f8785160333577196ba/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:58.235288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77b2d9-d00e-443e-8e19-67eed2e432c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=81bdccd201354a0081d7dcd17670b72a, user_id=f686928c27964f8785160333577196ba, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:58.236751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77b2d9-d00e-443e-8e19-67eed2e432c5 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:58.254808 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 44/83] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:27:58 2022] PUT /identity/v3/projects/81bdccd201354a0081d7dcd17670b72a/users/f686928c27964f8785160333577196ba/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:27:58.256079 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77b2d9-d00e-443e-8e19-67eed2e432c5 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:58.272176 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea5c33-6254-4972-b58c-876424e0ae43 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:58.282521 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:58.309079 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:27:58.333414 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2bb11-dca9-4bb3-bde0-a9cc9404a259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:58.334422 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2bb11-dca9-4bb3-bde0-a9cc9404a259 None admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:58.334711 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2bb11-dca9-4bb3-bde0-a9cc9404a259 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:58.334990 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2bb11-dca9-4bb3-bde0-a9cc9404a259 None admin] PATH_INFO: `/v3/projects/81bdccd201354a0081d7dcd17670b72a/users/b2cb9e39aae44ad29f4b41f3797d7ebc/roles/e37d07e878834488b4da4408ae42afd2` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:58.339232 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2bb11-dca9-4bb3-bde0-a9cc9404a259 None admin] RBAC: Authorizing `identity:create_grant(project_id=81bdccd201354a0081d7dcd17670b72a, user_id=b2cb9e39aae44ad29f4b41f3797d7ebc, role_id=e37d07e878834488b4da4408ae42afd2)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:58.341441 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2bb11-dca9-4bb3-bde0-a9cc9404a259 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:58.361772 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 40/84] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:27:58 2022] PUT /identity/v3/projects/81bdccd201354a0081d7dcd17670b72a/users/b2cb9e39aae44ad29f4b41f3797d7ebc/roles/e37d07e878834488b4da4408ae42afd2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:27:58.399132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77b2d9-d00e-443e-8e19-67eed2e432c5 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:58.442644 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888b8db-784b-4b4a-836c-7087220154dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:58.443410 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888b8db-784b-4b4a-836c-7087220154dd None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:58.443687 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888b8db-784b-4b4a-836c-7087220154dd None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:58.443962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888b8db-784b-4b4a-836c-7087220154dd None admin] PATH_INFO: `/v3/projects/ba444537e8a24371905cc4376845e6df` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:58.445276 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888b8db-784b-4b4a-836c-7087220154dd None admin] RBAC: Authorizing `identity:get_project(project_id=ba444537e8a24371905cc4376845e6df)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:58.446943 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888b8db-784b-4b4a-836c-7087220154dd None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:58.449381 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 45/85] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:27:58 2022] GET /identity/v3/projects/ba444537e8a24371905cc4376845e6df => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:27:58.455009 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2bb11-dca9-4bb3-bde0-a9cc9404a259 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:27:58.599281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2bb11-dca9-4bb3-bde0-a9cc9404a259 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:27:58.647348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e493215-eeaa-4cbd-875a-4c3de318da85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:27:58.648023 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e493215-eeaa-4cbd-875a-4c3de318da85 None admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:27:58.648306 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e493215-eeaa-4cbd-875a-4c3de318da85 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:27:58.648585 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e493215-eeaa-4cbd-875a-4c3de318da85 None admin] PATH_INFO: `/v3/projects/ba444537e8a24371905cc4376845e6df/users/b2cb9e39aae44ad29f4b41f3797d7ebc/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:27:58.650599 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e493215-eeaa-4cbd-875a-4c3de318da85 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba444537e8a24371905cc4376845e6df, user_id=b2cb9e39aae44ad29f4b41f3797d7ebc, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:27:58.652012 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e493215-eeaa-4cbd-875a-4c3de318da85 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:27:58.670867 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 41/86] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:27:58 2022] PUT /identity/v3/projects/ba444537e8a24371905cc4376845e6df/users/b2cb9e39aae44ad29f4b41f3797d7ebc/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:28:01.014172 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4b993-ebde-4477-8e28-3ba83ff1615c None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:01.015209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4b993-ebde-4477-8e28-3ba83ff1615c None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:01.015738 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4b993-ebde-4477-8e28-3ba83ff1615c None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:01.017386 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 46/87] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:01.023501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912852e-5d40-4a2d-a26b-c300472c134c None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:01.023906 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912852e-5d40-4a2d-a26b-c300472c134c None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:01.024061 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912852e-5d40-4a2d-a26b-c300472c134c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:01.046717 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-8912852e-5d40-4a2d-a26b-c300472c134c None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:01.047907 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-8912852e-5d40-4a2d-a26b-c300472c134c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:01.058759 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cccd87-c3c5-4c34-bce7-747964fd6b4b None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:01.059049 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cccd87-c3c5-4c34-bce7-747964fd6b4b None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:01.059332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cccd87-c3c5-4c34-bce7-747964fd6b4b None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:01.060827 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 47/88] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:01.065630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ee499-9d02-41a7-82f4-e62a4f9ab095 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:01.065943 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ee499-9d02-41a7-82f4-e62a4f9ab095 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:01.066749 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ee499-9d02-41a7-82f4-e62a4f9ab095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:01.093609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-094ee499-9d02-41a7-82f4-e62a4f9ab095 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:01.095004 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-094ee499-9d02-41a7-82f4-e62a4f9ab095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:01.110334 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:01.206908 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 48/89] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:28:01.216695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 42/90] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:01.321403 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f75002-56bf-4b34-b6e0-23dc9eda4522 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:01.321696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f75002-56bf-4b34-b6e0-23dc9eda4522 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:01.321999 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f75002-56bf-4b34-b6e0-23dc9eda4522 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:01.323372 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 49/91] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:01.328698 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb394dcd-dea4-4fa9-bb6e-8c48b5ab77f1 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:01.329249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb394dcd-dea4-4fa9-bb6e-8c48b5ab77f1 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:01.329742 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb394dcd-dea4-4fa9-bb6e-8c48b5ab77f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:01.359252 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-fb394dcd-dea4-4fa9-bb6e-8c48b5ab77f1 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:01.360865 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-fb394dcd-dea4-4fa9-bb6e-8c48b5ab77f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:01.447205 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 43/92] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:01.494976 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3f08d-0d79-4033-92fd-64eb671118aa None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:01.495285 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3f08d-0d79-4033-92fd-64eb671118aa None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:01.495728 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3f08d-0d79-4033-92fd-64eb671118aa None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:01.497108 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 50/93] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:01.512601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79414bc9-432b-4688-a8af-37f627ea0f58 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:01.512898 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79414bc9-432b-4688-a8af-37f627ea0f58 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:01.513182 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79414bc9-432b-4688-a8af-37f627ea0f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:01.537827 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-79414bc9-432b-4688-a8af-37f627ea0f58 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:01.543102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-79414bc9-432b-4688-a8af-37f627ea0f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:01.630437 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3f08d-0d79-4033-92fd-64eb671118aa None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:01.631991 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 44/94] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:01.634383 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79414bc9-432b-4688-a8af-37f627ea0f58 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:01.663145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:01.674316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:01.742118 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79414bc9-432b-4688-a8af-37f627ea0f58 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:01.778456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a052ce-3ccc-46cb-9176-6f86d9257f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:01.779531 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a052ce-3ccc-46cb-9176-6f86d9257f0f None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:01.780017 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a052ce-3ccc-46cb-9176-6f86d9257f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:01.780493 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a052ce-3ccc-46cb-9176-6f86d9257f0f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:01.792298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a052ce-3ccc-46cb-9176-6f86d9257f0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:01.797668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-67a052ce-3ccc-46cb-9176-6f86d9257f0f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 14:28:01.797668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:01.797668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:01.797668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:01.797668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:01.797668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:01.797668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:01.797668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:01.797668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:01.797668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:01.797668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:01.797668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:01.797668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:01.797668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:01.797668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:01.797668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:01.798503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:01.798503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:01.798503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:01.798503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:01.798503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:01.798503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:01.798503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:01.798503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:01.798503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:01.798503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:01.798503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:01.798503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:01.798503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:01.798503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:01.798503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:01.798503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:01.799270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:01.799270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:01.799270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:01.799270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:01.799270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:01.799270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:01.799270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:01.799270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:01.799270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:01.799270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:01.799270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 14:28:01.799270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:01.801662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 45/95] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:28:01.807818 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a052ce-3ccc-46cb-9176-6f86d9257f0f None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:01.839452 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3f08d-0d79-4033-92fd-64eb671118aa None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:01.913566 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a052ce-3ccc-46cb-9176-6f86d9257f0f None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:01.922054 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:01.950240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9da9d4-f12e-4fab-b9ec-804ff30e4a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:01.951193 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9da9d4-f12e-4fab-b9ec-804ff30e4a49 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:01.951298 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43390f-aba8-4536-baf6-a9a481b78b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:01.951821 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9da9d4-f12e-4fab-b9ec-804ff30e4a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:01.951922 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43390f-aba8-4536-baf6-a9a481b78b1b None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:01.952139 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43390f-aba8-4536-baf6-a9a481b78b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:01.952474 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43390f-aba8-4536-baf6-a9a481b78b1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:01.952804 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9da9d4-f12e-4fab-b9ec-804ff30e4a49 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:01.953681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9da9d4-f12e-4fab-b9ec-804ff30e4a49 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:01.954512 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9da9d4-f12e-4fab-b9ec-804ff30e4a49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:01.956199 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9da9d4-f12e-4fab-b9ec-804ff30e4a49 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:01.966118 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 46/96] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Oct 20 14:28:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:01.967208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9da9d4-f12e-4fab-b9ec-804ff30e4a49 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:01.976317 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43390f-aba8-4536-baf6-a9a481b78b1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:01.981914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-ab43390f-aba8-4536-baf6-a9a481b78b1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:01.981914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:01.981914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:01.981914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:01.981914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:01.981914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:01.981914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:01.981914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:01.981914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:01.981914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:01.981914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:01.981914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:01.981914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:01.981914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:01.981914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:01.981914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:01.982761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:01.982761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:01.982761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:01.982761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:01.982761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:01.982761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:01.982761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:01.982761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:01.982761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:01.982761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:01.982761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:01.982761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:01.982761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:01.982761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:01.982761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:01.982761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:01.983526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:01.983526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:01.983526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:01.983526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:01.983526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:01.983526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:01.983526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:01.983526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:01.983526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:01.983526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:01.983526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:01.983526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:01.983526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 51/97] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:01.984153 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43390f-aba8-4536-baf6-a9a481b78b1b None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:02.085523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:02.087716 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9da9d4-f12e-4fab-b9ec-804ff30e4a49 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:02.109648 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43390f-aba8-4536-baf6-a9a481b78b1b None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:02.126624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191d33e-f5a9-43b8-8f8c-cae02d3f187f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:02.127641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191d33e-f5a9-43b8-8f8c-cae02d3f187f None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:02.127936 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191d33e-f5a9-43b8-8f8c-cae02d3f187f None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:02.128215 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191d33e-f5a9-43b8-8f8c-cae02d3f187f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:02.129489 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191d33e-f5a9-43b8-8f8c-cae02d3f187f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:02.130986 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191d33e-f5a9-43b8-8f8c-cae02d3f187f None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:02.132718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 47/98] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:02.133345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191d33e-f5a9-43b8-8f8c-cae02d3f187f None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:02.150444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e3fd7-2133-453c-946b-23b89f37dcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:02.151078 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e3fd7-2133-453c-946b-23b89f37dcb8 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:02.151355 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e3fd7-2133-453c-946b-23b89f37dcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:02.151636 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e3fd7-2133-453c-946b-23b89f37dcb8 None admin] PATH_INFO: `/v3/users/dddc116fb7b74b4e8ec699553bfa6e88` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:02.154300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:02.166158 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e3fd7-2133-453c-946b-23b89f37dcb8 None admin] RBAC: Authorizing `identity:get_user(user_id=dddc116fb7b74b4e8ec699553bfa6e88)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:02.167593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e3fd7-2133-453c-946b-23b89f37dcb8 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:02.169268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 52/99] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:28:01 2022] GET /identity/v3/users/dddc116fb7b74b4e8ec699553bfa6e88 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:02.174035 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e3fd7-2133-453c-946b-23b89f37dcb8 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:02.250585 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191d33e-f5a9-43b8-8f8c-cae02d3f187f None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:02.285402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293afec-d224-4397-aaf4-6c060ebd4fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:02.286041 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293afec-d224-4397-aaf4-6c060ebd4fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:02.286329 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293afec-d224-4397-aaf4-6c060ebd4fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:02.286606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293afec-d224-4397-aaf4-6c060ebd4fc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:02.286876 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e3fd7-2133-453c-946b-23b89f37dcb8 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:02.287271 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293afec-d224-4397-aaf4-6c060ebd4fc8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:02.287624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293afec-d224-4397-aaf4-6c060ebd4fc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:02.289053 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293afec-d224-4397-aaf4-6c060ebd4fc8 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:02.297404 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 48/100] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Oct 20 14:28:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:02.303524 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f4d3a-59b0-42a8-ba45-9683bfa735da None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:02.303814 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f4d3a-59b0-42a8-ba45-9683bfa735da None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:02.304087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f4d3a-59b0-42a8-ba45-9683bfa735da None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:02.305319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 49/101] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:02.310269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f4d3a-59b0-42a8-ba45-9683bfa735da None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:02.322909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeda09a-d1e4-43d2-8b2c-b59ded670634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:02.323647 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeda09a-d1e4-43d2-8b2c-b59ded670634 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:02.323932 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeda09a-d1e4-43d2-8b2c-b59ded670634 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:02.324204 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeda09a-d1e4-43d2-8b2c-b59ded670634 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:02.327337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:02.336821 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeda09a-d1e4-43d2-8b2c-b59ded670634 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:02.341614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-feeda09a-d1e4-43d2-8b2c-b59ded670634 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 14:28:02.341614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:02.341614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:02.341614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:02.341614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:02.341614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:02.341614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:02.341614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:02.341614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:02.341614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:02.341614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:02.341614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:02.341614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:02.341614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:02.341614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:02.341614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:02.342634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:02.342634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:02.342634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:02.342634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:02.342634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:02.342634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:02.342634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:02.342634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:02.342634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:02.342634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:02.342634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:02.342634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:02.342634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:02.342634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:02.342634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:02.342634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:02.343484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:02.343484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:02.343484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:02.343484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:02.343484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:02.343484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:02.343484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:02.343484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:02.343484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:02.343484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:02.343484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 14:28:02.343484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:02.343484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 53/102] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Oct 20 14:28:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:02.348940 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeda09a-d1e4-43d2-8b2c-b59ded670634 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:02.399659 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:02.420884 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f4d3a-59b0-42a8-ba45-9683bfa735da None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:02.459138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a45428-d1a4-4662-8ea1-e7a52c9db012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:02.459767 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a45428-d1a4-4662-8ea1-e7a52c9db012 None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:02.460030 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a45428-d1a4-4662-8ea1-e7a52c9db012 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:02.460301 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a45428-d1a4-4662-8ea1-e7a52c9db012 None admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:02.460963 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a45428-d1a4-4662-8ea1-e7a52c9db012 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:02.462448 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a45428-d1a4-4662-8ea1-e7a52c9db012 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:02.481709 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeda09a-d1e4-43d2-8b2c-b59ded670634 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:02.489649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 50/103] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Oct 20 14:28:02 2022] POST /identity/v3/projects => generated 302 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:28:02.490305 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a45428-d1a4-4662-8ea1-e7a52c9db012 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:02.520792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e70ed-4560-4eb9-b6fd-b95c43a478cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:02.521458 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e70ed-4560-4eb9-b6fd-b95c43a478cb None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:02.521740 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e70ed-4560-4eb9-b6fd-b95c43a478cb None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:02.522085 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e70ed-4560-4eb9-b6fd-b95c43a478cb None admin] PATH_INFO: `/v3/projects/81bdccd201354a0081d7dcd17670b72a` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:02.523611 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e70ed-4560-4eb9-b6fd-b95c43a478cb None admin] RBAC: Authorizing `identity:get_project(project_id=81bdccd201354a0081d7dcd17670b72a)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:02.524879 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e70ed-4560-4eb9-b6fd-b95c43a478cb None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:02.526667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 54/104] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:28:02 2022] GET /identity/v3/projects/81bdccd201354a0081d7dcd17670b72a => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:02.533014 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42fa29-1ab0-417f-a018-a69e54904df4 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:02.533340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42fa29-1ab0-417f-a018-a69e54904df4 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:02.533638 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42fa29-1ab0-417f-a018-a69e54904df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:02.554410 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-2a42fa29-1ab0-417f-a018-a69e54904df4 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:02.555658 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2a42fa29-1ab0-417f-a018-a69e54904df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:02.619160 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:02.621937 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a45428-d1a4-4662-8ea1-e7a52c9db012 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:02.630019 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 55/105] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:02.630913 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42fa29-1ab0-417f-a018-a69e54904df4 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:02.657537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:02.666110 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5199fc-a056-478b-adbb-47a5de852f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:02.667058 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5199fc-a056-478b-adbb-47a5de852f5c None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:02.667542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5199fc-a056-478b-adbb-47a5de852f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:02.667881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5199fc-a056-478b-adbb-47a5de852f5c None admin] PATH_INFO: `/v3/users/b2cb9e39aae44ad29f4b41f3797d7ebc` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:02.669119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5199fc-a056-478b-adbb-47a5de852f5c None admin] RBAC: Authorizing `identity:get_user(user_id=b2cb9e39aae44ad29f4b41f3797d7ebc)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:02.671324 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5199fc-a056-478b-adbb-47a5de852f5c None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:02.672313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 51/106] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:28:02 2022] GET /identity/v3/users/b2cb9e39aae44ad29f4b41f3797d7ebc => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:02.673280 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5199fc-a056-478b-adbb-47a5de852f5c None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:02.779344 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42fa29-1ab0-417f-a018-a69e54904df4 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:02.791770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5199fc-a056-478b-adbb-47a5de852f5c None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:02.824824 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff56c9-219e-4d0f-8235-936b881e33fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:02.826143 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff56c9-219e-4d0f-8235-936b881e33fd None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:02.826845 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff56c9-219e-4d0f-8235-936b881e33fd None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:02.827269 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff56c9-219e-4d0f-8235-936b881e33fd None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:02.828340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff56c9-219e-4d0f-8235-936b881e33fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:02.829171 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff56c9-219e-4d0f-8235-936b881e33fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:02.831041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff56c9-219e-4d0f-8235-936b881e33fd None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:02.834164 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b609e1-82b0-4ebe-af2f-c9230ead453a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:02.834973 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b609e1-82b0-4ebe-af2f-c9230ead453a None admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:02.835319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b609e1-82b0-4ebe-af2f-c9230ead453a None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:02.835658 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b609e1-82b0-4ebe-af2f-c9230ead453a None admin] PATH_INFO: `/v3/projects/81bdccd201354a0081d7dcd17670b72a/users/dddc116fb7b74b4e8ec699553bfa6e88/roles/1e6a00ec995a45ba85a12b55a1eacc4c` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:02.838079 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b609e1-82b0-4ebe-af2f-c9230ead453a None admin] RBAC: Authorizing `identity:create_grant(project_id=81bdccd201354a0081d7dcd17670b72a, user_id=dddc116fb7b74b4e8ec699553bfa6e88, role_id=1e6a00ec995a45ba85a12b55a1eacc4c)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:02.839794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b609e1-82b0-4ebe-af2f-c9230ead453a None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:02.840433 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 56/107] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:28:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:02.841772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f9008-64c3-4742-a2db-698916029a7c None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:02.842226 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f9008-64c3-4742-a2db-698916029a7c None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:02.842659 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f9008-64c3-4742-a2db-698916029a7c None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:02.844078 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 57/108] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:02.844938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f9008-64c3-4742-a2db-698916029a7c None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:02.861970 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 52/109] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:28:02 2022] PUT /identity/v3/projects/81bdccd201354a0081d7dcd17670b72a/users/dddc116fb7b74b4e8ec699553bfa6e88/roles/1e6a00ec995a45ba85a12b55a1eacc4c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:28:02.863218 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b609e1-82b0-4ebe-af2f-c9230ead453a None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:02.932448 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:02.955380 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:02.999095 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f9008-64c3-4742-a2db-698916029a7c None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:03.005806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b609e1-82b0-4ebe-af2f-c9230ead453a None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:03.039624 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637abff9-642f-4440-8f5e-19b535882d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:03.040228 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637abff9-642f-4440-8f5e-19b535882d92 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:03.040514 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637abff9-642f-4440-8f5e-19b535882d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:03.040790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637abff9-642f-4440-8f5e-19b535882d92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:03.058913 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32609e-681b-4d25-be9b-37d012da6065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:03.059960 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32609e-681b-4d25-be9b-37d012da6065 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:03.060385 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32609e-681b-4d25-be9b-37d012da6065 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:03.061184 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32609e-681b-4d25-be9b-37d012da6065 None admin] PATH_INFO: `/v3/users/b2cb9e39aae44ad29f4b41f3797d7ebc` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:03.062801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32609e-681b-4d25-be9b-37d012da6065 None admin] RBAC: Authorizing `identity:get_user(user_id=b2cb9e39aae44ad29f4b41f3797d7ebc)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:03.064488 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32609e-681b-4d25-be9b-37d012da6065 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:03.069987 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 53/110] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:28:02 2022] GET /identity/v3/users/b2cb9e39aae44ad29f4b41f3797d7ebc => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:03.071493 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d5f5e-36a0-4d86-a89a-0ab3e3b40aca None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:03.071881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d5f5e-36a0-4d86-a89a-0ab3e3b40aca None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:03.072273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d5f5e-36a0-4d86-a89a-0ab3e3b40aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:03.093900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-c52d5f5e-36a0-4d86-a89a-0ab3e3b40aca None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:03.095743 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-c52d5f5e-36a0-4d86-a89a-0ab3e3b40aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:03.123731 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637abff9-642f-4440-8f5e-19b535882d92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:03.125126 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637abff9-642f-4440-8f5e-19b535882d92 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:03.170783 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 54/111] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:03.171873 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d5f5e-36a0-4d86-a89a-0ab3e3b40aca None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:03.189001 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:03.235273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:03.274705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 58/112] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:28:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 14:28:03.275435 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637abff9-642f-4440-8f5e-19b535882d92 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:03.280760 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d5f5e-36a0-4d86-a89a-0ab3e3b40aca None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:03.318181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3a32f-2436-4ed9-9f33-baf36b6bd1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:03.319065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3a32f-2436-4ed9-9f33-baf36b6bd1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:03.319492 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3a32f-2436-4ed9-9f33-baf36b6bd1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:03.319932 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3a32f-2436-4ed9-9f33-baf36b6bd1d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:03.331527 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3a32f-2436-4ed9-9f33-baf36b6bd1d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:03.337350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-aea3a32f-2436-4ed9-9f33-baf36b6bd1d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:28:03.337350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:03.337350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:03.337350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:03.337350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:03.337350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:03.337350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:03.337350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:03.337350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:03.337350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:03.337350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:03.337350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:03.337350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:03.337350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:03.337350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:03.337350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:03.338413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:03.338413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:03.338413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:03.338413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:03.338413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:03.338413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:03.338413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:03.338413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:03.338413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:03.338413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:03.338413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:03.338413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:03.338413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:03.338413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:03.338413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:03.338413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:03.339328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:03.339328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:03.339328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:03.339328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:03.339328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:03.339328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:03.339328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:03.339328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:03.339328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:03.339328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:03.339328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:28:03.339328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:03.341248 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 55/113] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:28:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:03.342242 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3a32f-2436-4ed9-9f33-baf36b6bd1d0 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:03.440037 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637abff9-642f-4440-8f5e-19b535882d92 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:03.448755 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3a32f-2436-4ed9-9f33-baf36b6bd1d0 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:03.467746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:03.485630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f022560-2fa8-4565-acca-0f6229ef2751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:03.486708 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f022560-2fa8-4565-acca-0f6229ef2751 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:03.487193 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f022560-2fa8-4565-acca-0f6229ef2751 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:03.487823 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f022560-2fa8-4565-acca-0f6229ef2751 None admin] PATH_INFO: `/v3/projects/81bdccd201354a0081d7dcd17670b72a` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:03.489350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f022560-2fa8-4565-acca-0f6229ef2751 None admin] RBAC: Authorizing `identity:get_project(project_id=81bdccd201354a0081d7dcd17670b72a)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:03.491110 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f022560-2fa8-4565-acca-0f6229ef2751 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:03.493035 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 56/114] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:28:03 2022] GET /identity/v3/projects/81bdccd201354a0081d7dcd17670b72a => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:03.494174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5d033-6fdb-4c64-9bd3-f6bd0eb9a44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:03.494563 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f022560-2fa8-4565-acca-0f6229ef2751 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:03.494859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5d033-6fdb-4c64-9bd3-f6bd0eb9a44b None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:03.495145 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5d033-6fdb-4c64-9bd3-f6bd0eb9a44b None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:03.495421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5d033-6fdb-4c64-9bd3-f6bd0eb9a44b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:03.552444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:03.602374 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f022560-2fa8-4565-acca-0f6229ef2751 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:03.639091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3316c13-1dc8-4410-8b1e-50f033598115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:03.640128 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3316c13-1dc8-4410-8b1e-50f033598115 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:03.640619 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3316c13-1dc8-4410-8b1e-50f033598115 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:03.641086 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3316c13-1dc8-4410-8b1e-50f033598115 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:03.641977 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3316c13-1dc8-4410-8b1e-50f033598115 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:03.642507 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3316c13-1dc8-4410-8b1e-50f033598115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:03.644686 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3316c13-1dc8-4410-8b1e-50f033598115 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:03.653934 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 57/115] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:03.655098 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3316c13-1dc8-4410-8b1e-50f033598115 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:03.662569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5d033-6fdb-4c64-9bd3-f6bd0eb9a44b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:03.664063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5d033-6fdb-4c64-9bd3-f6bd0eb9a44b None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:03.712276 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:03.771723 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3316c13-1dc8-4410-8b1e-50f033598115 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:03.783627 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 59/116] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:28:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 14:28:03.784390 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5d033-6fdb-4c64-9bd3-f6bd0eb9a44b None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:03.810696 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fff1ec-7c7b-45c6-81a4-fda796828622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:03.811840 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fff1ec-7c7b-45c6-81a4-fda796828622 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:03.812421 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fff1ec-7c7b-45c6-81a4-fda796828622 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:03.812990 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fff1ec-7c7b-45c6-81a4-fda796828622 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:03.813942 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fff1ec-7c7b-45c6-81a4-fda796828622 None admin] RBAC: Adding query filter params (role.id=59cd13c6b53b4329b0af96ce23f01e5e, scope.project.id=81bdccd201354a0081d7dcd17670b72a, user.id=b2cb9e39aae44ad29f4b41f3797d7ebc) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:03.814456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fff1ec-7c7b-45c6-81a4-fda796828622 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:03.817121 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fff1ec-7c7b-45c6-81a4-fda796828622 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:03.825954 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 58/117] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:28:03 2022] GET /identity/v3/role_assignments?user.id=b2cb9e39aae44ad29f4b41f3797d7ebc&scope.project.id=81bdccd201354a0081d7dcd17670b72a&role.id=59cd13c6b53b4329b0af96ce23f01e5e => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:03.827216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fff1ec-7c7b-45c6-81a4-fda796828622 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:03.865401 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:03.968047 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5d033-6fdb-4c64-9bd3-f6bd0eb9a44b None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:04.018511 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fff1ec-7c7b-45c6-81a4-fda796828622 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:04.020495 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bd4dd-ef12-4129-ba2c-310a0052d3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:04.021253 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bd4dd-ef12-4129-ba2c-310a0052d3af None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:04.021535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bd4dd-ef12-4129-ba2c-310a0052d3af None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:04.021816 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bd4dd-ef12-4129-ba2c-310a0052d3af None admin] PATH_INFO: `/v3/users/f686928c27964f8785160333577196ba` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:04.023758 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bd4dd-ef12-4129-ba2c-310a0052d3af None admin] RBAC: Authorizing `identity:get_user(user_id=f686928c27964f8785160333577196ba)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:04.025236 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bd4dd-ef12-4129-ba2c-310a0052d3af None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:04.027099 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 60/118] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:28:03 2022] GET /identity/v3/users/f686928c27964f8785160333577196ba => generated 247 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:04.027777 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bd4dd-ef12-4129-ba2c-310a0052d3af None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:04.033978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:04.065024 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c444acd-65d0-4459-95c5-70b4f0d65c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:04.067128 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c444acd-65d0-4459-95c5-70b4f0d65c52 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:04.067590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c444acd-65d0-4459-95c5-70b4f0d65c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:04.067870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c444acd-65d0-4459-95c5-70b4f0d65c52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:04.086569 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c444acd-65d0-4459-95c5-70b4f0d65c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:04.092439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-8c444acd-65d0-4459-95c5-70b4f0d65c52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:04.092439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:04.092439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:04.092439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:04.092439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:04.092439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:04.092439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:04.092439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:04.092439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:04.092439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:04.092439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:04.092439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:04.092439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:04.092439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:04.092439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:04.092439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:04.093273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:04.093273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:04.093273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:04.093273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:04.093273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:04.093273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:04.093273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:04.093273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:04.093273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:04.093273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:04.093273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:04.093273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:04.093273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:04.093273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:04.093273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:04.093273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:04.094462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:04.094462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:04.094462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:04.094462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:04.094462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:04.094462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:04.094462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:04.094462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:04.094462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:04.094462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:04.094462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:04.094462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:04.095033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 59/119] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:04.098766 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c444acd-65d0-4459-95c5-70b4f0d65c52 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:04.169872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bd4dd-ef12-4129-ba2c-310a0052d3af None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:04.205822 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:04.219882 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62573cf4-f5d8-478a-b1ea-973288aeb480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:04.220544 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62573cf4-f5d8-478a-b1ea-973288aeb480 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:04.220832 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62573cf4-f5d8-478a-b1ea-973288aeb480 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:04.221107 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62573cf4-f5d8-478a-b1ea-973288aeb480 None admin] PATH_INFO: `/v3/projects/81bdccd201354a0081d7dcd17670b72a` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:04.222282 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62573cf4-f5d8-478a-b1ea-973288aeb480 None admin] RBAC: Authorizing `identity:get_project(project_id=81bdccd201354a0081d7dcd17670b72a)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:04.223842 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62573cf4-f5d8-478a-b1ea-973288aeb480 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:04.225573 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 61/120] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:28:04 2022] GET /identity/v3/projects/81bdccd201354a0081d7dcd17670b72a => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:04.229461 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62573cf4-f5d8-478a-b1ea-973288aeb480 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:04.244656 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c444acd-65d0-4459-95c5-70b4f0d65c52 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:04.287061 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1d5a6-2cb1-4beb-85f1-f1b183858a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:04.287687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1d5a6-2cb1-4beb-85f1-f1b183858a51 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:04.287979 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1d5a6-2cb1-4beb-85f1-f1b183858a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:04.288265 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1d5a6-2cb1-4beb-85f1-f1b183858a51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:04.333828 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:04.358939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62573cf4-f5d8-478a-b1ea-973288aeb480 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:04.364775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1d5a6-2cb1-4beb-85f1-f1b183858a51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:04.366566 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1d5a6-2cb1-4beb-85f1-f1b183858a51 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:04.401968 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34b64d-470a-4d39-a61a-4fc3b73ce09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:04.402593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34b64d-470a-4d39-a61a-4fc3b73ce09f None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:04.402869 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34b64d-470a-4d39-a61a-4fc3b73ce09f None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:04.403428 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34b64d-470a-4d39-a61a-4fc3b73ce09f None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:04.404253 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34b64d-470a-4d39-a61a-4fc3b73ce09f None admin] RBAC: Adding query filter params (name=member) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:04.404688 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34b64d-470a-4d39-a61a-4fc3b73ce09f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:04.406105 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34b64d-470a-4d39-a61a-4fc3b73ce09f None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:04.416258 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 62/121] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Oct 20 14:28:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:04.418697 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34b64d-470a-4d39-a61a-4fc3b73ce09f None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:04.486149 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 60/122] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:28:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 14:28:04.487413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1d5a6-2cb1-4beb-85f1-f1b183858a51 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:04.490724 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:04.549124 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34b64d-470a-4d39-a61a-4fc3b73ce09f None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:04.570683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:04.588842 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa6763-fe8d-4139-be4a-47c1f4564257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:04.589752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa6763-fe8d-4139-be4a-47c1f4564257 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:04.590283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa6763-fe8d-4139-be4a-47c1f4564257 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:04.590847 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa6763-fe8d-4139-be4a-47c1f4564257 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:04.591767 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa6763-fe8d-4139-be4a-47c1f4564257 None admin] RBAC: Adding query filter params (role.id=e37d07e878834488b4da4408ae42afd2, scope.project.id=81bdccd201354a0081d7dcd17670b72a, user.id=b2cb9e39aae44ad29f4b41f3797d7ebc) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:04.592273 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa6763-fe8d-4139-be4a-47c1f4564257 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:04.594162 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa6763-fe8d-4139-be4a-47c1f4564257 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:04.601000 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 63/123] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:28:04 2022] GET /identity/v3/role_assignments?user.id=b2cb9e39aae44ad29f4b41f3797d7ebc&scope.project.id=81bdccd201354a0081d7dcd17670b72a&role.id=e37d07e878834488b4da4408ae42afd2 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:04.602039 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa6763-fe8d-4139-be4a-47c1f4564257 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:04.609133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1d5a6-2cb1-4beb-85f1-f1b183858a51 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:04.691943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215aa3e-b9a7-460b-b954-40d8a6499629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:04.693388 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215aa3e-b9a7-460b-b954-40d8a6499629 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:04.696376 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215aa3e-b9a7-460b-b954-40d8a6499629 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:04.696900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215aa3e-b9a7-460b-b954-40d8a6499629 None admin] PATH_INFO: `/v3/users/b2cb9e39aae44ad29f4b41f3797d7ebc` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:04.699210 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215aa3e-b9a7-460b-b954-40d8a6499629 None admin] RBAC: Authorizing `identity:get_user(user_id=b2cb9e39aae44ad29f4b41f3797d7ebc)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:04.704191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215aa3e-b9a7-460b-b954-40d8a6499629 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:04.706506 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 61/124] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:28:04 2022] GET /identity/v3/users/b2cb9e39aae44ad29f4b41f3797d7ebc => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:04.713073 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215aa3e-b9a7-460b-b954-40d8a6499629 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:04.807995 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa6763-fe8d-4139-be4a-47c1f4564257 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:04.842049 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:04.862358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9678e78-5132-4313-ac55-f5485344fc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:04.863351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9678e78-5132-4313-ac55-f5485344fc20 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:04.863834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9678e78-5132-4313-ac55-f5485344fc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:04.864285 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9678e78-5132-4313-ac55-f5485344fc20 None admin] PATH_INFO: `/v3/projects/81bdccd201354a0081d7dcd17670b72a` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:04.865632 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9678e78-5132-4313-ac55-f5485344fc20 None admin] RBAC: Authorizing `identity:get_project(project_id=81bdccd201354a0081d7dcd17670b72a)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:04.867418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9678e78-5132-4313-ac55-f5485344fc20 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:04.870402 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 64/125] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:28:04 2022] GET /identity/v3/projects/81bdccd201354a0081d7dcd17670b72a => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:04.871965 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae33e92-0b97-40c1-9ded-5864073ae1cb None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:04.872441 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae33e92-0b97-40c1-9ded-5864073ae1cb None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:04.872913 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae33e92-0b97-40c1-9ded-5864073ae1cb None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:04.874274 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 65/126] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:04.880034 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae33e92-0b97-40c1-9ded-5864073ae1cb None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:04.897701 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215aa3e-b9a7-460b-b954-40d8a6499629 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:04.942756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07df3c-d6ba-449c-bc2f-325fd5535cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:04.943376 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07df3c-d6ba-449c-bc2f-325fd5535cda None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:04.943654 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07df3c-d6ba-449c-bc2f-325fd5535cda None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:04.943924 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07df3c-d6ba-449c-bc2f-325fd5535cda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:04.955247 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:04.997245 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae33e92-0b97-40c1-9ded-5864073ae1cb None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:05.018543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07df3c-d6ba-449c-bc2f-325fd5535cda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:05.020422 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07df3c-d6ba-449c-bc2f-325fd5535cda None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:05.030514 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33121d31-2b33-43f3-af70-dca783f529f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:05.031574 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33121d31-2b33-43f3-af70-dca783f529f0 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:05.031861 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33121d31-2b33-43f3-af70-dca783f529f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:05.032467 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33121d31-2b33-43f3-af70-dca783f529f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:05.033262 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33121d31-2b33-43f3-af70-dca783f529f0 None admin] RBAC: Adding query filter params (role.id=fe3ee5741c6143adb5459b5de54450c8, scope.project.id=81bdccd201354a0081d7dcd17670b72a, user.id=f686928c27964f8785160333577196ba) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:05.033510 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33121d31-2b33-43f3-af70-dca783f529f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:05.035641 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33121d31-2b33-43f3-af70-dca783f529f0 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:05.049886 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 66/127] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:28:04 2022] GET /identity/v3/role_assignments?user.id=f686928c27964f8785160333577196ba&scope.project.id=81bdccd201354a0081d7dcd17670b72a&role.id=fe3ee5741c6143adb5459b5de54450c8 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:05.049886 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8246ab-7467-432c-918c-9e04a6b7ab04 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:05.049886 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8246ab-7467-432c-918c-9e04a6b7ab04 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:05.049886 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8246ab-7467-432c-918c-9e04a6b7ab04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:05.063038 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-fe8246ab-7467-432c-918c-9e04a6b7ab04 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:05.064160 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-fe8246ab-7467-432c-918c-9e04a6b7ab04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:05.115851 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:05.143418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 67/128] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:05.148068 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 62/129] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:28:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 20 14:28:05.154006 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8246ab-7467-432c-918c-9e04a6b7ab04 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:05.279773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8246ab-7467-432c-918c-9e04a6b7ab04 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:05.317938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69535d-ce02-42c9-9407-02b9342b9668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:05.318590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69535d-ce02-42c9-9407-02b9342b9668 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:05.318870 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69535d-ce02-42c9-9407-02b9342b9668 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:05.319143 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69535d-ce02-42c9-9407-02b9342b9668 None admin] PATH_INFO: `/v3/projects/ba444537e8a24371905cc4376845e6df` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:05.320277 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c69535d-ce02-42c9-9407-02b9342b9668 None admin] RBAC: Authorizing `identity:get_project(project_id=ba444537e8a24371905cc4376845e6df)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:05.321724 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c69535d-ce02-42c9-9407-02b9342b9668 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:05.323571 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 68/130] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:28:05 2022] GET /identity/v3/projects/ba444537e8a24371905cc4376845e6df => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:05.329738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07df3c-d6ba-449c-bc2f-325fd5535cda None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:05.333645 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65383641-9026-48be-b70f-248d8a7b5309 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:05.333971 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65383641-9026-48be-b70f-248d8a7b5309 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:05.334247 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65383641-9026-48be-b70f-248d8a7b5309 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:05.335753 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 69/131] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:05.341166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97300564-4d9e-4c80-948c-e39d639f3ae3 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:05.341465 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97300564-4d9e-4c80-948c-e39d639f3ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:05.341740 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97300564-4d9e-4c80-948c-e39d639f3ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:05.359946 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-97300564-4d9e-4c80-948c-e39d639f3ae3 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:05.361116 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-97300564-4d9e-4c80-948c-e39d639f3ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:05.374680 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:05.406972 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:05.433287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 70/132] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:28:05.435999 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07df3c-d6ba-449c-bc2f-325fd5535cda None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:05.450736 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97300564-4d9e-4c80-948c-e39d639f3ae3 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:05.472102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63156545-fc87-420a-936b-d0c4b9a04c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:05.473337 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63156545-fc87-420a-936b-d0c4b9a04c65 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:05.473627 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63156545-fc87-420a-936b-d0c4b9a04c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:05.473931 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63156545-fc87-420a-936b-d0c4b9a04c65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:05.474665 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63156545-fc87-420a-936b-d0c4b9a04c65 None admin] RBAC: Adding query filter params (role.id=59cd13c6b53b4329b0af96ce23f01e5e, scope.project.id=ba444537e8a24371905cc4376845e6df, user.id=b2cb9e39aae44ad29f4b41f3797d7ebc) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:05.474974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63156545-fc87-420a-936b-d0c4b9a04c65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:05.476428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63156545-fc87-420a-936b-d0c4b9a04c65 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:05.482258 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 63/133] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:28:05 2022] GET /identity/v3/role_assignments?user.id=b2cb9e39aae44ad29f4b41f3797d7ebc&scope.project.id=ba444537e8a24371905cc4376845e6df&role.id=59cd13c6b53b4329b0af96ce23f01e5e => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:05.568045 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97300564-4d9e-4c80-948c-e39d639f3ae3 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:05.604181 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed9fb6-711d-42b6-bf6e-04490f777b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:05.604840 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed9fb6-711d-42b6-bf6e-04490f777b51 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:05.605128 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed9fb6-711d-42b6-bf6e-04490f777b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:05.605405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed9fb6-711d-42b6-bf6e-04490f777b51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:05.606634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed9fb6-711d-42b6-bf6e-04490f777b51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:05.608128 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed9fb6-711d-42b6-bf6e-04490f777b51 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:05.609989 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 71/134] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:05.615345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63156545-fc87-420a-936b-d0c4b9a04c65 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:05.706550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed9fb6-711d-42b6-bf6e-04490f777b51 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:05.727800 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63156545-fc87-420a-936b-d0c4b9a04c65 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:05.730149 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:05.754812 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:05.761897 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c860c-64dd-489a-a146-88a1beacd29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:05.762515 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c860c-64dd-489a-a146-88a1beacd29d None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:05.762805 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c860c-64dd-489a-a146-88a1beacd29d None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:05.763087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c860c-64dd-489a-a146-88a1beacd29d None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:05.763920 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c860c-64dd-489a-a146-88a1beacd29d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:05.765716 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c860c-64dd-489a-a146-88a1beacd29d None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:05.787302 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 64/135] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Oct 20 14:28:05 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:28:05.813050 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed9fb6-711d-42b6-bf6e-04490f777b51 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:05.850076 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea141c-3625-4037-b8f0-7b3108efdf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:05.850651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea141c-3625-4037-b8f0-7b3108efdf63 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:05.850937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea141c-3625-4037-b8f0-7b3108efdf63 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:05.851216 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea141c-3625-4037-b8f0-7b3108efdf63 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:05.862678 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea141c-3625-4037-b8f0-7b3108efdf63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:05.868898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-58ea141c-3625-4037-b8f0-7b3108efdf63 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 14:28:05.868898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:05.868898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:05.868898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:05.868898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:05.868898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:05.868898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:05.868898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:05.868898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:05.868898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:05.868898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:05.868898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:05.868898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:05.868898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:05.868898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:05.868898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:05.869792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:05.869792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:05.869792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:05.869792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:05.869792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:05.869792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:05.869792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:05.869792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:05.869792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:05.869792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:05.869792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:05.869792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:05.869792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:05.869792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:05.869792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:05.869792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:05.870606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:05.870606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:05.870606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:05.870606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:05.870606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:05.870606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:05.870606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:05.870606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:05.870606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:05.870606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:05.870606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 14:28:05.870606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:05.870606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 72/136] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:28:05.876049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c860c-64dd-489a-a146-88a1beacd29d None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:05.979737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c860c-64dd-489a-a146-88a1beacd29d None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:06.014060 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3b7c8-2ecb-40f1-9426-77a6647d8de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:06.014672 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3b7c8-2ecb-40f1-9426-77a6647d8de2 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:06.014952 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3b7c8-2ecb-40f1-9426-77a6647d8de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:06.015278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3b7c8-2ecb-40f1-9426-77a6647d8de2 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:06.015963 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3b7c8-2ecb-40f1-9426-77a6647d8de2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:06.016265 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3b7c8-2ecb-40f1-9426-77a6647d8de2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:06.017627 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3b7c8-2ecb-40f1-9426-77a6647d8de2 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:06.026346 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 65/137] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Oct 20 14:28:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:06.032250 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea141c-3625-4037-b8f0-7b3108efdf63 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:06.144762 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea141c-3625-4037-b8f0-7b3108efdf63 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:06.152783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:06.189661 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58181c23-7a90-400e-b784-9769dedb612e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:06.190348 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58181c23-7a90-400e-b784-9769dedb612e None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:06.190628 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58181c23-7a90-400e-b784-9769dedb612e None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:06.190959 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58181c23-7a90-400e-b784-9769dedb612e None admin] PATH_INFO: `/v3/users/dddc116fb7b74b4e8ec699553bfa6e88` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:06.192130 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58181c23-7a90-400e-b784-9769dedb612e None admin] RBAC: Authorizing `identity:get_user(user_id=dddc116fb7b74b4e8ec699553bfa6e88)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:06.193579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58181c23-7a90-400e-b784-9769dedb612e None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:06.197958 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 73/138] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:28:06 2022] GET /identity/v3/users/dddc116fb7b74b4e8ec699553bfa6e88 => generated 289 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:06.201142 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3b7c8-2ecb-40f1-9426-77a6647d8de2 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:06.230736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:06.310384 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3b7c8-2ecb-40f1-9426-77a6647d8de2 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:06.346819 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4866e-a65e-4958-b2c4-92a6298371cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:06.348609 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4866e-a65e-4958-b2c4-92a6298371cf None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:06.349096 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4866e-a65e-4958-b2c4-92a6298371cf None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:06.349581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4866e-a65e-4958-b2c4-92a6298371cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:06.421163 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4866e-a65e-4958-b2c4-92a6298371cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:06.423043 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4866e-a65e-4958-b2c4-92a6298371cf None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:06.448490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:06.532998 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 66/139] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:28:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 14:28:06.539217 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58181c23-7a90-400e-b784-9769dedb612e None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:06.651914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58181c23-7a90-400e-b784-9769dedb612e None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:06.688414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ad604-8e3f-4977-9d89-4bd011a9e6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:06.689376 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ad604-8e3f-4977-9d89-4bd011a9e6b2 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:06.689916 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ad604-8e3f-4977-9d89-4bd011a9e6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:06.690416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ad604-8e3f-4977-9d89-4bd011a9e6b2 None admin] PATH_INFO: `/v3/projects/81bdccd201354a0081d7dcd17670b72a` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:06.691785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ad604-8e3f-4977-9d89-4bd011a9e6b2 None admin] RBAC: Authorizing `identity:get_project(project_id=81bdccd201354a0081d7dcd17670b72a)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:06.693523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ad604-8e3f-4977-9d89-4bd011a9e6b2 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:06.695476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 74/140] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:28:06 2022] GET /identity/v3/projects/81bdccd201354a0081d7dcd17670b72a => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:06.701879 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4866e-a65e-4958-b2c4-92a6298371cf None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:06.803777 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4866e-a65e-4958-b2c4-92a6298371cf None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:06.830026 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:06.842234 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40f494-af6b-4366-ab98-188d4a003e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:06.843094 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40f494-af6b-4366-ab98-188d4a003e72 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:06.843386 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40f494-af6b-4366-ab98-188d4a003e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:06.843728 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40f494-af6b-4366-ab98-188d4a003e72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:06.844625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40f494-af6b-4366-ab98-188d4a003e72 None admin] RBAC: Adding query filter params (role.id=1e6a00ec995a45ba85a12b55a1eacc4c, scope.project.id=81bdccd201354a0081d7dcd17670b72a, user.id=dddc116fb7b74b4e8ec699553bfa6e88) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:06.845000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40f494-af6b-4366-ab98-188d4a003e72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:06.846686 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40f494-af6b-4366-ab98-188d4a003e72 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:06.853116 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 67/141] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:28:06 2022] GET /identity/v3/role_assignments?user.id=dddc116fb7b74b4e8ec699553bfa6e88&scope.project.id=81bdccd201354a0081d7dcd17670b72a&role.id=1e6a00ec995a45ba85a12b55a1eacc4c => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:08.098183 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfddf2-f8da-47c7-9292-8bad24daf678 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:08.098710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfddf2-f8da-47c7-9292-8bad24daf678 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:08.098710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfddf2-f8da-47c7-9292-8bad24daf678 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:08.100211 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 75/142] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:08.105424 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f93b6-511d-45ab-9da2-51a35f99a821 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:08.106043 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f93b6-511d-45ab-9da2-51a35f99a821 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:08.106043 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f93b6-511d-45ab-9da2-51a35f99a821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:08.126170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-336f93b6-511d-45ab-9da2-51a35f99a821 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:08.127407 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-336f93b6-511d-45ab-9da2-51a35f99a821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:08.211781 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 68/143] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:08.230055 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daed104-173c-433d-9797-67b85ae98e6d None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:08.230428 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daed104-173c-433d-9797-67b85ae98e6d None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:08.230781 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daed104-173c-433d-9797-67b85ae98e6d None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:08.232405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 76/144] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:08.238094 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5383eb-62a4-4650-8218-2c077974d366 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:08.238459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5383eb-62a4-4650-8218-2c077974d366 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:08.238746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5383eb-62a4-4650-8218-2c077974d366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:08.258128 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-4d5383eb-62a4-4650-8218-2c077974d366 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:08.259323 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-4d5383eb-62a4-4650-8218-2c077974d366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:08.301430 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7a284-61ae-4d20-8bdf-ac7c0b399f64 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:08.302140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7a284-61ae-4d20-8bdf-ac7c0b399f64 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:08.302434 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7a284-61ae-4d20-8bdf-ac7c0b399f64 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:08.304545 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 77/145] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:28:08.309835 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9583a-1e8c-4b46-b734-2f48db173d2a None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:08.310147 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9583a-1e8c-4b46-b734-2f48db173d2a None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:08.310408 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9583a-1e8c-4b46-b734-2f48db173d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:08.327151 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 69/146] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:08.331912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-76c9583a-1e8c-4b46-b734-2f48db173d2a None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:08.331912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-76c9583a-1e8c-4b46-b734-2f48db173d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:08.365715 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:08.397684 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 78/147] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:28:08.485044 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5383eb-62a4-4650-8218-2c077974d366 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:08.532016 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:08.585634 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5383eb-62a4-4650-8218-2c077974d366 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:08.594939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9583a-1e8c-4b46-b734-2f48db173d2a None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:08.621035 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3a290-37ba-4272-8e7c-8dbf4674876e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:08.621602 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3a290-37ba-4272-8e7c-8dbf4674876e None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:08.621901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3a290-37ba-4272-8e7c-8dbf4674876e None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:08.622178 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3a290-37ba-4272-8e7c-8dbf4674876e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:08.634481 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3a290-37ba-4272-8e7c-8dbf4674876e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:08.639295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-2ad3a290-37ba-4272-8e7c-8dbf4674876e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:28:08.639295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:08.639295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:08.639295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:08.639295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:08.639295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:08.639295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:08.639295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:08.639295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:08.639295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:08.639295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:08.639295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:08.639295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:08.639295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:08.639295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:08.639295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:08.640167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:08.640167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:08.640167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:08.640167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:08.640167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:08.640167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:08.640167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:08.640167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:08.640167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:08.640167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:08.640167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:08.640167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:08.640167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:08.640167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:08.640167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:08.640167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:08.640956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:08.640956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:08.640956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:08.640956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:08.640956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:08.640956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:08.640956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:08.640956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:08.640956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:08.640956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:08.640956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:28:08.640956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:08.640956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 70/148] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:28:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:08.646395 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3a290-37ba-4272-8e7c-8dbf4674876e None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:08.700078 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9583a-1e8c-4b46-b734-2f48db173d2a None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:08.734230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5539f1f-406f-4ed2-9ac7-095cc12c9825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:08.734858 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5539f1f-406f-4ed2-9ac7-095cc12c9825 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:08.735141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5539f1f-406f-4ed2-9ac7-095cc12c9825 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:08.735414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5539f1f-406f-4ed2-9ac7-095cc12c9825 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:08.745309 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5539f1f-406f-4ed2-9ac7-095cc12c9825 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:08.747340 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3a290-37ba-4272-8e7c-8dbf4674876e None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:08.750190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-f5539f1f-406f-4ed2-9ac7-095cc12c9825 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 14:28:08.750190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:08.750190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:08.750190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:08.750190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:08.750190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:08.750190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:08.750190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:08.750190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:08.750190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:08.750190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:08.750190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:08.750190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:08.750190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:08.750190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:08.750190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:08.751029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:08.751029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:08.751029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:08.751029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:08.751029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:08.751029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:08.751029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:08.751029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:08.751029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:08.751029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:08.751029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:08.751029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:08.751029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:08.751029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:08.751029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:08.751029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:08.751925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:08.751925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:08.751925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:08.751925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:08.751925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:08.751925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:08.751925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:08.751925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:08.751925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:08.751925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:08.751925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 14:28:08.751925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:08.751925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 79/149] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Oct 20 14:28:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:28:08.754719 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5539f1f-406f-4ed2-9ac7-095cc12c9825 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:08.755434 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:08.783962 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1901a-d366-4761-82cb-0c3efc0dfebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:08.784585 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1901a-d366-4761-82cb-0c3efc0dfebf None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:08.784859 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1901a-d366-4761-82cb-0c3efc0dfebf None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:08.785125 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1901a-d366-4761-82cb-0c3efc0dfebf None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:08.785774 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1901a-d366-4761-82cb-0c3efc0dfebf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:08.786105 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1901a-d366-4761-82cb-0c3efc0dfebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:08.786526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:08.787503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1901a-d366-4761-82cb-0c3efc0dfebf None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:08.795623 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 71/150] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:08.796408 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1901a-d366-4761-82cb-0c3efc0dfebf None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:08.854150 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5539f1f-406f-4ed2-9ac7-095cc12c9825 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:08.887116 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0c8c9-756b-49df-8efc-f0bd353cc4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:08.887672 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0c8c9-756b-49df-8efc-f0bd353cc4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:08.887948 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0c8c9-756b-49df-8efc-f0bd353cc4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:08.888214 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0c8c9-756b-49df-8efc-f0bd353cc4c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:08.889294 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0c8c9-756b-49df-8efc-f0bd353cc4c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:08.890766 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0c8c9-756b-49df-8efc-f0bd353cc4c5 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:08.892300 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 80/151] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:08.893058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0c8c9-756b-49df-8efc-f0bd353cc4c5 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:08.893398 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1901a-d366-4761-82cb-0c3efc0dfebf None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:08.928914 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fc87e-a36a-4bcc-9a80-5ae5fbb4cc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:08.929524 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fc87e-a36a-4bcc-9a80-5ae5fbb4cc10 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:08.929810 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fc87e-a36a-4bcc-9a80-5ae5fbb4cc10 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:08.930114 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fc87e-a36a-4bcc-9a80-5ae5fbb4cc10 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:08.930779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fc87e-a36a-4bcc-9a80-5ae5fbb4cc10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:08.931081 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fc87e-a36a-4bcc-9a80-5ae5fbb4cc10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:08.932699 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fc87e-a36a-4bcc-9a80-5ae5fbb4cc10 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:08.945227 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 72/152] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:28:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:08.945227 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fc87e-a36a-4bcc-9a80-5ae5fbb4cc10 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:08.970504 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:08.991438 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:08.994253 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0c8c9-756b-49df-8efc-f0bd353cc4c5 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:09.027573 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e37b6-1aa6-4bd0-90bd-f6a30f762947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:09.028194 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e37b6-1aa6-4bd0-90bd-f6a30f762947 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:09.028477 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e37b6-1aa6-4bd0-90bd-f6a30f762947 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:09.028750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e37b6-1aa6-4bd0-90bd-f6a30f762947 None admin] PATH_INFO: `/v3/users/025ee3cad2d647b4b228fd1da9ef54ce` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:09.042328 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e37b6-1aa6-4bd0-90bd-f6a30f762947 None admin] RBAC: Authorizing `identity:get_user(user_id=025ee3cad2d647b4b228fd1da9ef54ce)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:09.042489 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fc87e-a36a-4bcc-9a80-5ae5fbb4cc10 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:09.043613 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e37b6-1aa6-4bd0-90bd-f6a30f762947 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:09.045215 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 81/153] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:28:08 2022] GET /identity/v3/users/025ee3cad2d647b4b228fd1da9ef54ce => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:09.046150 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e37b6-1aa6-4bd0-90bd-f6a30f762947 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:09.085574 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de034a09-8ea5-4876-8084-61412bc0e403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:09.086602 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de034a09-8ea5-4876-8084-61412bc0e403 None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:09.087142 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de034a09-8ea5-4876-8084-61412bc0e403 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:09.087620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de034a09-8ea5-4876-8084-61412bc0e403 None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:09.089591 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de034a09-8ea5-4876-8084-61412bc0e403 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:09.091409 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de034a09-8ea5-4876-8084-61412bc0e403 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:09.119382 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 73/154] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Oct 20 14:28:08 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:28:09.120437 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de034a09-8ea5-4876-8084-61412bc0e403 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:09.192405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e37b6-1aa6-4bd0-90bd-f6a30f762947 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:09.230353 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fd058-8cdd-4a80-bbf7-0541211b19f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:09.231003 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fd058-8cdd-4a80-bbf7-0541211b19f1 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:09.231280 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fd058-8cdd-4a80-bbf7-0541211b19f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:09.231549 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fd058-8cdd-4a80-bbf7-0541211b19f1 None admin] PATH_INFO: `/v3/users/025ee3cad2d647b4b228fd1da9ef54ce` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:09.232962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fd058-8cdd-4a80-bbf7-0541211b19f1 None admin] RBAC: Authorizing `identity:get_user(user_id=025ee3cad2d647b4b228fd1da9ef54ce)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:09.234565 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fd058-8cdd-4a80-bbf7-0541211b19f1 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:09.236317 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 82/155] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:28:09 2022] GET /identity/v3/users/025ee3cad2d647b4b228fd1da9ef54ce => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:09.242531 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fd058-8cdd-4a80-bbf7-0541211b19f1 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:09.244517 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:09.262078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de034a09-8ea5-4876-8084-61412bc0e403 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:09.276404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:09.304484 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378103a5-5563-41f8-acb3-030c5acc6c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:09.305144 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378103a5-5563-41f8-acb3-030c5acc6c8f None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:09.305428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378103a5-5563-41f8-acb3-030c5acc6c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:09.305704 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378103a5-5563-41f8-acb3-030c5acc6c8f None admin] PATH_INFO: `/v3/projects/52926432875245df81bfd82b5824c1f0` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:09.307944 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378103a5-5563-41f8-acb3-030c5acc6c8f None admin] RBAC: Authorizing `identity:get_project(project_id=52926432875245df81bfd82b5824c1f0)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:09.309401 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378103a5-5563-41f8-acb3-030c5acc6c8f None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:09.311085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 74/156] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:28:09 2022] GET /identity/v3/projects/52926432875245df81bfd82b5824c1f0 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:09.318322 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378103a5-5563-41f8-acb3-030c5acc6c8f None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:09.380068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fd058-8cdd-4a80-bbf7-0541211b19f1 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:09.447256 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a995e-52fb-4db7-8daf-fe4170e4d3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:09.448183 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a995e-52fb-4db7-8daf-fe4170e4d3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:09.448668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a995e-52fb-4db7-8daf-fe4170e4d3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:09.449127 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a995e-52fb-4db7-8daf-fe4170e4d3e8 None admin] PATH_INFO: `/v3/projects/52926432875245df81bfd82b5824c1f0` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:09.451853 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a995e-52fb-4db7-8daf-fe4170e4d3e8 None admin] RBAC: Authorizing `identity:get_project(project_id=52926432875245df81bfd82b5824c1f0)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:09.453326 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a995e-52fb-4db7-8daf-fe4170e4d3e8 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:09.458727 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 83/157] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:28:09 2022] GET /identity/v3/projects/52926432875245df81bfd82b5824c1f0 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:09.461967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a995e-52fb-4db7-8daf-fe4170e4d3e8 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:09.473934 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378103a5-5563-41f8-acb3-030c5acc6c8f None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:09.512344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdad289-4cc6-4de2-a025-9d88176fd008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:09.513020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdad289-4cc6-4de2-a025-9d88176fd008 None admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:09.513304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdad289-4cc6-4de2-a025-9d88176fd008 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:09.513582 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdad289-4cc6-4de2-a025-9d88176fd008 None admin] PATH_INFO: `/v3/projects/52926432875245df81bfd82b5824c1f0/users/025ee3cad2d647b4b228fd1da9ef54ce/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:09.516639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdad289-4cc6-4de2-a025-9d88176fd008 None admin] RBAC: Authorizing `identity:create_grant(project_id=52926432875245df81bfd82b5824c1f0, user_id=025ee3cad2d647b4b228fd1da9ef54ce, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:09.517508 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdad289-4cc6-4de2-a025-9d88176fd008 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:09.535528 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 75/158] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:28:09 2022] PUT /identity/v3/projects/52926432875245df81bfd82b5824c1f0/users/025ee3cad2d647b4b228fd1da9ef54ce/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:28:09.580629 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:09.589119 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a995e-52fb-4db7-8daf-fe4170e4d3e8 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:09.629018 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899aa71-8694-476b-b813-e3a64bfe6ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:09.629696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899aa71-8694-476b-b813-e3a64bfe6ed0 None admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:09.630018 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899aa71-8694-476b-b813-e3a64bfe6ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:09.630296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899aa71-8694-476b-b813-e3a64bfe6ed0 None admin] PATH_INFO: `/v3/projects/52926432875245df81bfd82b5824c1f0/users/025ee3cad2d647b4b228fd1da9ef54ce/roles/e37d07e878834488b4da4408ae42afd2` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:09.632645 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899aa71-8694-476b-b813-e3a64bfe6ed0 None admin] RBAC: Authorizing `identity:create_grant(project_id=52926432875245df81bfd82b5824c1f0, user_id=025ee3cad2d647b4b228fd1da9ef54ce, role_id=e37d07e878834488b4da4408ae42afd2)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:09.634161 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899aa71-8694-476b-b813-e3a64bfe6ed0 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:09.652754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 84/159] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:28:09 2022] PUT /identity/v3/projects/52926432875245df81bfd82b5824c1f0/users/025ee3cad2d647b4b228fd1da9ef54ce/roles/e37d07e878834488b4da4408ae42afd2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:28:11.443606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55605b76-4930-448f-b150-b7e1a35e7eda None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:11.444606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55605b76-4930-448f-b150-b7e1a35e7eda None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:11.445103 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55605b76-4930-448f-b150-b7e1a35e7eda None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:11.446927 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 76/160] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:11.452757 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19806f8-4f30-450e-af4e-e795f9a33e68 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:11.453705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19806f8-4f30-450e-af4e-e795f9a33e68 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:11.454233 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19806f8-4f30-450e-af4e-e795f9a33e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:11.475239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-c19806f8-4f30-450e-af4e-e795f9a33e68 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:11.476842 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-c19806f8-4f30-450e-af4e-e795f9a33e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:11.548011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 85/161] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:11.577691 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7f863-7fdd-4fbd-9c64-ccc6c48c73fc None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:11.578006 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7f863-7fdd-4fbd-9c64-ccc6c48c73fc None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:11.578290 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7f863-7fdd-4fbd-9c64-ccc6c48c73fc None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:11.579796 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 77/162] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:11.584957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adecb4-f653-4f14-a58f-c6252d32ff2c None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:11.585251 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adecb4-f653-4f14-a58f-c6252d32ff2c None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:11.585531 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adecb4-f653-4f14-a58f-c6252d32ff2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:11.604654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-b3adecb4-f653-4f14-a58f-c6252d32ff2c None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:11.605866 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b3adecb4-f653-4f14-a58f-c6252d32ff2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:11.676107 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 86/163] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:11.804780 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abef0a-b0f7-4a69-9502-e00bd4eec4eb None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:11.805069 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abef0a-b0f7-4a69-9502-e00bd4eec4eb None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:11.805257 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abef0a-b0f7-4a69-9502-e00bd4eec4eb None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:11.807023 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 78/164] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:11.812155 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bc6ff-9646-4229-9fde-8a8095ccab73 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:11.812447 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bc6ff-9646-4229-9fde-8a8095ccab73 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:11.812723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bc6ff-9646-4229-9fde-8a8095ccab73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:11.822596 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56d38c-2454-4508-bd13-88b0f089bc88 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:11.822873 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56d38c-2454-4508-bd13-88b0f089bc88 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:11.823156 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56d38c-2454-4508-bd13-88b0f089bc88 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:11.824483 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 79/165] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:28:11.830867 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbca7f4-1b43-4c51-a6c4-2a32e8662d1a None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:11.831230 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbca7f4-1b43-4c51-a6c4-2a32e8662d1a None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:11.831458 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbca7f4-1b43-4c51-a6c4-2a32e8662d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:11.835228 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-ad3bc6ff-9646-4229-9fde-8a8095ccab73 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:11.836588 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ad3bc6ff-9646-4229-9fde-8a8095ccab73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:11.847923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:11.853219 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-cfbca7f4-1b43-4c51-a6c4-2a32e8662d1a None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:11.854430 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-cfbca7f4-1b43-4c51-a6c4-2a32e8662d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:11.864845 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:11.910204 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 87/166] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:11.911376 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bc6ff-9646-4229-9fde-8a8095ccab73 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:11.938564 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 80/167] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:28:11.955583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbca7f4-1b43-4c51-a6c4-2a32e8662d1a None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:12.028347 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bc6ff-9646-4229-9fde-8a8095ccab73 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:12.063961 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59416884-c5fd-477b-88ec-25e82f29d939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:12.064621 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59416884-c5fd-477b-88ec-25e82f29d939 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:12.064897 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59416884-c5fd-477b-88ec-25e82f29d939 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:12.065226 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59416884-c5fd-477b-88ec-25e82f29d939 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:12.076322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59416884-c5fd-477b-88ec-25e82f29d939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:12.078258 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbca7f4-1b43-4c51-a6c4-2a32e8662d1a None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:12.081783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-59416884-c5fd-477b-88ec-25e82f29d939 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:12.081783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:12.081783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:12.081783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:12.081783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:12.081783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:12.081783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:12.081783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:12.081783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:12.081783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:12.081783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:12.081783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:12.081783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:12.081783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:12.081783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:12.081783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:12.082860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:12.082860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:12.082860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:12.082860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:12.082860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:12.082860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:12.082860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:12.082860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:12.082860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:12.082860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:12.082860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:12.082860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:12.082860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:12.082860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:12.082860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:12.082860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:12.083639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:12.083639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:12.083639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:12.083639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:12.083639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:12.083639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:12.083639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:12.083639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:12.083639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:12.083639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:12.083639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:12.083639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:12.083639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 88/168] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:12.088885 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59416884-c5fd-477b-88ec-25e82f29d939 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:12.093935 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:12.127811 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e917ca-35e1-4815-9cf6-ec050201eb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:12.129811 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e917ca-35e1-4815-9cf6-ec050201eb03 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:12.130369 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e917ca-35e1-4815-9cf6-ec050201eb03 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:12.130828 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e917ca-35e1-4815-9cf6-ec050201eb03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:12.132125 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e917ca-35e1-4815-9cf6-ec050201eb03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:12.134330 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e917ca-35e1-4815-9cf6-ec050201eb03 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:12.136586 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 81/169] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:12.143018 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e917ca-35e1-4815-9cf6-ec050201eb03 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:12.162169 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:12.213246 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59416884-c5fd-477b-88ec-25e82f29d939 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:12.247452 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b09c20-af67-4965-80da-aa5f6f398351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:12.248052 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b09c20-af67-4965-80da-aa5f6f398351 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:12.248389 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b09c20-af67-4965-80da-aa5f6f398351 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:12.248661 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b09c20-af67-4965-80da-aa5f6f398351 None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:12.249316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b09c20-af67-4965-80da-aa5f6f398351 None admin] RBAC: Adding query filter params (name=member) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:12.249614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b09c20-af67-4965-80da-aa5f6f398351 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:12.251014 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b09c20-af67-4965-80da-aa5f6f398351 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:12.257741 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e917ca-35e1-4815-9cf6-ec050201eb03 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:12.259346 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 89/170] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Oct 20 14:28:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:12.260119 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b09c20-af67-4965-80da-aa5f6f398351 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:12.291711 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6ac81-aaba-4120-9b1f-e0e7dcb232f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:12.292313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6ac81-aaba-4120-9b1f-e0e7dcb232f4 None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:12.292619 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6ac81-aaba-4120-9b1f-e0e7dcb232f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:12.292895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6ac81-aaba-4120-9b1f-e0e7dcb232f4 None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:12.293544 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6ac81-aaba-4120-9b1f-e0e7dcb232f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:12.295007 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6ac81-aaba-4120-9b1f-e0e7dcb232f4 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:12.329964 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 82/171] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Oct 20 14:28:12 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:28:12.329964 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6ac81-aaba-4120-9b1f-e0e7dcb232f4 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:12.344229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:12.384419 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b09c20-af67-4965-80da-aa5f6f398351 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:12.396894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:12.423595 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61248549-f40b-45eb-ad38-6fe3c722c602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:12.424244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61248549-f40b-45eb-ad38-6fe3c722c602 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:12.424527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61248549-f40b-45eb-ad38-6fe3c722c602 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:12.424831 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61248549-f40b-45eb-ad38-6fe3c722c602 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:12.437938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61248549-f40b-45eb-ad38-6fe3c722c602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:12.438138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6ac81-aaba-4120-9b1f-e0e7dcb232f4 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:12.445481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-61248549-f40b-45eb-ad38-6fe3c722c602 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:28:12.445481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:12.445481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:12.445481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:12.445481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:12.445481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:12.445481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:12.445481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:12.445481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:12.445481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:12.445481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:12.445481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:12.445481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:12.445481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:12.445481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:12.445481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:12.446519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:12.446519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:12.446519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:12.446519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:12.446519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:12.446519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:12.446519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:12.446519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:12.446519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:12.446519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:12.446519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:12.446519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:12.446519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:12.446519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:12.446519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:12.446519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:12.447283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:12.447283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:12.447283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:12.447283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:12.447283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:12.447283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:12.447283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:12.447283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:12.447283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:12.447283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:12.447283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:28:12.447283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:12.447863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 90/172] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:28:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:12.454047 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61248549-f40b-45eb-ad38-6fe3c722c602 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:12.476728 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0839b-c8db-4d8e-b40d-822e56204967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:12.478041 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0839b-c8db-4d8e-b40d-822e56204967 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:12.478475 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0839b-c8db-4d8e-b40d-822e56204967 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:12.478747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0839b-c8db-4d8e-b40d-822e56204967 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:12.489893 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0839b-c8db-4d8e-b40d-822e56204967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:12.495737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-54d0839b-c8db-4d8e-b40d-822e56204967 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 14:28:12.495737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:12.495737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:12.495737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:12.495737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:12.495737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:12.495737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:12.495737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:12.495737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:12.495737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:12.495737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:12.495737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:12.495737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:12.495737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:12.495737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:12.495737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:12.496801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:12.496801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:12.496801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:12.496801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:12.496801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:12.496801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:12.496801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:12.496801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:12.496801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:12.496801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:12.496801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:12.496801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:12.496801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:12.496801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:12.496801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:12.496801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:12.497702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:12.497702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:12.497702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:12.497702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:12.497702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:12.497702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:12.497702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:12.497702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:12.497702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:12.497702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:12.497702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 14:28:12.497702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:12.497702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 83/173] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Oct 20 14:28:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:12.497702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0839b-c8db-4d8e-b40d-822e56204967 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:12.577896 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61248549-f40b-45eb-ad38-6fe3c722c602 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:12.606677 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:12.615367 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fdf48-e4c7-4ab0-9d85-cd81e41fabf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:12.616224 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fdf48-e4c7-4ab0-9d85-cd81e41fabf7 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:12.616338 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fdf48-e4c7-4ab0-9d85-cd81e41fabf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:12.616538 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fdf48-e4c7-4ab0-9d85-cd81e41fabf7 None admin] PATH_INFO: `/v3/users/684a751de16847e89940f021a2b825e2` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:12.627603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0839b-c8db-4d8e-b40d-822e56204967 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:12.633155 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fdf48-e4c7-4ab0-9d85-cd81e41fabf7 None admin] RBAC: Authorizing `identity:get_user(user_id=684a751de16847e89940f021a2b825e2)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:12.634801 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fdf48-e4c7-4ab0-9d85-cd81e41fabf7 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:12.636560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 91/174] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:28:12 2022] GET /identity/v3/users/684a751de16847e89940f021a2b825e2 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:12.642386 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fdf48-e4c7-4ab0-9d85-cd81e41fabf7 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:12.666792 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:12.676883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bcef16-feb0-4d75-9447-9a030be1da74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:12.677470 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcef16-feb0-4d75-9447-9a030be1da74 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:12.677860 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcef16-feb0-4d75-9447-9a030be1da74 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:12.678054 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcef16-feb0-4d75-9447-9a030be1da74 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:12.678730 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bcef16-feb0-4d75-9447-9a030be1da74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:12.679151 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bcef16-feb0-4d75-9447-9a030be1da74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:12.680556 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bcef16-feb0-4d75-9447-9a030be1da74 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:12.695458 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 84/175] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:12.696017 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bcef16-feb0-4d75-9447-9a030be1da74 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:12.767790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fdf48-e4c7-4ab0-9d85-cd81e41fabf7 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:12.807846 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512eade-c3c4-435b-beca-14af039822c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:12.808460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512eade-c3c4-435b-beca-14af039822c3 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:12.808743 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512eade-c3c4-435b-beca-14af039822c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:12.809017 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512eade-c3c4-435b-beca-14af039822c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:12.809688 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512eade-c3c4-435b-beca-14af039822c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:12.810015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512eade-c3c4-435b-beca-14af039822c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:12.811399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512eade-c3c4-435b-beca-14af039822c3 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:12.820203 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 92/176] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:28:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:12.821122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512eade-c3c4-435b-beca-14af039822c3 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:12.839443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bcef16-feb0-4d75-9447-9a030be1da74 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:12.876906 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:12.883996 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bdd63-1cf7-4061-a5fc-dc2aa4235b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:12.884703 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bdd63-1cf7-4061-a5fc-dc2aa4235b68 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:12.884988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bdd63-1cf7-4061-a5fc-dc2aa4235b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:12.885261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bdd63-1cf7-4061-a5fc-dc2aa4235b68 None admin] PATH_INFO: `/v3/projects/52926432875245df81bfd82b5824c1f0` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:12.886433 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0bdd63-1cf7-4061-a5fc-dc2aa4235b68 None admin] RBAC: Authorizing `identity:get_project(project_id=52926432875245df81bfd82b5824c1f0)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:12.888008 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0bdd63-1cf7-4061-a5fc-dc2aa4235b68 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:12.889978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 85/177] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:28:12 2022] GET /identity/v3/projects/52926432875245df81bfd82b5824c1f0 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:12.890852 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bdd63-1cf7-4061-a5fc-dc2aa4235b68 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:12.952701 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512eade-c3c4-435b-beca-14af039822c3 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:12.958000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:12.988456 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f72ce-1809-4893-b51c-f87b80ae2d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:12.989140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f72ce-1809-4893-b51c-f87b80ae2d09 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:12.989424 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f72ce-1809-4893-b51c-f87b80ae2d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:12.989748 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f72ce-1809-4893-b51c-f87b80ae2d09 None admin] PATH_INFO: `/v3/users/025ee3cad2d647b4b228fd1da9ef54ce` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:12.990940 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f72ce-1809-4893-b51c-f87b80ae2d09 None admin] RBAC: Authorizing `identity:get_user(user_id=025ee3cad2d647b4b228fd1da9ef54ce)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:12.992476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f72ce-1809-4893-b51c-f87b80ae2d09 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:12.994312 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 93/178] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:28:12 2022] GET /identity/v3/users/025ee3cad2d647b4b228fd1da9ef54ce => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:12.995058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f72ce-1809-4893-b51c-f87b80ae2d09 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:13.013514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bdd63-1cf7-4061-a5fc-dc2aa4235b68 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:13.060927 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e9838-72d2-4762-b941-8d3d09711f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:13.062498 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e9838-72d2-4762-b941-8d3d09711f04 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:13.062931 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e9838-72d2-4762-b941-8d3d09711f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:13.063394 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e9838-72d2-4762-b941-8d3d09711f04 None admin] PATH_INFO: `/v3/users/025ee3cad2d647b4b228fd1da9ef54ce` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:13.064948 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e9838-72d2-4762-b941-8d3d09711f04 None admin] RBAC: Authorizing `identity:get_user(user_id=025ee3cad2d647b4b228fd1da9ef54ce)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:13.067808 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e9838-72d2-4762-b941-8d3d09711f04 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:13.070213 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 86/179] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:28:12 2022] GET /identity/v3/users/025ee3cad2d647b4b228fd1da9ef54ce => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:13.072096 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e9838-72d2-4762-b941-8d3d09711f04 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:13.103486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f72ce-1809-4893-b51c-f87b80ae2d09 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:13.119695 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:13.141887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b6d6-0707-42ee-8039-1899d3c4ce70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:13.142485 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b6d6-0707-42ee-8039-1899d3c4ce70 None admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:13.142786 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b6d6-0707-42ee-8039-1899d3c4ce70 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:13.143128 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b6d6-0707-42ee-8039-1899d3c4ce70 None admin] PATH_INFO: `/v3/projects/52926432875245df81bfd82b5824c1f0/users/684a751de16847e89940f021a2b825e2/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:13.145160 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3b6d6-0707-42ee-8039-1899d3c4ce70 None admin] RBAC: Authorizing `identity:create_grant(project_id=52926432875245df81bfd82b5824c1f0, user_id=684a751de16847e89940f021a2b825e2, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:13.146671 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3b6d6-0707-42ee-8039-1899d3c4ce70 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:13.169870 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 94/180] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:28:12 2022] PUT /identity/v3/projects/52926432875245df81bfd82b5824c1f0/users/684a751de16847e89940f021a2b825e2/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:28:13.169870 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b6d6-0707-42ee-8039-1899d3c4ce70 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:13.259829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e9838-72d2-4762-b941-8d3d09711f04 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:13.320726 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:13.341616 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d820249-3541-4773-b11f-3f6fe2aec396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:13.342464 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d820249-3541-4773-b11f-3f6fe2aec396 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:13.342753 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d820249-3541-4773-b11f-3f6fe2aec396 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:13.343027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d820249-3541-4773-b11f-3f6fe2aec396 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:13.392935 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b6d6-0707-42ee-8039-1899d3c4ce70 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:13.441350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73138230-0d0f-4098-8c9b-1226b658ba8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:13.442353 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73138230-0d0f-4098-8c9b-1226b658ba8f None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:13.442646 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73138230-0d0f-4098-8c9b-1226b658ba8f None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:13.442988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73138230-0d0f-4098-8c9b-1226b658ba8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:13.450538 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d820249-3541-4773-b11f-3f6fe2aec396 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:13.452758 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d820249-3541-4773-b11f-3f6fe2aec396 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:13.504456 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:13.558397 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73138230-0d0f-4098-8c9b-1226b658ba8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:13.559896 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73138230-0d0f-4098-8c9b-1226b658ba8f None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:13.632408 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 87/181] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:28:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 14:28:13.642853 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d820249-3541-4773-b11f-3f6fe2aec396 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:13.695537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:13.708601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 95/182] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:28:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 14:28:13.719885 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73138230-0d0f-4098-8c9b-1226b658ba8f None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:13.811777 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d820249-3541-4773-b11f-3f6fe2aec396 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:13.878989 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:13.894570 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddae15-875f-4d96-8311-1c8049edd981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:13.898357 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddae15-875f-4d96-8311-1c8049edd981 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:13.898789 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddae15-875f-4d96-8311-1c8049edd981 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:13.899232 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddae15-875f-4d96-8311-1c8049edd981 None admin] PATH_INFO: `/v3/projects/52926432875245df81bfd82b5824c1f0` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:13.902147 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddae15-875f-4d96-8311-1c8049edd981 None admin] RBAC: Authorizing `identity:get_project(project_id=52926432875245df81bfd82b5824c1f0)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:13.903772 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddae15-875f-4d96-8311-1c8049edd981 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:13.906756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 88/183] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:28:13 2022] GET /identity/v3/projects/52926432875245df81bfd82b5824c1f0 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:13.914720 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddae15-875f-4d96-8311-1c8049edd981 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:13.926136 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73138230-0d0f-4098-8c9b-1226b658ba8f None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:13.976516 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59026658-4888-443c-b8fd-de0c677746df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:13.977935 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59026658-4888-443c-b8fd-de0c677746df None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:13.979851 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59026658-4888-443c-b8fd-de0c677746df None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:13.980278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59026658-4888-443c-b8fd-de0c677746df None admin] PATH_INFO: `/v3/projects/52926432875245df81bfd82b5824c1f0` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:13.982396 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59026658-4888-443c-b8fd-de0c677746df None admin] RBAC: Authorizing `identity:get_project(project_id=52926432875245df81bfd82b5824c1f0)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:13.984140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59026658-4888-443c-b8fd-de0c677746df None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:13.991334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 96/184] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:28:13 2022] GET /identity/v3/projects/52926432875245df81bfd82b5824c1f0 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:13.992395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59026658-4888-443c-b8fd-de0c677746df None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:14.105645 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:14.116865 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddae15-875f-4d96-8311-1c8049edd981 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:14.165319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0743c6-3b70-4db8-a02a-7949159dd7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:14.165319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0743c6-3b70-4db8-a02a-7949159dd7f1 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:14.165608 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0743c6-3b70-4db8-a02a-7949159dd7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:14.165870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0743c6-3b70-4db8-a02a-7949159dd7f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:14.166599 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0743c6-3b70-4db8-a02a-7949159dd7f1 None admin] RBAC: Adding query filter params (role.id=fe3ee5741c6143adb5459b5de54450c8, scope.project.id=52926432875245df81bfd82b5824c1f0, user.id=025ee3cad2d647b4b228fd1da9ef54ce) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:14.166909 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0743c6-3b70-4db8-a02a-7949159dd7f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:14.168348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0743c6-3b70-4db8-a02a-7949159dd7f1 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:14.176061 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 89/185] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:28:13 2022] GET /identity/v3/role_assignments?user.id=025ee3cad2d647b4b228fd1da9ef54ce&scope.project.id=52926432875245df81bfd82b5824c1f0&role.id=fe3ee5741c6143adb5459b5de54450c8 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:14.203864 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59026658-4888-443c-b8fd-de0c677746df None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:14.244820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b54570-dc8c-4f67-b73e-abc7a95e4097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:14.245791 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b54570-dc8c-4f67-b73e-abc7a95e4097 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:14.246306 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b54570-dc8c-4f67-b73e-abc7a95e4097 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:14.246771 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b54570-dc8c-4f67-b73e-abc7a95e4097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:14.247730 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b54570-dc8c-4f67-b73e-abc7a95e4097 None admin] RBAC: Adding query filter params (role.id=e37d07e878834488b4da4408ae42afd2, scope.project.id=52926432875245df81bfd82b5824c1f0, user.id=025ee3cad2d647b4b228fd1da9ef54ce) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:14.248232 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b54570-dc8c-4f67-b73e-abc7a95e4097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:14.249922 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b54570-dc8c-4f67-b73e-abc7a95e4097 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:14.257161 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 97/186] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:28:13 2022] GET /identity/v3/role_assignments?user.id=025ee3cad2d647b4b228fd1da9ef54ce&scope.project.id=52926432875245df81bfd82b5824c1f0&role.id=e37d07e878834488b4da4408ae42afd2 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:14.803903 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127d946-cb5d-480e-8998-c3d559e0f520 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:14.804446 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127d946-cb5d-480e-8998-c3d559e0f520 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:14.804446 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127d946-cb5d-480e-8998-c3d559e0f520 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:14.806174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 90/187] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:14.811123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9820974-8c5a-4f30-be41-b34a8a64e76b None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:14.811487 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9820974-8c5a-4f30-be41-b34a8a64e76b None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:14.811676 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9820974-8c5a-4f30-be41-b34a8a64e76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:14.825547 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:14.831322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-c9820974-8c5a-4f30-be41-b34a8a64e76b None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:14.832726 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-c9820974-8c5a-4f30-be41-b34a8a64e76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:14.866445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd32937-5846-4837-9184-56a73a77177b None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:14.866778 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd32937-5846-4837-9184-56a73a77177b None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:14.867010 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd32937-5846-4837-9184-56a73a77177b None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:14.869444 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 91/188] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:28:14.874670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfab2a5-dae6-4afe-9379-f65760731821 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:14.874954 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfab2a5-dae6-4afe-9379-f65760731821 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:14.875600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfab2a5-dae6-4afe-9379-f65760731821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:14.897262 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-fbfab2a5-dae6-4afe-9379-f65760731821 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:14.898525 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-fbfab2a5-dae6-4afe-9379-f65760731821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:14.900246 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 98/189] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:14.966249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 92/190] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:28:15.171387 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9820974-8c5a-4f30-be41-b34a8a64e76b None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:15.236703 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfab2a5-dae6-4afe-9379-f65760731821 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:15.277641 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9820974-8c5a-4f30-be41-b34a8a64e76b None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:15.312916 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff102a-7ed5-4318-83ce-4da535e85311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:15.313545 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff102a-7ed5-4318-83ce-4da535e85311 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:15.313823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff102a-7ed5-4318-83ce-4da535e85311 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:15.314110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff102a-7ed5-4318-83ce-4da535e85311 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:15.316835 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:15.325452 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff102a-7ed5-4318-83ce-4da535e85311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:15.327325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:15.330307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-62ff102a-7ed5-4318-83ce-4da535e85311 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 14:28:15.330307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:15.330307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:15.330307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:15.330307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:15.330307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:15.330307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:15.330307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:15.330307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:15.330307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:15.330307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:15.330307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:15.330307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:15.330307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:15.330307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:15.330307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:15.331168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:15.331168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:15.331168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:15.331168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:15.331168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:15.331168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:15.331168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:15.331168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:15.331168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:15.331168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:15.331168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:15.331168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:15.331168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:15.331168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:15.331168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:15.331168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:15.331952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:15.331952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:15.331952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:15.331952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:15.331952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:15.331952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:15.331952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:15.331952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:15.331952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:15.331952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:15.331952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 14:28:15.331952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:15.331952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 99/191] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:15.338373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff102a-7ed5-4318-83ce-4da535e85311 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:15.343512 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfab2a5-dae6-4afe-9379-f65760731821 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:15.378556 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc27c6-88f1-4616-bfef-dd63e8552edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:15.379220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc27c6-88f1-4616-bfef-dd63e8552edf None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:15.379496 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc27c6-88f1-4616-bfef-dd63e8552edf None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:15.379766 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc27c6-88f1-4616-bfef-dd63e8552edf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:15.380932 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc27c6-88f1-4616-bfef-dd63e8552edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:15.382406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc27c6-88f1-4616-bfef-dd63e8552edf None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:15.384109 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 93/192] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:15.389250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc27c6-88f1-4616-bfef-dd63e8552edf None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:15.438137 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff102a-7ed5-4318-83ce-4da535e85311 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:15.482067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5f045-b820-4551-aefa-7c1d0c953ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:15.482974 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5f045-b820-4551-aefa-7c1d0c953ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:15.483449 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5f045-b820-4551-aefa-7c1d0c953ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:15.483897 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5f045-b820-4551-aefa-7c1d0c953ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:15.485172 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5f045-b820-4551-aefa-7c1d0c953ca5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:15.485772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5f045-b820-4551-aefa-7c1d0c953ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:15.488572 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5f045-b820-4551-aefa-7c1d0c953ca5 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:15.496538 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc27c6-88f1-4616-bfef-dd63e8552edf None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:15.499864 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 100/193] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Oct 20 14:28:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:15.505319 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5f045-b820-4551-aefa-7c1d0c953ca5 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:15.533161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea24e84-7df5-4f05-a37a-2016032a0151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:15.534312 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea24e84-7df5-4f05-a37a-2016032a0151 None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:15.534593 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea24e84-7df5-4f05-a37a-2016032a0151 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:15.534872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea24e84-7df5-4f05-a37a-2016032a0151 None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:15.535584 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea24e84-7df5-4f05-a37a-2016032a0151 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:15.537021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea24e84-7df5-4f05-a37a-2016032a0151 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:15.562802 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 94/194] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Oct 20 14:28:15 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:28:15.565589 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439d26d-d365-4a9f-9d96-a0d720c494b5 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:15.566045 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439d26d-d365-4a9f-9d96-a0d720c494b5 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:15.566408 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439d26d-d365-4a9f-9d96-a0d720c494b5 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:15.566804 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:15.567876 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 95/195] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:15.574267 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0f3ad-0074-4a8e-8802-53253a731eeb None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:15.574590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0f3ad-0074-4a8e-8802-53253a731eeb None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:15.574829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0f3ad-0074-4a8e-8802-53253a731eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:15.593672 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-28e0f3ad-0074-4a8e-8802-53253a731eeb None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:15.594941 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-28e0f3ad-0074-4a8e-8802-53253a731eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:15.604868 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:15.617139 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5f045-b820-4551-aefa-7c1d0c953ca5 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:15.655720 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee252d-ea2b-4b56-87fa-2648c92c68fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:15.656368 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee252d-ea2b-4b56-87fa-2648c92c68fb None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:15.656651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee252d-ea2b-4b56-87fa-2648c92c68fb None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:15.656924 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee252d-ea2b-4b56-87fa-2648c92c68fb None admin] PATH_INFO: `/v3/users/52e979b5fb2a4b659a6aea964a487dbb` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:15.672267 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee252d-ea2b-4b56-87fa-2648c92c68fb None admin] RBAC: Authorizing `identity:get_user(user_id=52e979b5fb2a4b659a6aea964a487dbb)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:15.673783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee252d-ea2b-4b56-87fa-2648c92c68fb None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:15.676374 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 101/196] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:28:15 2022] GET /identity/v3/users/52e979b5fb2a4b659a6aea964a487dbb => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:15.680370 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 96/197] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:28:15.683105 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee252d-ea2b-4b56-87fa-2648c92c68fb None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:15.793511 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee252d-ea2b-4b56-87fa-2648c92c68fb None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:15.810920 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:15.831915 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e130a-2cd5-4072-8f28-53d763f2b302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:15.833321 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e130a-2cd5-4072-8f28-53d763f2b302 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:15.833806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e130a-2cd5-4072-8f28-53d763f2b302 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:15.834310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e130a-2cd5-4072-8f28-53d763f2b302 None admin] PATH_INFO: `/v3/projects/52926432875245df81bfd82b5824c1f0` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:15.835689 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e130a-2cd5-4072-8f28-53d763f2b302 None admin] RBAC: Authorizing `identity:get_project(project_id=52926432875245df81bfd82b5824c1f0)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:15.837346 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e130a-2cd5-4072-8f28-53d763f2b302 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:15.839526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 102/198] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:28:15 2022] GET /identity/v3/projects/52926432875245df81bfd82b5824c1f0 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:15.844909 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0f3ad-0074-4a8e-8802-53253a731eeb None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:15.947581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0f3ad-0074-4a8e-8802-53253a731eeb None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:15.961283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e130a-2cd5-4072-8f28-53d763f2b302 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:15.990102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f389e77-ac20-4cfa-ac46-c36bae99cb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:15.990767 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f389e77-ac20-4cfa-ac46-c36bae99cb1b None admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:15.991042 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f389e77-ac20-4cfa-ac46-c36bae99cb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:15.991311 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f389e77-ac20-4cfa-ac46-c36bae99cb1b None admin] PATH_INFO: `/v3/projects/52926432875245df81bfd82b5824c1f0/users/52e979b5fb2a4b659a6aea964a487dbb/roles/1e6a00ec995a45ba85a12b55a1eacc4c` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:15.993319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f389e77-ac20-4cfa-ac46-c36bae99cb1b None admin] RBAC: Authorizing `identity:create_grant(project_id=52926432875245df81bfd82b5824c1f0, user_id=52e979b5fb2a4b659a6aea964a487dbb, role_id=1e6a00ec995a45ba85a12b55a1eacc4c)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:15.994868 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f389e77-ac20-4cfa-ac46-c36bae99cb1b None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:16.011602 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 97/199] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:28:15 2022] PUT /identity/v3/projects/52926432875245df81bfd82b5824c1f0/users/52e979b5fb2a4b659a6aea964a487dbb/roles/1e6a00ec995a45ba85a12b55a1eacc4c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:28:16.091625 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e130a-2cd5-4072-8f28-53d763f2b302 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:16.131761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46de675-c16c-4506-a716-4b20e13fe760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:16.132492 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46de675-c16c-4506-a716-4b20e13fe760 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:16.132823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46de675-c16c-4506-a716-4b20e13fe760 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:16.133104 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46de675-c16c-4506-a716-4b20e13fe760 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:16.145753 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46de675-c16c-4506-a716-4b20e13fe760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:16.151550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-d46de675-c16c-4506-a716-4b20e13fe760 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:16.151550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:16.151550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:16.151550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:16.151550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:16.151550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:16.151550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:16.151550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:16.151550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:16.151550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:16.151550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:16.151550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:16.151550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:16.151550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:16.151550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:16.151550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:16.152416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:16.152416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:16.152416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:16.152416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:16.152416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:16.152416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:16.152416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:16.152416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:16.152416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:16.152416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:16.152416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:16.152416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:16.152416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:16.152416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:16.152416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:16.152416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:16.153450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:16.153450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:16.153450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:16.153450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:16.153450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:16.153450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:16.153450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:16.153450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:16.153450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:16.153450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:16.153450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:16.153450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:16.153450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 103/200] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:16.164131 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f389e77-ac20-4cfa-ac46-c36bae99cb1b None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:16.168859 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:16.281098 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f389e77-ac20-4cfa-ac46-c36bae99cb1b None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:16.317715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f126d8b-ff11-42bf-a52c-cf0416fbedad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:16.318690 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f126d8b-ff11-42bf-a52c-cf0416fbedad None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:16.319183 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f126d8b-ff11-42bf-a52c-cf0416fbedad None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:16.319663 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f126d8b-ff11-42bf-a52c-cf0416fbedad None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:16.320583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f126d8b-ff11-42bf-a52c-cf0416fbedad None admin] RBAC: Adding query filter params (name=member) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:16.321118 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f126d8b-ff11-42bf-a52c-cf0416fbedad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:16.322703 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f126d8b-ff11-42bf-a52c-cf0416fbedad None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:16.336621 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 98/201] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Oct 20 14:28:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:16.338295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46de675-c16c-4506-a716-4b20e13fe760 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:16.387032 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:16.444867 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46de675-c16c-4506-a716-4b20e13fe760 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:16.481168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb06ae7-ca10-4179-80cf-37543873a445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:16.482119 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb06ae7-ca10-4179-80cf-37543873a445 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:16.482500 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb06ae7-ca10-4179-80cf-37543873a445 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:16.482925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb06ae7-ca10-4179-80cf-37543873a445 None admin] PATH_INFO: `/v3/users/684a751de16847e89940f021a2b825e2` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:16.484168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb06ae7-ca10-4179-80cf-37543873a445 None admin] RBAC: Authorizing `identity:get_user(user_id=684a751de16847e89940f021a2b825e2)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:16.485742 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb06ae7-ca10-4179-80cf-37543873a445 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:16.488465 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 104/202] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:28:16 2022] GET /identity/v3/users/684a751de16847e89940f021a2b825e2 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:16.494285 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f126d8b-ff11-42bf-a52c-cf0416fbedad None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:16.561442 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:16.601483 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f126d8b-ff11-42bf-a52c-cf0416fbedad None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:16.635991 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa45e9-9576-4a10-badd-dd9935c706a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:16.636750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa45e9-9576-4a10-badd-dd9935c706a3 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:16.637187 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa45e9-9576-4a10-badd-dd9935c706a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:16.637500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa45e9-9576-4a10-badd-dd9935c706a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:16.714820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa45e9-9576-4a10-badd-dd9935c706a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:16.716457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa45e9-9576-4a10-badd-dd9935c706a3 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:16.782042 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:16.826050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 99/203] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:28:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 14:28:16.827871 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb06ae7-ca10-4179-80cf-37543873a445 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:16.936393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb06ae7-ca10-4179-80cf-37543873a445 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:16.950848 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:16.973506 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96d6ec-a249-414b-ad64-c242867169a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:16.974165 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96d6ec-a249-414b-ad64-c242867169a3 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:16.974442 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96d6ec-a249-414b-ad64-c242867169a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:16.974710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96d6ec-a249-414b-ad64-c242867169a3 None admin] PATH_INFO: `/v3/projects/52926432875245df81bfd82b5824c1f0` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:16.975810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96d6ec-a249-414b-ad64-c242867169a3 None admin] RBAC: Authorizing `identity:get_project(project_id=52926432875245df81bfd82b5824c1f0)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:16.977263 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96d6ec-a249-414b-ad64-c242867169a3 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:16.978906 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 105/204] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:28:16 2022] GET /identity/v3/projects/52926432875245df81bfd82b5824c1f0 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:16.985142 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa45e9-9576-4a10-badd-dd9935c706a3 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:17.089510 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa45e9-9576-4a10-badd-dd9935c706a3 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:17.124445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6b4d3-c857-4c46-af4c-de64447f31a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:17.125045 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6b4d3-c857-4c46-af4c-de64447f31a0 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:17.125319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6b4d3-c857-4c46-af4c-de64447f31a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:17.125590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6b4d3-c857-4c46-af4c-de64447f31a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:17.126356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6b4d3-c857-4c46-af4c-de64447f31a0 None admin] RBAC: Adding query filter params (role.id=59cd13c6b53b4329b0af96ce23f01e5e, scope.project.id=52926432875245df81bfd82b5824c1f0, user.id=684a751de16847e89940f021a2b825e2) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:17.126662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6b4d3-c857-4c46-af4c-de64447f31a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:17.128125 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6b4d3-c857-4c46-af4c-de64447f31a0 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:17.134212 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 100/205] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:28:16 2022] GET /identity/v3/role_assignments?user.id=684a751de16847e89940f021a2b825e2&scope.project.id=52926432875245df81bfd82b5824c1f0&role.id=59cd13c6b53b4329b0af96ce23f01e5e => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:18.020562 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b923bd-d143-435d-bb45-a984f2d46f90 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:18.021075 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b923bd-d143-435d-bb45-a984f2d46f90 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:18.021149 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b923bd-d143-435d-bb45-a984f2d46f90 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:18.022616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 106/206] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:18.027782 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee1c08-eb36-43b7-b1e0-0779024f1471 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:18.028188 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee1c08-eb36-43b7-b1e0-0779024f1471 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:18.028410 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee1c08-eb36-43b7-b1e0-0779024f1471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:18.046958 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-84ee1c08-eb36-43b7-b1e0-0779024f1471 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:18.048167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-84ee1c08-eb36-43b7-b1e0-0779024f1471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:18.051754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5d265-1760-4385-b2c7-b848a3a27ebb None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:18.052033 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5d265-1760-4385-b2c7-b848a3a27ebb None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:18.052306 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5d265-1760-4385-b2c7-b848a3a27ebb None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:18.053678 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 107/207] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:28:18.058900 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906481f-6a2e-4f71-b417-21ca7bc8df41 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:18.059183 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906481f-6a2e-4f71-b417-21ca7bc8df41 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:18.059458 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906481f-6a2e-4f71-b417-21ca7bc8df41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:18.072835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:18.078213 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-a906481f-6a2e-4f71-b417-21ca7bc8df41 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:18.079384 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a906481f-6a2e-4f71-b417-21ca7bc8df41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:18.126028 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 101/208] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:18.153681 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 108/209] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:28:18.242664 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4eb0a8-72f9-4ab9-9ce5-defdc9ce40bc None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:18.242955 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4eb0a8-72f9-4ab9-9ce5-defdc9ce40bc None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:18.243232 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4eb0a8-72f9-4ab9-9ce5-defdc9ce40bc None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:18.244724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 102/210] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:18.249673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d1e2a-2583-4c80-892e-f1ab43a8abe2 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:18.250001 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d1e2a-2583-4c80-892e-f1ab43a8abe2 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:18.250279 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d1e2a-2583-4c80-892e-f1ab43a8abe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:18.268698 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-d54d1e2a-2583-4c80-892e-f1ab43a8abe2 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:18.269903 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-d54d1e2a-2583-4c80-892e-f1ab43a8abe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:18.341877 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 109/211] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:18.404045 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4eb0a8-72f9-4ab9-9ce5-defdc9ce40bc None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:18.429500 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d1e2a-2583-4c80-892e-f1ab43a8abe2 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:18.472380 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:18.514686 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4eb0a8-72f9-4ab9-9ce5-defdc9ce40bc None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:18.528911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d1e2a-2583-4c80-892e-f1ab43a8abe2 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:18.550982 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20062a7-e589-42c0-92df-c28f8e7c648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:18.551722 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20062a7-e589-42c0-92df-c28f8e7c648a None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:18.552118 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20062a7-e589-42c0-92df-c28f8e7c648a None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:18.552393 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20062a7-e589-42c0-92df-c28f8e7c648a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:18.553482 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20062a7-e589-42c0-92df-c28f8e7c648a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:18.555069 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20062a7-e589-42c0-92df-c28f8e7c648a None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:18.557177 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 103/212] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:18.562331 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20062a7-e589-42c0-92df-c28f8e7c648a None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:18.563266 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5a76c-3530-47ce-ade8-6693e3544340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:18.563963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5a76c-3530-47ce-ade8-6693e3544340 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:18.564298 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5a76c-3530-47ce-ade8-6693e3544340 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:18.564583 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5a76c-3530-47ce-ade8-6693e3544340 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:18.575559 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5a76c-3530-47ce-ade8-6693e3544340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:18.580554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-6fa5a76c-3530-47ce-ade8-6693e3544340 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:18.580554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:18.580554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:18.580554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:18.580554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:18.580554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:18.580554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:18.580554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:18.580554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:18.580554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:18.580554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:18.580554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:18.580554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:18.580554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:18.580554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:18.580554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:18.581561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:18.581561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:18.581561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:18.581561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:18.581561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:18.581561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:18.581561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:18.581561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:18.581561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:18.581561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:18.581561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:18.581561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:18.581561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:18.581561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:18.581561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:18.581561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:18.582356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:18.582356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:18.582356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:18.582356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:18.582356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:18.582356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:18.582356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:18.582356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:18.582356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:18.582356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:18.582356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:18.582356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:18.582356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 110/213] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:28:18.587277 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5a76c-3530-47ce-ade8-6693e3544340 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:18.594243 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:18.669237 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20062a7-e589-42c0-92df-c28f8e7c648a None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:18.683804 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:18.687360 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5a76c-3530-47ce-ade8-6693e3544340 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:18.702296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e206863-db8e-4e64-936f-1f2bdc55dadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:18.703117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e206863-db8e-4e64-936f-1f2bdc55dadd None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:18.703550 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e206863-db8e-4e64-936f-1f2bdc55dadd None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:18.703815 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e206863-db8e-4e64-936f-1f2bdc55dadd None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:18.704467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e206863-db8e-4e64-936f-1f2bdc55dadd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:18.706645 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e206863-db8e-4e64-936f-1f2bdc55dadd None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:18.724109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af671ba-ec26-413d-b53b-df1f6f9aeda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:18.724721 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af671ba-ec26-413d-b53b-df1f6f9aeda8 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:18.724996 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af671ba-ec26-413d-b53b-df1f6f9aeda8 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:18.725270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af671ba-ec26-413d-b53b-df1f6f9aeda8 None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:18.725971 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af671ba-ec26-413d-b53b-df1f6f9aeda8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:18.726275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af671ba-ec26-413d-b53b-df1f6f9aeda8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:18.727647 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af671ba-ec26-413d-b53b-df1f6f9aeda8 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:18.728392 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 104/214] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Oct 20 14:28:18 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:28:18.728392 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e206863-db8e-4e64-936f-1f2bdc55dadd None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:18.742950 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 111/215] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Oct 20 14:28:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:18.749005 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af671ba-ec26-413d-b53b-df1f6f9aeda8 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:18.840519 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:18.861079 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e206863-db8e-4e64-936f-1f2bdc55dadd None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:18.863362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af671ba-ec26-413d-b53b-df1f6f9aeda8 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:18.900283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11cc7b-f41f-4d3b-b8e6-02a98de7aae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:18.901029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11cc7b-f41f-4d3b-b8e6-02a98de7aae4 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:18.901265 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fee23-bf12-4314-a5f9-c40df8bcce27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:18.901384 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11cc7b-f41f-4d3b-b8e6-02a98de7aae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:18.901561 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11cc7b-f41f-4d3b-b8e6-02a98de7aae4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:18.901932 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fee23-bf12-4314-a5f9-c40df8bcce27 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:18.902315 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fee23-bf12-4314-a5f9-c40df8bcce27 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:18.902592 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fee23-bf12-4314-a5f9-c40df8bcce27 None admin] PATH_INFO: `/v3/users/f0f9bfb56824402086eb0b3d09bb89f3` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:18.914525 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11cc7b-f41f-4d3b-b8e6-02a98de7aae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:18.920006 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105fee23-bf12-4314-a5f9-c40df8bcce27 None admin] RBAC: Authorizing `identity:get_user(user_id=f0f9bfb56824402086eb0b3d09bb89f3)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:18.920148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-ec11cc7b-f41f-4d3b-b8e6-02a98de7aae4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 14:28:18.920148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:18.920148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:18.920148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:18.920148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:18.920148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:18.920148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:18.920148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:18.920148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:18.920148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:18.920148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:18.920148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:18.920148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:18.920148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:18.920148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:18.920148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:18.920939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:18.920939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:18.920939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:18.920939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:18.920939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:18.920939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:18.920939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:18.920939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:18.920939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:18.920939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:18.920939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:18.920939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:18.920939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:18.920939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:18.920939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:18.920939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:18.921746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:18.921746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:18.921746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:18.921746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:18.921746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:18.921746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:18.921746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:18.921746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:18.921746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:18.921746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:18.921746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 14:28:18.921746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:18.921746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 105/216] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:18.923421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105fee23-bf12-4314-a5f9-c40df8bcce27 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:18.925786 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 112/217] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:28:18 2022] GET /identity/v3/users/f0f9bfb56824402086eb0b3d09bb89f3 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:18.927512 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11cc7b-f41f-4d3b-b8e6-02a98de7aae4 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:18.931747 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fee23-bf12-4314-a5f9-c40df8bcce27 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:18.953819 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:19.048834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11cc7b-f41f-4d3b-b8e6-02a98de7aae4 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:19.056537 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fee23-bf12-4314-a5f9-c40df8bcce27 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:19.095142 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab56183-17c5-45a8-bb79-bd64d8e31abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:19.096465 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab56183-17c5-45a8-bb79-bd64d8e31abd None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:19.097112 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab56183-17c5-45a8-bb79-bd64d8e31abd None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:19.097469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab56183-17c5-45a8-bb79-bd64d8e31abd None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:19.098303 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab56183-17c5-45a8-bb79-bd64d8e31abd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:19.098682 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab56183-17c5-45a8-bb79-bd64d8e31abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:19.098877 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d0b74-ea75-444b-8579-e49835619716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:19.099689 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d0b74-ea75-444b-8579-e49835619716 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:19.099971 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d0b74-ea75-444b-8579-e49835619716 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:19.100157 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab56183-17c5-45a8-bb79-bd64d8e31abd None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:19.100264 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d0b74-ea75-444b-8579-e49835619716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:19.100984 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d0b74-ea75-444b-8579-e49835619716 None admin] RBAC: Adding query filter params (role.id=59cd13c6b53b4329b0af96ce23f01e5e, user.id=f0f9bfb56824402086eb0b3d09bb89f3, scope.system=all) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:19.101289 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d0b74-ea75-444b-8579-e49835619716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:19.102854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d0b74-ea75-444b-8579-e49835619716 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:19.108353 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 113/218] 10.222.0.17 () {56 vars in 1308 bytes} [Thu Oct 20 14:28:18 2022] GET /identity/v3/role_assignments?user.id=f0f9bfb56824402086eb0b3d09bb89f3&scope.system=all&role.id=59cd13c6b53b4329b0af96ce23f01e5e => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:19.114448 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 106/219] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Oct 20 14:28:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:19.120705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d0b74-ea75-444b-8579-e49835619716 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:19.232695 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:19.253198 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d0b74-ea75-444b-8579-e49835619716 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:19.290765 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c905b08-ee88-4c04-b931-5338cc74c3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:19.291776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c905b08-ee88-4c04-b931-5338cc74c3cc None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:19.292075 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c905b08-ee88-4c04-b931-5338cc74c3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:19.292344 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c905b08-ee88-4c04-b931-5338cc74c3cc None admin] PATH_INFO: `/v3/users/52e979b5fb2a4b659a6aea964a487dbb` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:19.293459 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c905b08-ee88-4c04-b931-5338cc74c3cc None admin] RBAC: Authorizing `identity:get_user(user_id=52e979b5fb2a4b659a6aea964a487dbb)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:19.294942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c905b08-ee88-4c04-b931-5338cc74c3cc None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:19.296515 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 114/220] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:28:19 2022] GET /identity/v3/users/52e979b5fb2a4b659a6aea964a487dbb => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:19.302128 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab56183-17c5-45a8-bb79-bd64d8e31abd None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:19.306244 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:19.405353 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab56183-17c5-45a8-bb79-bd64d8e31abd None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:19.441225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bb2c0-d7c5-43a4-b5cf-ee51f1418225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:19.441835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bb2c0-d7c5-43a4-b5cf-ee51f1418225 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:19.442135 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bb2c0-d7c5-43a4-b5cf-ee51f1418225 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:19.442405 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bb2c0-d7c5-43a4-b5cf-ee51f1418225 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:19.515125 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bb2c0-d7c5-43a4-b5cf-ee51f1418225 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:19.516603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bb2c0-d7c5-43a4-b5cf-ee51f1418225 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:19.519863 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:19.624605 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 107/221] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:28:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 14:28:19.630015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c905b08-ee88-4c04-b931-5338cc74c3cc None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:19.734971 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c905b08-ee88-4c04-b931-5338cc74c3cc None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:19.769718 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b991ca-1522-4d2d-a066-a054576a7a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:19.770385 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b991ca-1522-4d2d-a066-a054576a7a03 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:19.770708 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b991ca-1522-4d2d-a066-a054576a7a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:19.770984 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b991ca-1522-4d2d-a066-a054576a7a03 None admin] PATH_INFO: `/v3/projects/52926432875245df81bfd82b5824c1f0` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:19.772103 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b991ca-1522-4d2d-a066-a054576a7a03 None admin] RBAC: Authorizing `identity:get_project(project_id=52926432875245df81bfd82b5824c1f0)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:19.773609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b991ca-1522-4d2d-a066-a054576a7a03 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:19.775675 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 115/222] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:28:19 2022] GET /identity/v3/projects/52926432875245df81bfd82b5824c1f0 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:19.781504 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bb2c0-d7c5-43a4-b5cf-ee51f1418225 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:19.897821 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bb2c0-d7c5-43a4-b5cf-ee51f1418225 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:19.900163 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:19.935578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0714b-a0a1-43da-b97c-c439fbcfd489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:19.936237 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0714b-a0a1-43da-b97c-c439fbcfd489 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:19.936523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0714b-a0a1-43da-b97c-c439fbcfd489 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:19.936795 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0714b-a0a1-43da-b97c-c439fbcfd489 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:19.937518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0714b-a0a1-43da-b97c-c439fbcfd489 None admin] RBAC: Adding query filter params (role.id=1e6a00ec995a45ba85a12b55a1eacc4c, scope.project.id=52926432875245df81bfd82b5824c1f0, user.id=52e979b5fb2a4b659a6aea964a487dbb) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:19.937823 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0714b-a0a1-43da-b97c-c439fbcfd489 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:19.939289 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0714b-a0a1-43da-b97c-c439fbcfd489 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:19.946209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 108/223] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:28:19 2022] GET /identity/v3/role_assignments?user.id=52e979b5fb2a4b659a6aea964a487dbb&scope.project.id=52926432875245df81bfd82b5824c1f0&role.id=1e6a00ec995a45ba85a12b55a1eacc4c => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:21.117309 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfa8c9-48ca-4675-9687-cf0e1730c953 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:21.117815 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfa8c9-48ca-4675-9687-cf0e1730c953 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:21.118151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfa8c9-48ca-4675-9687-cf0e1730c953 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:21.119243 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 116/224] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:21.124571 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fb42b-8d1d-43ff-9d76-ef4424deefd3 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:21.124971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fb42b-8d1d-43ff-9d76-ef4424deefd3 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:21.125131 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fb42b-8d1d-43ff-9d76-ef4424deefd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:21.125620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40f6ad-a84f-4350-bd2e-997b5f0b0082 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:21.125939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40f6ad-a84f-4350-bd2e-997b5f0b0082 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:21.126218 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40f6ad-a84f-4350-bd2e-997b5f0b0082 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:21.127629 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 117/225] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:28:21.133823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c56d8b-c5cc-40c1-9e79-c5c334570060 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:21.134145 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c56d8b-c5cc-40c1-9e79-c5c334570060 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:21.134423 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c56d8b-c5cc-40c1-9e79-c5c334570060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:21.143872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-f59fb42b-8d1d-43ff-9d76-ef4424deefd3 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:21.145048 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-f59fb42b-8d1d-43ff-9d76-ef4424deefd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:21.153258 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-a8c56d8b-c5cc-40c1-9e79-c5c334570060 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:21.154451 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a8c56d8b-c5cc-40c1-9e79-c5c334570060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:21.169241 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:21.229104 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 109/226] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:21.230112 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 118/227] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:28:21.312289 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae246b49-0d33-4029-b666-ce56af4e0cdf None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:21.312602 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae246b49-0d33-4029-b666-ce56af4e0cdf None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:21.312844 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae246b49-0d33-4029-b666-ce56af4e0cdf None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:21.314346 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 110/228] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:21.319616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca7920-de31-41b5-b4b6-fe44956e1570 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:21.319902 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca7920-de31-41b5-b4b6-fe44956e1570 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:21.320172 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca7920-de31-41b5-b4b6-fe44956e1570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:21.338041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-06ca7920-de31-41b5-b4b6-fe44956e1570 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:21.339216 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-06ca7920-de31-41b5-b4b6-fe44956e1570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:21.406093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 119/229] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:21.500365 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae246b49-0d33-4029-b666-ce56af4e0cdf None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:21.505274 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca7920-de31-41b5-b4b6-fe44956e1570 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:21.588233 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:21.608892 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:21.611196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca7920-de31-41b5-b4b6-fe44956e1570 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:21.613769 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae246b49-0d33-4029-b666-ce56af4e0cdf None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:21.649773 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba19b9-5bb1-4b22-8b38-4dd13464e946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:21.650243 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f1862-d667-4425-a6b6-a27ca24cf3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:21.650442 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba19b9-5bb1-4b22-8b38-4dd13464e946 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:21.650702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba19b9-5bb1-4b22-8b38-4dd13464e946 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:21.650876 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f1862-d667-4425-a6b6-a27ca24cf3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:21.650970 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba19b9-5bb1-4b22-8b38-4dd13464e946 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:21.651166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f1862-d667-4425-a6b6-a27ca24cf3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:21.651539 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f1862-d667-4425-a6b6-a27ca24cf3b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:21.652047 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba19b9-5bb1-4b22-8b38-4dd13464e946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:21.653474 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba19b9-5bb1-4b22-8b38-4dd13464e946 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:21.655277 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 111/230] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:21.660676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba19b9-5bb1-4b22-8b38-4dd13464e946 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:21.662400 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f1862-d667-4425-a6b6-a27ca24cf3b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:21.667322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-069f1862-d667-4425-a6b6-a27ca24cf3b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 14:28:21.667322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:21.667322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:21.667322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:21.667322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:21.667322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:21.667322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:21.667322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:21.667322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:21.667322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:21.667322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:21.667322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:21.667322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:21.667322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:21.667322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:21.667322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:21.668174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:21.668174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:21.668174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:21.668174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:21.668174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:21.668174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:21.668174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:21.668174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:21.668174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:21.668174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:21.668174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:21.668174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:21.668174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:21.668174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:21.668174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:21.668174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:21.668985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:21.668985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:21.668985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:21.668985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:21.668985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:21.668985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:21.668985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:21.668985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:21.668985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:21.668985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:21.668985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 14:28:21.668985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:21.673035 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 120/231] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:28:21.673821 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f1862-d667-4425-a6b6-a27ca24cf3b3 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:21.760025 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba19b9-5bb1-4b22-8b38-4dd13464e946 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:21.772456 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f1862-d667-4425-a6b6-a27ca24cf3b3 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:21.793351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc9414-881b-4bc7-8de9-b0358b2e9ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:21.793994 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc9414-881b-4bc7-8de9-b0358b2e9ff1 None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:21.794276 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc9414-881b-4bc7-8de9-b0358b2e9ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:21.794548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc9414-881b-4bc7-8de9-b0358b2e9ff1 None admin] PATH_INFO: `/v3/groups` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:21.795173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc9414-881b-4bc7-8de9-b0358b2e9ff1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:21.796603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc9414-881b-4bc7-8de9-b0358b2e9ff1 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:21.807508 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500384d7-5766-4bec-a077-b68bc2a21b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:21.808109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500384d7-5766-4bec-a077-b68bc2a21b70 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:21.808388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500384d7-5766-4bec-a077-b68bc2a21b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:21.808652 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500384d7-5766-4bec-a077-b68bc2a21b70 None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:21.809315 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500384d7-5766-4bec-a077-b68bc2a21b70 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:21.809719 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500384d7-5766-4bec-a077-b68bc2a21b70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:21.811210 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500384d7-5766-4bec-a077-b68bc2a21b70 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:21.813401 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 112/232] 10.222.0.17 () {60 vars in 1134 bytes} [Thu Oct 20 14:28:21 2022] POST /identity/v3/groups => generated 229 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:28:21.819072 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc9414-881b-4bc7-8de9-b0358b2e9ff1 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:21.820378 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 121/233] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Oct 20 14:28:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:21.826417 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500384d7-5766-4bec-a077-b68bc2a21b70 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:21.829723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:21.855861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:21.943081 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc9414-881b-4bc7-8de9-b0358b2e9ff1 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:21.947316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500384d7-5766-4bec-a077-b68bc2a21b70 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:21.983727 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38480238-ae3f-4698-93c0-01cdbadfba08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:21.984358 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38480238-ae3f-4698-93c0-01cdbadfba08 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:21.984633 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38480238-ae3f-4698-93c0-01cdbadfba08 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:21.985317 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17f087-aca8-471e-8f04-41fdd15280e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:21.985409 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38480238-ae3f-4698-93c0-01cdbadfba08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:21.985480 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17f087-aca8-471e-8f04-41fdd15280e6 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:21.985752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17f087-aca8-471e-8f04-41fdd15280e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:21.986929 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17f087-aca8-471e-8f04-41fdd15280e6 None admin] PATH_INFO: `/v3/users/3f3e14fa4f2e4c5f8d3e02561e27b193` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:21.996909 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38480238-ae3f-4698-93c0-01cdbadfba08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:22.001586 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17f087-aca8-471e-8f04-41fdd15280e6 None admin] RBAC: Authorizing `identity:get_user(user_id=3f3e14fa4f2e4c5f8d3e02561e27b193)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:22.003687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-38480238-ae3f-4698-93c0-01cdbadfba08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:22.003687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:22.003687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:22.003687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:22.003687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:22.003687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:22.003687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:22.003687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:22.003687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:22.003687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:22.003687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:22.003687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:22.003687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:22.003687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:22.003687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:22.003687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:22.004534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:22.004534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:22.004534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:22.004534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:22.004534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:22.004534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:22.004534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:22.004534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:22.004534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:22.004534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:22.004534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:22.004534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:22.004534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:22.004534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:22.004534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:22.004534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:22.006736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:22.006736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:22.006736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:22.006736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:22.006736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:22.006736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:22.006736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:22.006736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:22.006736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:22.006736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:22.006736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:22.006736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:22.007501 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17f087-aca8-471e-8f04-41fdd15280e6 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:22.007583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 113/234] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:22.007659 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 122/235] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:28:21 2022] GET /identity/v3/users/3f3e14fa4f2e4c5f8d3e02561e27b193 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:22.010721 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38480238-ae3f-4698-93c0-01cdbadfba08 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:22.011141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17f087-aca8-471e-8f04-41fdd15280e6 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:22.078122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:22.106081 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:22.130599 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17f087-aca8-471e-8f04-41fdd15280e6 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:22.131138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38480238-ae3f-4698-93c0-01cdbadfba08 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:22.175231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78388b3-1c4b-427c-b357-8486066376e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:22.175873 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78388b3-1c4b-427c-b357-8486066376e0 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:22.176156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78388b3-1c4b-427c-b357-8486066376e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:22.176431 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78388b3-1c4b-427c-b357-8486066376e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:22.177166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78388b3-1c4b-427c-b357-8486066376e0 None admin] RBAC: Adding query filter params (role.id=1e6a00ec995a45ba85a12b55a1eacc4c, user.id=3f3e14fa4f2e4c5f8d3e02561e27b193, scope.system=all) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:22.177477 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78388b3-1c4b-427c-b357-8486066376e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:22.178980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78388b3-1c4b-427c-b357-8486066376e0 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:22.181618 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee8115-be72-44fe-88a1-ae15ad3f9c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:22.182996 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee8115-be72-44fe-88a1-ae15ad3f9c19 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:22.183518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee8115-be72-44fe-88a1-ae15ad3f9c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:22.183921 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee8115-be72-44fe-88a1-ae15ad3f9c19 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:22.184759 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee8115-be72-44fe-88a1-ae15ad3f9c19 None admin] RBAC: Adding query filter params (name=member) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:22.184870 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 123/236] 10.222.0.17 () {56 vars in 1308 bytes} [Thu Oct 20 14:28:22 2022] GET /identity/v3/role_assignments?user.id=3f3e14fa4f2e4c5f8d3e02561e27b193&scope.system=all&role.id=1e6a00ec995a45ba85a12b55a1eacc4c => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:22.185284 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee8115-be72-44fe-88a1-ae15ad3f9c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:22.186918 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee8115-be72-44fe-88a1-ae15ad3f9c19 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:22.197536 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 114/237] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Oct 20 14:28:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:22.203019 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78388b3-1c4b-427c-b357-8486066376e0 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:22.339041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78388b3-1c4b-427c-b357-8486066376e0 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:22.367482 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:22.381284 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea14ec-e89c-46f6-b16c-cfa73fbff283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:22.382034 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea14ec-e89c-46f6-b16c-cfa73fbff283 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:22.382314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea14ec-e89c-46f6-b16c-cfa73fbff283 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:22.382584 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea14ec-e89c-46f6-b16c-cfa73fbff283 None admin] PATH_INFO: `/v3/users/f0f9bfb56824402086eb0b3d09bb89f3` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:22.383712 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea14ec-e89c-46f6-b16c-cfa73fbff283 None admin] RBAC: Authorizing `identity:get_user(user_id=f0f9bfb56824402086eb0b3d09bb89f3)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:22.385431 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea14ec-e89c-46f6-b16c-cfa73fbff283 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:22.387250 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 124/238] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:28:22 2022] GET /identity/v3/users/f0f9bfb56824402086eb0b3d09bb89f3 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:22.393532 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee8115-be72-44fe-88a1-ae15ad3f9c19 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:22.504244 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee8115-be72-44fe-88a1-ae15ad3f9c19 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:22.542356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a5e54-29b1-4d9b-b078-d2748286585d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:22.543230 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a5e54-29b1-4d9b-b078-d2748286585d None admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:22.543515 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a5e54-29b1-4d9b-b078-d2748286585d None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:22.543792 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a5e54-29b1-4d9b-b078-d2748286585d None admin] PATH_INFO: `/v3/system/users/f0f9bfb56824402086eb0b3d09bb89f3/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:22.545234 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a5e54-29b1-4d9b-b078-d2748286585d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f0f9bfb56824402086eb0b3d09bb89f3, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:22.546670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a5e54-29b1-4d9b-b078-d2748286585d None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:22.569885 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 115/239] 10.222.0.17 () {58 vars in 1334 bytes} [Thu Oct 20 14:28:22 2022] PUT /identity/v3/system/users/f0f9bfb56824402086eb0b3d09bb89f3/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:28:24.080808 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4992539-c928-49e2-8cdc-014a8518f9f7 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:24.081370 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4992539-c928-49e2-8cdc-014a8518f9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:24.081370 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4992539-c928-49e2-8cdc-014a8518f9f7 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:24.082864 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 125/240] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:24.088029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79755e7d-ef37-4090-a9bb-baa4d117f2fb None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:24.088399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79755e7d-ef37-4090-a9bb-baa4d117f2fb None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:24.088592 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79755e7d-ef37-4090-a9bb-baa4d117f2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:24.106703 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-79755e7d-ef37-4090-a9bb-baa4d117f2fb None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:24.107885 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-79755e7d-ef37-4090-a9bb-baa4d117f2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:24.115703 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:24.184647 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 116/241] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:24.448283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8601518-2466-43f5-99a2-c97b419086a8 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:24.448619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8601518-2466-43f5-99a2-c97b419086a8 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:24.448813 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8601518-2466-43f5-99a2-c97b419086a8 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:24.450266 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 126/242] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:24.451710 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79755e7d-ef37-4090-a9bb-baa4d117f2fb None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:24.455696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eec6f6-ab64-4c2e-aec8-7b37a5757266 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:24.455984 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eec6f6-ab64-4c2e-aec8-7b37a5757266 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:24.456259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eec6f6-ab64-4c2e-aec8-7b37a5757266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:24.474444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-72eec6f6-ab64-4c2e-aec8-7b37a5757266 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:24.475622 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-72eec6f6-ab64-4c2e-aec8-7b37a5757266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:24.549135 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 127/243] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:28:24.554260 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79755e7d-ef37-4090-a9bb-baa4d117f2fb None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:24.589299 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e104a-ed8d-41ab-9efa-ceb3999ff163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:24.589962 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e104a-ed8d-41ab-9efa-ceb3999ff163 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:24.590241 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e104a-ed8d-41ab-9efa-ceb3999ff163 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:24.590509 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e104a-ed8d-41ab-9efa-ceb3999ff163 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:24.591585 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e104a-ed8d-41ab-9efa-ceb3999ff163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:24.593049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e104a-ed8d-41ab-9efa-ceb3999ff163 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:24.594774 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 117/244] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:24.600104 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eec6f6-ab64-4c2e-aec8-7b37a5757266 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:24.704840 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eec6f6-ab64-4c2e-aec8-7b37a5757266 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:24.732388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:24.745302 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38374c8-5d85-4168-989b-897178a1fbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:24.745942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38374c8-5d85-4168-989b-897178a1fbaf None admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:24.746220 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38374c8-5d85-4168-989b-897178a1fbaf None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:24.746490 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38374c8-5d85-4168-989b-897178a1fbaf None admin] PATH_INFO: `/v3/groups` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:24.747125 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38374c8-5d85-4168-989b-897178a1fbaf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:24.748563 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38374c8-5d85-4168-989b-897178a1fbaf None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:24.751926 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a781e-541d-47eb-8803-d20bc246e8db None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:24.752206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a781e-541d-47eb-8803-d20bc246e8db None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:24.752478 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a781e-541d-47eb-8803-d20bc246e8db None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:24.753980 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 118/245] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:28:24.759067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb5562-f44c-48a9-8c29-ab43623ffc54 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:24.759381 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb5562-f44c-48a9-8c29-ab43623ffc54 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:24.759609 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb5562-f44c-48a9-8c29-ab43623ffc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:24.764992 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 128/246] 10.222.0.17 () {60 vars in 1134 bytes} [Thu Oct 20 14:28:24 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:28:24.779234 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-ecdb5562-f44c-48a9-8c29-ab43623ffc54 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:24.780467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-ecdb5562-f44c-48a9-8c29-ab43623ffc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:24.784446 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:24.824305 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38374c8-5d85-4168-989b-897178a1fbaf None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:24.860387 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 119/247] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:28:24.938646 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38374c8-5d85-4168-989b-897178a1fbaf None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:24.977025 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ff7dd-7ac6-434b-8b71-496eaa273592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:24.977578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ff7dd-7ac6-434b-8b71-496eaa273592 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:24.977883 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ff7dd-7ac6-434b-8b71-496eaa273592 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:24.978186 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ff7dd-7ac6-434b-8b71-496eaa273592 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:24.988915 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ff7dd-7ac6-434b-8b71-496eaa273592 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:24.994229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-5b6ff7dd-7ac6-434b-8b71-496eaa273592 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 14:28:24.994229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:24.994229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:24.994229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:24.994229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:24.994229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:24.994229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:24.994229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:24.994229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:24.994229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:24.994229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:24.994229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:24.994229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:24.994229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:24.994229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:24.994229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:24.995270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:24.995270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:24.995270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:24.995270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:24.995270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:24.995270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:24.995270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:24.995270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:24.995270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:24.995270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:24.995270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:24.995270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:24.995270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:24.995270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:24.995270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:24.995270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:24.996248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:24.996248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:24.996248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:24.996248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:24.996248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:24.996248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:24.996248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:24.996248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:24.996248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:24.996248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:24.996248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 14:28:24.996248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:25.000172 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 129/248] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:25.001548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb5562-f44c-48a9-8c29-ab43623ffc54 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:25.105758 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb5562-f44c-48a9-8c29-ab43623ffc54 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:25.130601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ff7dd-7ac6-434b-8b71-496eaa273592 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:25.145649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39671a-6ead-418c-9a7e-c2cea1af2235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:25.146311 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39671a-6ead-418c-9a7e-c2cea1af2235 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:25.146596 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39671a-6ead-418c-9a7e-c2cea1af2235 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:25.146870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39671a-6ead-418c-9a7e-c2cea1af2235 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:25.147544 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39671a-6ead-418c-9a7e-c2cea1af2235 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:25.147846 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39671a-6ead-418c-9a7e-c2cea1af2235 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:25.149236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39671a-6ead-418c-9a7e-c2cea1af2235 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:25.158406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 120/249] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Oct 20 14:28:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:25.164368 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39671a-6ead-418c-9a7e-c2cea1af2235 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:25.169408 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:25.191963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:25.270943 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ff7dd-7ac6-434b-8b71-496eaa273592 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:25.304337 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39671a-6ead-418c-9a7e-c2cea1af2235 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:25.319838 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d22118-dcce-4b76-89ef-769d530a3b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:25.321222 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d22118-dcce-4b76-89ef-769d530a3b59 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:25.321673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d22118-dcce-4b76-89ef-769d530a3b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:25.322373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d22118-dcce-4b76-89ef-769d530a3b59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:25.337458 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d22118-dcce-4b76-89ef-769d530a3b59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:25.342532 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33b742-a3e0-4e90-bb83-cd9000a79e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:25.343252 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33b742-a3e0-4e90-bb83-cd9000a79e4c None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:25.343603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33b742-a3e0-4e90-bb83-cd9000a79e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:25.343951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33b742-a3e0-4e90-bb83-cd9000a79e4c None admin] PATH_INFO: `/v3/users/3f3e14fa4f2e4c5f8d3e02561e27b193` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:25.344498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-97d22118-dcce-4b76-89ef-769d530a3b59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:25.344498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:25.344498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:25.344498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:25.344498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:25.344498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:25.344498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:25.344498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:25.344498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:25.344498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:25.344498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:25.344498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:25.344498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:25.344498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:25.344498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:25.344498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:25.345322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:25.345322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:25.345322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:25.345322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:25.345322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:25.345322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:25.345322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:25.345322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:25.345322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:25.345322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:25.345322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:25.345322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:25.345322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:25.345322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:25.345322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:25.345322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:25.346654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:25.346654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:25.346654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:25.346654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:25.346654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:25.346654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:25.346654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:25.346654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:25.346654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:25.346654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:25.346654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:25.346654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:25.347233 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33b742-a3e0-4e90-bb83-cd9000a79e4c None admin] RBAC: Authorizing `identity:get_user(user_id=3f3e14fa4f2e4c5f8d3e02561e27b193)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:25.347233 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33b742-a3e0-4e90-bb83-cd9000a79e4c None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:25.349454 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 130/250] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:25.349613 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 121/251] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:28:25 2022] GET /identity/v3/users/3f3e14fa4f2e4c5f8d3e02561e27b193 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:25.354876 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33b742-a3e0-4e90-bb83-cd9000a79e4c None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:25.355235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d22118-dcce-4b76-89ef-769d530a3b59 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:25.446454 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:25.490082 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33b742-a3e0-4e90-bb83-cd9000a79e4c None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:25.507468 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d22118-dcce-4b76-89ef-769d530a3b59 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:25.509153 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:25.537736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442b164-36b9-4850-b76d-2e53333138ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:25.538362 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442b164-36b9-4850-b76d-2e53333138ab None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:25.538650 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442b164-36b9-4850-b76d-2e53333138ab None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:25.538924 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442b164-36b9-4850-b76d-2e53333138ab None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:25.539605 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442b164-36b9-4850-b76d-2e53333138ab None admin] RBAC: Adding query filter params (name=member) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:25.539904 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442b164-36b9-4850-b76d-2e53333138ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:25.541558 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442b164-36b9-4850-b76d-2e53333138ab None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:25.551504 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 122/252] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Oct 20 14:28:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:25.553692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44f834-f1e3-428b-a9f5-adae1df38102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:25.554411 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44f834-f1e3-428b-a9f5-adae1df38102 None admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:25.554711 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44f834-f1e3-428b-a9f5-adae1df38102 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:25.554988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44f834-f1e3-428b-a9f5-adae1df38102 None admin] PATH_INFO: `/v3/system/users/3f3e14fa4f2e4c5f8d3e02561e27b193/roles/1e6a00ec995a45ba85a12b55a1eacc4c` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:25.557008 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44f834-f1e3-428b-a9f5-adae1df38102 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3f3e14fa4f2e4c5f8d3e02561e27b193, role_id=1e6a00ec995a45ba85a12b55a1eacc4c)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:25.557708 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442b164-36b9-4850-b76d-2e53333138ab None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:25.558618 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44f834-f1e3-428b-a9f5-adae1df38102 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:25.571941 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 131/253] 10.222.0.17 () {58 vars in 1334 bytes} [Thu Oct 20 14:28:25 2022] PUT /identity/v3/system/users/3f3e14fa4f2e4c5f8d3e02561e27b193/roles/1e6a00ec995a45ba85a12b55a1eacc4c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:28:25.689723 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442b164-36b9-4850-b76d-2e53333138ab None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:25.726701 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:25.733138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c82d4-8c76-469c-a15e-0d55cca21492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:25.734237 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c82d4-8c76-469c-a15e-0d55cca21492 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:25.734824 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c82d4-8c76-469c-a15e-0d55cca21492 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:25.735297 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c82d4-8c76-469c-a15e-0d55cca21492 None admin] PATH_INFO: `/v3/users/f0f9bfb56824402086eb0b3d09bb89f3` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:25.736800 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c82d4-8c76-469c-a15e-0d55cca21492 None admin] RBAC: Authorizing `identity:get_user(user_id=f0f9bfb56824402086eb0b3d09bb89f3)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:25.738516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c82d4-8c76-469c-a15e-0d55cca21492 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:25.740424 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 123/254] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:28:25 2022] GET /identity/v3/users/f0f9bfb56824402086eb0b3d09bb89f3 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:25.746995 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44f834-f1e3-428b-a9f5-adae1df38102 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:25.881219 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44f834-f1e3-428b-a9f5-adae1df38102 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:25.924168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae7013-883d-4a3c-a4e4-81770f277cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:25.924868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae7013-883d-4a3c-a4e4-81770f277cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:25.925152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae7013-883d-4a3c-a4e4-81770f277cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:25.925426 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae7013-883d-4a3c-a4e4-81770f277cc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:25.926288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae7013-883d-4a3c-a4e4-81770f277cc1 None admin] RBAC: Adding query filter params (role.id=59cd13c6b53b4329b0af96ce23f01e5e, user.id=f0f9bfb56824402086eb0b3d09bb89f3, scope.system=all) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:25.926597 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae7013-883d-4a3c-a4e4-81770f277cc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:25.928116 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae7013-883d-4a3c-a4e4-81770f277cc1 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:25.945750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 132/255] 10.222.0.17 () {56 vars in 1308 bytes} [Thu Oct 20 14:28:25 2022] GET /identity/v3/role_assignments?user.id=f0f9bfb56824402086eb0b3d09bb89f3&scope.system=all&role.id=59cd13c6b53b4329b0af96ce23f01e5e => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:27.639185 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bfbf6-f7b3-4113-abb6-d0752395e7e7 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:27.640195 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bfbf6-f7b3-4113-abb6-d0752395e7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:27.640716 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bfbf6-f7b3-4113-abb6-d0752395e7e7 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:27.643072 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 124/256] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:27.648901 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b6ff4-7738-4f10-a4ea-03069c98b4b3 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:27.649729 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b6ff4-7738-4f10-a4ea-03069c98b4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:27.650236 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b6ff4-7738-4f10-a4ea-03069c98b4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:27.675738 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-199b6ff4-7738-4f10-a4ea-03069c98b4b3 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:27.677309 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-199b6ff4-7738-4f10-a4ea-03069c98b4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:27.704564 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:27.751925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 133/257] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 20 14:28:27.761595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d237f9-cdfd-44ab-983b-3f92eb81c256 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:27.762204 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d237f9-cdfd-44ab-983b-3f92eb81c256 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:27.762681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d237f9-cdfd-44ab-983b-3f92eb81c256 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:27.764527 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 125/258] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:27.770690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41b354-006f-42fe-b605-5850d5040545 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:27.771235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41b354-006f-42fe-b605-5850d5040545 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:27.771712 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41b354-006f-42fe-b605-5850d5040545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:27.791865 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-2e41b354-006f-42fe-b605-5850d5040545 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:27.793567 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2e41b354-006f-42fe-b605-5850d5040545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:27.806641 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 134/259] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 14:28:28.141158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d237f9-cdfd-44ab-983b-3f92eb81c256 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:28.156112 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d237f9-cdfd-44ab-983b-3f92eb81c256 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:28.162514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b7621-beb4-4f7e-a11c-9d14775e6825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:28.168544 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b7621-beb4-4f7e-a11c-9d14775e6825 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:28.169075 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b7621-beb4-4f7e-a11c-9d14775e6825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:28.169553 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b7621-beb4-4f7e-a11c-9d14775e6825 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:28.190283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b7621-beb4-4f7e-a11c-9d14775e6825 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:28.196189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-ba2b7621-beb4-4f7e-a11c-9d14775e6825 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 14:28:28.196189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:28.196189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:28.196189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:28.196189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:28.196189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:28.196189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:28.196189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:28.196189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:28.196189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:28.196189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:28.196189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:28.196189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:28.196189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:28.196189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:28.196189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:28.197070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:28.197070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:28.197070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:28.197070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:28.197070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:28.197070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:28.197070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:28.197070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:28.197070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:28.197070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:28.197070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:28.197070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:28.197070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:28.197070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:28.197070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:28.197070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:28.197872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:28.197872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:28.197872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:28.197872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:28.197872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:28.197872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:28.197872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:28.197872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:28.197872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:28.197872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:28.197872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 14:28:28.197872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:28.200456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 126/260] 10.222.0.17 () {56 vars in 1135 bytes} [Thu Oct 20 14:28:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:28.207688 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41b354-006f-42fe-b605-5850d5040545 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:28.217291 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41b354-006f-42fe-b605-5850d5040545 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:28.222232 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b0010-c558-4495-86d3-604d37ab75d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:28.223091 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b0010-c558-4495-86d3-604d37ab75d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:28.223570 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b0010-c558-4495-86d3-604d37ab75d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:28.224078 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b0010-c558-4495-86d3-604d37ab75d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:28.224949 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b0010-c558-4495-86d3-604d37ab75d1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:28.225493 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b0010-c558-4495-86d3-604d37ab75d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:28.227528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: WARNING py.warnings [None req-a12b0010-c558-4495-86d3-604d37ab75d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 20 14:28:28.227528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: warnings.warn(msg) Oct 20 14:28:28.227528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: Oct 20 14:28:28.228791 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b0010-c558-4495-86d3-604d37ab75d1 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:28.242665 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 135/261] 10.222.0.17 () {56 vars in 1132 bytes} [Thu Oct 20 14:28:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:28.248514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b7621-beb4-4f7e-a11c-9d14775e6825 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:28.259378 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b7621-beb4-4f7e-a11c-9d14775e6825 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:28.266565 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b2d8a-7d89-4f0f-b19d-b765ef4c5865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:28.268265 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b2d8a-7d89-4f0f-b19d-b765ef4c5865 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:28.268797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b2d8a-7d89-4f0f-b19d-b765ef4c5865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:28.269273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b2d8a-7d89-4f0f-b19d-b765ef4c5865 admin admin] PATH_INFO: `/v3/groups/47dadb317d284753aa8b134e9bae3c9d` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:28.276140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b2d8a-7d89-4f0f-b19d-b765ef4c5865 admin admin] RBAC: Authorizing `identity:get_group(group_id=47dadb317d284753aa8b134e9bae3c9d)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:28.282298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: WARNING py.warnings [None req-4e5b2d8a-7d89-4f0f-b19d-b765ef4c5865 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 14:28:28.282298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: warnings.warn(msg) Oct 20 14:28:28.282298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: Oct 20 14:28:28.283590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b2d8a-7d89-4f0f-b19d-b765ef4c5865 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:28.285624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 127/262] 10.222.0.17 () {56 vars in 1201 bytes} [Thu Oct 20 14:28:28 2022] GET /identity/v3/groups/47dadb317d284753aa8b134e9bae3c9d => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:28.291260 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b0010-c558-4495-86d3-604d37ab75d1 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:28.307530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b0010-c558-4495-86d3-604d37ab75d1 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:28.312255 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ba51b-c08f-426f-9c59-1f573a32fb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:28.313149 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ba51b-c08f-426f-9c59-1f573a32fb83 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:28.313627 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ba51b-c08f-426f-9c59-1f573a32fb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:28.314713 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ba51b-c08f-426f-9c59-1f573a32fb83 admin admin] PATH_INFO: `/v3/projects/81bdccd201354a0081d7dcd17670b72a` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:28.316049 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ba51b-c08f-426f-9c59-1f573a32fb83 admin admin] RBAC: Authorizing `identity:get_project(project_id=81bdccd201354a0081d7dcd17670b72a)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:28.318358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ba51b-c08f-426f-9c59-1f573a32fb83 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:28.320496 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 136/263] 10.222.0.17 () {56 vars in 1207 bytes} [Thu Oct 20 14:28:28 2022] GET /identity/v3/projects/81bdccd201354a0081d7dcd17670b72a => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:28.326362 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b2d8a-7d89-4f0f-b19d-b765ef4c5865 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:28.327704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ba51b-c08f-426f-9c59-1f573a32fb83 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:28.340332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ba51b-c08f-426f-9c59-1f573a32fb83 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:28.344439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b2d8a-7d89-4f0f-b19d-b765ef4c5865 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:28.349051 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d43c4e-d14b-4919-938b-05d7f59cdec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:28.350365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d43c4e-d14b-4919-938b-05d7f59cdec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:28.351668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d43c4e-d14b-4919-938b-05d7f59cdec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:28.352683 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d43c4e-d14b-4919-938b-05d7f59cdec4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:28.356041 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5e692-e4db-434a-ba8d-046e1b5c59e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:28.357709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5e692-e4db-434a-ba8d-046e1b5c59e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:28.359093 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5e692-e4db-434a-ba8d-046e1b5c59e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:28.359582 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5e692-e4db-434a-ba8d-046e1b5c59e3 admin admin] PATH_INFO: `/v3/projects/81bdccd201354a0081d7dcd17670b72a/groups/47dadb317d284753aa8b134e9bae3c9d/roles/e37d07e878834488b4da4408ae42afd2` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:28.364677 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5e692-e4db-434a-ba8d-046e1b5c59e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81bdccd201354a0081d7dcd17670b72a, group_id=47dadb317d284753aa8b134e9bae3c9d, role_id=e37d07e878834488b4da4408ae42afd2)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:28.366347 dv-cinder-779233-7-smb devstack@keystone.service[81802]: WARNING py.warnings [None req-b5d5e692-e4db-434a-ba8d-046e1b5c59e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 14:28:28.366347 dv-cinder-779233-7-smb devstack@keystone.service[81802]: warnings.warn(msg) Oct 20 14:28:28.366347 dv-cinder-779233-7-smb devstack@keystone.service[81802]: Oct 20 14:28:28.369357 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5e692-e4db-434a-ba8d-046e1b5c59e3 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:28.379873 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d43c4e-d14b-4919-938b-05d7f59cdec4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:28.387752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-c1d43c4e-d14b-4919-938b-05d7f59cdec4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:28.387752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:28.387752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:28.387752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:28.387752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:28.387752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:28.387752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:28.387752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:28.387752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:28.387752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:28.387752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:28.387752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:28.387752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:28.387752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:28.387752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:28.387752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:28.388761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:28.388761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:28.388761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:28.388761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:28.388761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:28.388761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:28.388761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:28.388761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:28.388761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:28.388761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:28.388761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:28.388761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:28.388761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:28.388761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:28.388761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:28.388761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:28.389578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:28.389578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:28.389578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:28.389578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:28.389578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:28.389578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:28.389578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:28.389578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:28.389578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:28.389578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:28.389578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:28.389578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:28.392362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 137/264] 10.222.0.17 () {56 vars in 1120 bytes} [Thu Oct 20 14:28:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:28:28.398409 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791fb77-0158-435b-8b4d-b51fabf225d5 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:28.398409 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791fb77-0158-435b-8b4d-b51fabf225d5 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:28.398409 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791fb77-0158-435b-8b4d-b51fabf225d5 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:28.399088 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 138/265] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:28.403498 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 128/266] 10.222.0.17 () {58 vars in 1463 bytes} [Thu Oct 20 14:28:28 2022] PUT /identity/v3/projects/81bdccd201354a0081d7dcd17670b72a/groups/47dadb317d284753aa8b134e9bae3c9d/roles/e37d07e878834488b4da4408ae42afd2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:28:28.406156 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57ff49-cbf9-406a-8295-035f44f2c040 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:28.406681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57ff49-cbf9-406a-8295-035f44f2c040 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:28.407155 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57ff49-cbf9-406a-8295-035f44f2c040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:28.407373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791fb77-0158-435b-8b4d-b51fabf225d5 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:28.438436 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-6f57ff49-cbf9-406a-8295-035f44f2c040 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:28.440815 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-6f57ff49-cbf9-406a-8295-035f44f2c040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:28.524504 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791fb77-0158-435b-8b4d-b51fabf225d5 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:28.534193 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a182e-5bfa-4184-aebf-aa4ab2eb8a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:28.534940 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a182e-5bfa-4184-aebf-aa4ab2eb8a71 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:28.535227 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a182e-5bfa-4184-aebf-aa4ab2eb8a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:28.535546 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a182e-5bfa-4184-aebf-aa4ab2eb8a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:28.536295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a182e-5bfa-4184-aebf-aa4ab2eb8a71 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:28.536601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a182e-5bfa-4184-aebf-aa4ab2eb8a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:28.538623 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a182e-5bfa-4184-aebf-aa4ab2eb8a71 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:28.553524 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 139/267] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Oct 20 14:28:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:28.558887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a182e-5bfa-4184-aebf-aa4ab2eb8a71 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:28.572300 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a182e-5bfa-4184-aebf-aa4ab2eb8a71 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:28.572595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 129/268] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:28.580376 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc7496-4585-43bd-963f-4679ebe8ece7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:28.581166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc7496-4585-43bd-963f-4679ebe8ece7 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:28.581495 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc7496-4585-43bd-963f-4679ebe8ece7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:28.581777 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc7496-4585-43bd-963f-4679ebe8ece7 admin admin] PATH_INFO: `/v3/groups/47dadb317d284753aa8b134e9bae3c9d` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:28.586652 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc7496-4585-43bd-963f-4679ebe8ece7 admin admin] RBAC: Authorizing `identity:get_group(group_id=47dadb317d284753aa8b134e9bae3c9d)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:28.587859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: WARNING py.warnings [None req-bfbc7496-4585-43bd-963f-4679ebe8ece7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 14:28:28.587859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: warnings.warn(msg) Oct 20 14:28:28.587859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: Oct 20 14:28:28.589088 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc7496-4585-43bd-963f-4679ebe8ece7 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:28.591343 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 140/269] 10.222.0.17 () {56 vars in 1201 bytes} [Thu Oct 20 14:28:28 2022] GET /identity/v3/groups/47dadb317d284753aa8b134e9bae3c9d => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:28.596750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57ff49-cbf9-406a-8295-035f44f2c040 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:28.618964 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57ff49-cbf9-406a-8295-035f44f2c040 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:28.635255 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11b5f6-8923-445c-b278-b3c58f6736ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:28.635922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11b5f6-8923-445c-b278-b3c58f6736ee admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:28.636207 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11b5f6-8923-445c-b278-b3c58f6736ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:28.636486 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11b5f6-8923-445c-b278-b3c58f6736ee admin admin] PATH_INFO: `/v3/projects/81bdccd201354a0081d7dcd17670b72a` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:28.637646 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11b5f6-8923-445c-b278-b3c58f6736ee admin admin] RBAC: Authorizing `identity:get_project(project_id=81bdccd201354a0081d7dcd17670b72a)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:28.639814 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11b5f6-8923-445c-b278-b3c58f6736ee admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:28.641655 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 130/270] 10.222.0.17 () {56 vars in 1207 bytes} [Thu Oct 20 14:28:28 2022] GET /identity/v3/projects/81bdccd201354a0081d7dcd17670b72a => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:28.648372 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc7496-4585-43bd-963f-4679ebe8ece7 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:28.663678 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc7496-4585-43bd-963f-4679ebe8ece7 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:28.670834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8311c-044f-451d-b6ee-ffee5168fd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:28.671558 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8311c-044f-451d-b6ee-ffee5168fd25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:28.671837 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8311c-044f-451d-b6ee-ffee5168fd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:28.672115 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8311c-044f-451d-b6ee-ffee5168fd25 admin admin] PATH_INFO: `/v3/projects/81bdccd201354a0081d7dcd17670b72a/groups/47dadb317d284753aa8b134e9bae3c9d/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:28.675911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8311c-044f-451d-b6ee-ffee5168fd25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81bdccd201354a0081d7dcd17670b72a, group_id=47dadb317d284753aa8b134e9bae3c9d, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:28.677023 dv-cinder-779233-7-smb devstack@keystone.service[81801]: WARNING py.warnings [None req-58c8311c-044f-451d-b6ee-ffee5168fd25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 14:28:28.677023 dv-cinder-779233-7-smb devstack@keystone.service[81801]: warnings.warn(msg) Oct 20 14:28:28.677023 dv-cinder-779233-7-smb devstack@keystone.service[81801]: Oct 20 14:28:28.679257 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8311c-044f-451d-b6ee-ffee5168fd25 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:28.702600 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 141/271] 10.222.0.17 () {58 vars in 1463 bytes} [Thu Oct 20 14:28:28 2022] PUT /identity/v3/projects/81bdccd201354a0081d7dcd17670b72a/groups/47dadb317d284753aa8b134e9bae3c9d/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:28:28.752732 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a300e8-2b7b-49d5-932c-86612ca22537 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:28.753185 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a300e8-2b7b-49d5-932c-86612ca22537 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:28.753342 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a300e8-2b7b-49d5-932c-86612ca22537 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:28.755017 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 131/272] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:28.760574 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b348600-d89e-4f9a-911e-b641c836c196 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:28.760920 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b348600-d89e-4f9a-911e-b641c836c196 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:28.761200 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b348600-d89e-4f9a-911e-b641c836c196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:28.789901 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-3b348600-d89e-4f9a-911e-b641c836c196 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:28.791147 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-3b348600-d89e-4f9a-911e-b641c836c196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:28.862033 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 142/273] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 14:28:29.109940 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a300e8-2b7b-49d5-932c-86612ca22537 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:29.154806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b348600-d89e-4f9a-911e-b641c836c196 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:29.170652 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b348600-d89e-4f9a-911e-b641c836c196 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:29.185159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b66ed-fde2-4072-b34c-c332f4ca18eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:29.185938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b66ed-fde2-4072-b34c-c332f4ca18eb admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:29.186221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b66ed-fde2-4072-b34c-c332f4ca18eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:29.186489 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b66ed-fde2-4072-b34c-c332f4ca18eb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:29.199568 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:29.209972 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b66ed-fde2-4072-b34c-c332f4ca18eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:29.218737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-e72b66ed-fde2-4072-b34c-c332f4ca18eb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:29.218737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:29.218737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:29.218737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:29.218737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:29.218737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:29.218737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:29.218737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:29.218737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:29.218737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:29.218737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:29.218737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:29.218737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:29.218737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:29.218737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:29.218737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:29.219630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:29.219630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:29.219630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:29.219630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:29.219630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:29.219630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:29.219630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:29.219630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:29.219630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:29.219630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:29.219630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:29.219630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:29.219630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:29.219630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:29.219630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:29.219630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:29.220507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:29.220507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:29.220507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:29.220507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:29.220507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:29.220507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:29.220507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:29.220507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:29.220507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:29.220507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:29.220507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:29.220507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:29.220507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 143/274] 10.222.0.17 () {56 vars in 1120 bytes} [Thu Oct 20 14:28:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:29.230374 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b66ed-fde2-4072-b34c-c332f4ca18eb admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:29.238397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:29.249249 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b66ed-fde2-4072-b34c-c332f4ca18eb admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:29.250080 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a300e8-2b7b-49d5-932c-86612ca22537 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:29.262954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dc173-c054-4408-9e7f-3acec436bbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:29.263619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dc173-c054-4408-9e7f-3acec436bbe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:29.263949 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dc173-c054-4408-9e7f-3acec436bbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:29.264222 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dc173-c054-4408-9e7f-3acec436bbe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:29.264892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111dc173-c054-4408-9e7f-3acec436bbe9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:29.266779 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111dc173-c054-4408-9e7f-3acec436bbe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:29.271542 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111dc173-c054-4408-9e7f-3acec436bbe9 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:29.289419 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 144/275] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Oct 20 14:28:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:29.297492 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dc173-c054-4408-9e7f-3acec436bbe9 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:29.318638 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dc173-c054-4408-9e7f-3acec436bbe9 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:29.322412 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ae139-51c1-4202-8df7-9d38b398d7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:29.323052 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ae139-51c1-4202-8df7-9d38b398d7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:29.323379 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ae139-51c1-4202-8df7-9d38b398d7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:29.323647 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ae139-51c1-4202-8df7-9d38b398d7d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:29.328369 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638ab9d-d0cc-41f8-b39f-a3d22b682f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:29.329673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638ab9d-d0cc-41f8-b39f-a3d22b682f30 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:29.329984 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638ab9d-d0cc-41f8-b39f-a3d22b682f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:29.331261 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638ab9d-d0cc-41f8-b39f-a3d22b682f30 admin admin] PATH_INFO: `/v3/groups/47dadb317d284753aa8b134e9bae3c9d` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:29.333465 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638ab9d-d0cc-41f8-b39f-a3d22b682f30 admin admin] RBAC: Authorizing `identity:get_group(group_id=47dadb317d284753aa8b134e9bae3c9d)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:29.336245 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638ab9d-d0cc-41f8-b39f-a3d22b682f30 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:29.340012 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 145/276] 10.222.0.17 () {56 vars in 1201 bytes} [Thu Oct 20 14:28:29 2022] GET /identity/v3/groups/47dadb317d284753aa8b134e9bae3c9d => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:29.344068 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ae139-51c1-4202-8df7-9d38b398d7d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:29.346274 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638ab9d-d0cc-41f8-b39f-a3d22b682f30 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:29.357692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-2f7ae139-51c1-4202-8df7-9d38b398d7d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 14:28:29.357692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:29.357692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:29.357692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:29.357692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:29.357692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:29.357692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:29.357692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:29.357692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:29.357692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:29.357692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:29.357692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:29.357692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:29.357692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:29.357692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:29.357692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:29.359881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:29.359881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:29.359881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:29.359881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:29.359881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:29.359881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:29.359881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:29.359881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:29.359881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:29.359881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:29.359881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:29.359881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:29.359881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:29.359881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:29.359881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:29.359881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:29.362572 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:29.362572 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:29.362572 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:29.362572 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:29.362572 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:29.362572 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:29.362572 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:29.362572 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:29.362572 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:29.362572 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:29.362572 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 14:28:29.362572 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:29.362572 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 132/277] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:29.364342 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638ab9d-d0cc-41f8-b39f-a3d22b682f30 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:29.366811 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ae139-51c1-4202-8df7-9d38b398d7d3 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:29.375461 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d36c3-8103-4847-9c28-97464b45bca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:29.376153 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d36c3-8103-4847-9c28-97464b45bca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:29.379849 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d36c3-8103-4847-9c28-97464b45bca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:29.380189 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d36c3-8103-4847-9c28-97464b45bca7 admin admin] PATH_INFO: `/v3/projects/52926432875245df81bfd82b5824c1f0` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:29.381768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d36c3-8103-4847-9c28-97464b45bca7 admin admin] RBAC: Authorizing `identity:get_project(project_id=52926432875245df81bfd82b5824c1f0)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:29.385817 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d36c3-8103-4847-9c28-97464b45bca7 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:29.388961 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 146/278] 10.222.0.17 () {56 vars in 1207 bytes} [Thu Oct 20 14:28:29 2022] GET /identity/v3/projects/52926432875245df81bfd82b5824c1f0 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:29.395759 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d36c3-8103-4847-9c28-97464b45bca7 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:29.411445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d36c3-8103-4847-9c28-97464b45bca7 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:29.421050 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b6924-85a4-46b6-a5d4-d79108a738dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:29.422667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b6924-85a4-46b6-a5d4-d79108a738dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:29.422999 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b6924-85a4-46b6-a5d4-d79108a738dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:29.424561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b6924-85a4-46b6-a5d4-d79108a738dc admin admin] PATH_INFO: `/v3/projects/52926432875245df81bfd82b5824c1f0/groups/47dadb317d284753aa8b134e9bae3c9d/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:29.428816 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b6924-85a4-46b6-a5d4-d79108a738dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=52926432875245df81bfd82b5824c1f0, group_id=47dadb317d284753aa8b134e9bae3c9d, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:29.433302 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b6924-85a4-46b6-a5d4-d79108a738dc admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:29.460167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 147/279] 10.222.0.17 () {58 vars in 1463 bytes} [Thu Oct 20 14:28:29 2022] PUT /identity/v3/projects/52926432875245df81bfd82b5824c1f0/groups/47dadb317d284753aa8b134e9bae3c9d/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:28:29.526471 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ae139-51c1-4202-8df7-9d38b398d7d3 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:29.573591 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c518d-a2ae-41d5-bc7e-912616466cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:29.574240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c518d-a2ae-41d5-bc7e-912616466cab None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:29.574584 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c518d-a2ae-41d5-bc7e-912616466cab None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:29.574861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c518d-a2ae-41d5-bc7e-912616466cab None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:29.575551 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c518d-a2ae-41d5-bc7e-912616466cab None admin] RBAC: Adding query filter params (name=reader) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:29.575903 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c518d-a2ae-41d5-bc7e-912616466cab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:29.577438 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c518d-a2ae-41d5-bc7e-912616466cab None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:29.590252 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 133/280] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Oct 20 14:28:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:29.596018 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b6924-85a4-46b6-a5d4-d79108a738dc admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:29.717933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b6924-85a4-46b6-a5d4-d79108a738dc admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:29.754310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd9f73-309a-4ae4-8a90-a6913a03e3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:29.755027 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd9f73-309a-4ae4-8a90-a6913a03e3ce None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:29.755309 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd9f73-309a-4ae4-8a90-a6913a03e3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:29.755577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd9f73-309a-4ae4-8a90-a6913a03e3ce None admin] PATH_INFO: `/v3/users/3f3e14fa4f2e4c5f8d3e02561e27b193` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:29.756714 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd9f73-309a-4ae4-8a90-a6913a03e3ce None admin] RBAC: Authorizing `identity:get_user(user_id=3f3e14fa4f2e4c5f8d3e02561e27b193)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:29.758209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd9f73-309a-4ae4-8a90-a6913a03e3ce None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:29.759804 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 148/281] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:28:29 2022] GET /identity/v3/users/3f3e14fa4f2e4c5f8d3e02561e27b193 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:29.765810 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c518d-a2ae-41d5-bc7e-912616466cab None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:29.792372 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:29.899137 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c518d-a2ae-41d5-bc7e-912616466cab None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:29.941773 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866bbe0-0256-43d5-bbef-2639c44f6def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:29.942503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866bbe0-0256-43d5-bbef-2639c44f6def None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:29.942784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866bbe0-0256-43d5-bbef-2639c44f6def None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:29.943124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866bbe0-0256-43d5-bbef-2639c44f6def None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:29.943875 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866bbe0-0256-43d5-bbef-2639c44f6def None admin] RBAC: Adding query filter params (role.id=1e6a00ec995a45ba85a12b55a1eacc4c, user.id=3f3e14fa4f2e4c5f8d3e02561e27b193, scope.system=all) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:29.944236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866bbe0-0256-43d5-bbef-2639c44f6def None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:29.945736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866bbe0-0256-43d5-bbef-2639c44f6def None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:29.963750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 134/282] 10.222.0.17 () {56 vars in 1308 bytes} [Thu Oct 20 14:28:29 2022] GET /identity/v3/role_assignments?user.id=3f3e14fa4f2e4c5f8d3e02561e27b193&scope.system=all&role.id=1e6a00ec995a45ba85a12b55a1eacc4c => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:30.193021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba9485-781b-4a5d-995e-653abe4b9f75 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:30.193447 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba9485-781b-4a5d-995e-653abe4b9f75 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:30.194738 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba9485-781b-4a5d-995e-653abe4b9f75 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:30.196951 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 149/283] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:30.207103 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fcef3-6534-4f00-a3ce-e1088e896f75 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:30.207435 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fcef3-6534-4f00-a3ce-e1088e896f75 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:30.207639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fcef3-6534-4f00-a3ce-e1088e896f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:30.233308 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-e60fcef3-6534-4f00-a3ce-e1088e896f75 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:30.234541 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e60fcef3-6534-4f00-a3ce-e1088e896f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:30.288514 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486840b-413e-47d3-89e8-d8509e6e4b91 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:30.288514 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486840b-413e-47d3-89e8-d8509e6e4b91 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:30.288514 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486840b-413e-47d3-89e8-d8509e6e4b91 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:30.289391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 150/284] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:30.297008 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec9da3-9f99-434b-9cb6-ef415ea94e52 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:30.297298 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec9da3-9f99-434b-9cb6-ef415ea94e52 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:30.297583 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec9da3-9f99-434b-9cb6-ef415ea94e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:30.314457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 135/285] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 14:28:30.344399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-efec9da3-9f99-434b-9cb6-ef415ea94e52 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:30.345646 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-efec9da3-9f99-434b-9cb6-ef415ea94e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:30.359429 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 151/286] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 20 14:28:30.637598 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fcef3-6534-4f00-a3ce-e1088e896f75 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:30.648097 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fcef3-6534-4f00-a3ce-e1088e896f75 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:30.653013 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e367c83-a0df-4b5c-a011-53c2a22627ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:30.654698 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e367c83-a0df-4b5c-a011-53c2a22627ac admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:30.655187 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e367c83-a0df-4b5c-a011-53c2a22627ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:30.655721 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e367c83-a0df-4b5c-a011-53c2a22627ac admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:30.667034 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e367c83-a0df-4b5c-a011-53c2a22627ac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:30.675463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-1e367c83-a0df-4b5c-a011-53c2a22627ac admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 14:28:30.675463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:30.675463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:30.675463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:30.675463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:30.675463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:30.675463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:30.675463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:30.675463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:30.675463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:30.675463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:30.675463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:30.675463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:30.675463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:30.675463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:30.675463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:30.677264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:30.677264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:30.677264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:30.677264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:30.677264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:30.677264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:30.677264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:30.677264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:30.677264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:30.677264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:30.677264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:30.677264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:30.677264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:30.677264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:30.677264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:30.677264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:30.678078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:30.678078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:30.678078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:30.678078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:30.678078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:30.678078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:30.678078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:30.678078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:30.678078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:30.678078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:30.678078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 14:28:30.678078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:30.678695 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec9da3-9f99-434b-9cb6-ef415ea94e52 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:30.680893 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 136/287] 10.222.0.17 () {56 vars in 1135 bytes} [Thu Oct 20 14:28:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:30.691226 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec9da3-9f99-434b-9cb6-ef415ea94e52 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:30.694400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e367c83-a0df-4b5c-a011-53c2a22627ac admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:30.702783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb59821-3453-42c2-968a-29d00b705e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:30.703685 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb59821-3453-42c2-968a-29d00b705e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:30.704159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb59821-3453-42c2-968a-29d00b705e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:30.705131 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb59821-3453-42c2-968a-29d00b705e72 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:30.713272 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e367c83-a0df-4b5c-a011-53c2a22627ac admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:30.724430 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23a3cd-ef1e-4c6e-9559-ebb1dbbda7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:30.725036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23a3cd-ef1e-4c6e-9559-ebb1dbbda7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:30.725311 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23a3cd-ef1e-4c6e-9559-ebb1dbbda7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:30.725581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23a3cd-ef1e-4c6e-9559-ebb1dbbda7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:30.726279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23a3cd-ef1e-4c6e-9559-ebb1dbbda7c5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:30.726580 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23a3cd-ef1e-4c6e-9559-ebb1dbbda7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:30.727585 dv-cinder-779233-7-smb devstack@keystone.service[81802]: WARNING py.warnings [None req-bb23a3cd-ef1e-4c6e-9559-ebb1dbbda7c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 20 14:28:30.727585 dv-cinder-779233-7-smb devstack@keystone.service[81802]: warnings.warn(msg) Oct 20 14:28:30.727585 dv-cinder-779233-7-smb devstack@keystone.service[81802]: Oct 20 14:28:30.728496 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23a3cd-ef1e-4c6e-9559-ebb1dbbda7c5 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:30.731485 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb59821-3453-42c2-968a-29d00b705e72 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:30.731956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:30.737239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-5bb59821-3453-42c2-968a-29d00b705e72 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:28:30.737239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:30.737239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:30.737239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:30.737239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:30.737239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:30.737239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:30.737239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:30.737239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:30.737239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:30.737239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:30.737239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:30.737239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:30.737239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:30.737239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:30.737239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:30.738242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:30.738242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:30.738242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:30.738242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:30.738242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:30.738242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:30.738242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:30.738242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:30.738242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:30.738242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:30.738242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:30.738242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:30.738242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:30.738242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:30.738242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:30.738242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:30.739486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:30.739486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:30.739486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:30.739486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:30.739486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:30.739486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:30.739486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:30.739486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:30.739486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:30.739486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:30.739486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:28:30.739486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:30.739486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 152/288] 10.222.0.17 () {56 vars in 1117 bytes} [Thu Oct 20 14:28:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:30.744557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb59821-3453-42c2-968a-29d00b705e72 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:30.744884 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 137/289] 10.222.0.17 () {56 vars in 1132 bytes} [Thu Oct 20 14:28:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:30.750205 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23a3cd-ef1e-4c6e-9559-ebb1dbbda7c5 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:30.766041 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23a3cd-ef1e-4c6e-9559-ebb1dbbda7c5 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:30.769595 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb59821-3453-42c2-968a-29d00b705e72 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:30.776620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e956b23-8b8d-44ec-bb9f-db375ab0ad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:30.777251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e956b23-8b8d-44ec-bb9f-db375ab0ad50 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:30.777535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e956b23-8b8d-44ec-bb9f-db375ab0ad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:30.777809 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e956b23-8b8d-44ec-bb9f-db375ab0ad50 admin admin] PATH_INFO: `/v3/groups/47dadb317d284753aa8b134e9bae3c9d` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:30.778889 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476faac-56e2-4def-a7a2-2ac27dc37dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:30.779487 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476faac-56e2-4def-a7a2-2ac27dc37dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:30.779748 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476faac-56e2-4def-a7a2-2ac27dc37dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:30.779992 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476faac-56e2-4def-a7a2-2ac27dc37dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:30.780658 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476faac-56e2-4def-a7a2-2ac27dc37dd8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:30.780958 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476faac-56e2-4def-a7a2-2ac27dc37dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:30.783198 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476faac-56e2-4def-a7a2-2ac27dc37dd8 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:30.785304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e956b23-8b8d-44ec-bb9f-db375ab0ad50 admin admin] RBAC: Authorizing `identity:get_group(group_id=47dadb317d284753aa8b134e9bae3c9d)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:30.787233 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e956b23-8b8d-44ec-bb9f-db375ab0ad50 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:30.789149 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 138/290] 10.222.0.17 () {56 vars in 1201 bytes} [Thu Oct 20 14:28:30 2022] GET /identity/v3/groups/47dadb317d284753aa8b134e9bae3c9d => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:30.794120 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e956b23-8b8d-44ec-bb9f-db375ab0ad50 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:30.803352 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 153/291] 10.222.0.17 () {56 vars in 1120 bytes} [Thu Oct 20 14:28:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:30.809418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476faac-56e2-4def-a7a2-2ac27dc37dd8 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:30.810636 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e956b23-8b8d-44ec-bb9f-db375ab0ad50 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:30.822094 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb230b-ab8b-48c3-b1ee-21afae786935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:30.822737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb230b-ab8b-48c3-b1ee-21afae786935 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:30.823038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb230b-ab8b-48c3-b1ee-21afae786935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:30.823350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb230b-ab8b-48c3-b1ee-21afae786935 admin admin] PATH_INFO: `/v3/projects/52926432875245df81bfd82b5824c1f0` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:30.825379 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb230b-ab8b-48c3-b1ee-21afae786935 admin admin] RBAC: Authorizing `identity:get_project(project_id=52926432875245df81bfd82b5824c1f0)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:30.827896 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476faac-56e2-4def-a7a2-2ac27dc37dd8 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:30.829250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb230b-ab8b-48c3-b1ee-21afae786935 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:30.836305 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 139/292] 10.222.0.17 () {56 vars in 1207 bytes} [Thu Oct 20 14:28:30 2022] GET /identity/v3/projects/52926432875245df81bfd82b5824c1f0 => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:30.839288 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb230b-ab8b-48c3-b1ee-21afae786935 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:30.840251 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd5f15-062b-4394-adfd-a919797e2959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:30.841280 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd5f15-062b-4394-adfd-a919797e2959 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:30.842945 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd5f15-062b-4394-adfd-a919797e2959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:30.843244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd5f15-062b-4394-adfd-a919797e2959 admin admin] PATH_INFO: `/v3/groups/c0636541284d409f9d7a3a4c738e5abc` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:30.854329 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:30.856979 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb230b-ab8b-48c3-b1ee-21afae786935 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:30.858182 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd5f15-062b-4394-adfd-a919797e2959 admin admin] RBAC: Authorizing `identity:get_group(group_id=c0636541284d409f9d7a3a4c738e5abc)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:30.861185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd5f15-062b-4394-adfd-a919797e2959 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:30.864559 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 154/293] 10.222.0.17 () {56 vars in 1201 bytes} [Thu Oct 20 14:28:30 2022] GET /identity/v3/groups/c0636541284d409f9d7a3a4c738e5abc => generated 229 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:30.867145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fce3b2-01d9-4c0a-826d-3db11cdfb501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:30.867905 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fce3b2-01d9-4c0a-826d-3db11cdfb501 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:30.868974 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd5f15-062b-4394-adfd-a919797e2959 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:30.869155 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fce3b2-01d9-4c0a-826d-3db11cdfb501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:30.869423 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fce3b2-01d9-4c0a-826d-3db11cdfb501 admin admin] PATH_INFO: `/v3/projects/52926432875245df81bfd82b5824c1f0/groups/47dadb317d284753aa8b134e9bae3c9d/roles/e37d07e878834488b4da4408ae42afd2` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:30.876654 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fce3b2-01d9-4c0a-826d-3db11cdfb501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52926432875245df81bfd82b5824c1f0, group_id=47dadb317d284753aa8b134e9bae3c9d, role_id=e37d07e878834488b4da4408ae42afd2)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:30.879619 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fce3b2-01d9-4c0a-826d-3db11cdfb501 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:30.886474 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd5f15-062b-4394-adfd-a919797e2959 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:30.893510 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972eb2ca-af30-4869-9398-d2f680ba14d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:30.894189 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eb2ca-af30-4869-9398-d2f680ba14d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:30.894505 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eb2ca-af30-4869-9398-d2f680ba14d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:30.894800 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eb2ca-af30-4869-9398-d2f680ba14d3 admin admin] PATH_INFO: `/v3/projects/e7ff2453910940f2bc733ed16c90677b` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:30.900684 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972eb2ca-af30-4869-9398-d2f680ba14d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=e7ff2453910940f2bc733ed16c90677b)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:30.903207 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 140/294] 10.222.0.17 () {58 vars in 1463 bytes} [Thu Oct 20 14:28:30 2022] PUT /identity/v3/projects/52926432875245df81bfd82b5824c1f0/groups/47dadb317d284753aa8b134e9bae3c9d/roles/e37d07e878834488b4da4408ae42afd2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:28:30.905242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972eb2ca-af30-4869-9398-d2f680ba14d3 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:30.907163 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 155/295] 10.222.0.17 () {56 vars in 1207 bytes} [Thu Oct 20 14:28:30 2022] GET /identity/v3/projects/e7ff2453910940f2bc733ed16c90677b => generated 344 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:30.913456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fce3b2-01d9-4c0a-826d-3db11cdfb501 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:30.983105 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fce3b2-01d9-4c0a-826d-3db11cdfb501 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:30.991431 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2e66c-a7bf-4fb7-a6bf-703a14912feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:30.992114 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2e66c-a7bf-4fb7-a6bf-703a14912feb admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:30.992449 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2e66c-a7bf-4fb7-a6bf-703a14912feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:30.992753 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2e66c-a7bf-4fb7-a6bf-703a14912feb admin admin] PATH_INFO: `/v3/projects/e7ff2453910940f2bc733ed16c90677b/groups/c0636541284d409f9d7a3a4c738e5abc/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:30.996136 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2e66c-a7bf-4fb7-a6bf-703a14912feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ff2453910940f2bc733ed16c90677b, group_id=c0636541284d409f9d7a3a4c738e5abc, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:30.998985 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2e66c-a7bf-4fb7-a6bf-703a14912feb admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:31.023331 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 141/296] 10.222.0.17 () {58 vars in 1463 bytes} [Thu Oct 20 14:28:30 2022] PUT /identity/v3/projects/e7ff2453910940f2bc733ed16c90677b/groups/c0636541284d409f9d7a3a4c738e5abc/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:28:31.570480 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef1f2e-060d-499e-a844-1e069e41499b None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:31.570884 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef1f2e-060d-499e-a844-1e069e41499b None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:31.571052 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef1f2e-060d-499e-a844-1e069e41499b None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:31.572648 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 156/297] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:31.587589 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a9ace-279b-4f70-a4fb-eca61715c201 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:31.587907 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a9ace-279b-4f70-a4fb-eca61715c201 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:31.588145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a9ace-279b-4f70-a4fb-eca61715c201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:31.613936 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-e06a9ace-279b-4f70-a4fb-eca61715c201 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:31.615154 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e06a9ace-279b-4f70-a4fb-eca61715c201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:31.695003 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 142/298] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:32.239277 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef1f2e-060d-499e-a844-1e069e41499b None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:32.367488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef1f2e-060d-499e-a844-1e069e41499b None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:32.406786 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178991c-258d-43a1-bafd-d0f8f6c2ff58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:32.407970 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178991c-258d-43a1-bafd-d0f8f6c2ff58 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:32.408460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178991c-258d-43a1-bafd-d0f8f6c2ff58 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:32.408739 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178991c-258d-43a1-bafd-d0f8f6c2ff58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:32.422974 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178991c-258d-43a1-bafd-d0f8f6c2ff58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:32.428009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-1178991c-258d-43a1-bafd-d0f8f6c2ff58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 14:28:32.428009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:32.428009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:32.428009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:32.428009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:32.428009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:32.428009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:32.428009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:32.428009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:32.428009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:32.428009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:32.428009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:32.428009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:32.428009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:32.428009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:32.428009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:32.430110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:32.430110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:32.430110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:32.430110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:32.430110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:32.430110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:32.430110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:32.430110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:32.430110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:32.430110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:32.430110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:32.430110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:32.430110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:32.430110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:32.430110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:32.430110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:32.432527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:32.432527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:32.432527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:32.432527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:32.432527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:32.432527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:32.432527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:32.432527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:32.432527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:32.432527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:32.432527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 14:28:32.432527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:32.432527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 157/299] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Oct 20 14:28:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:32.437867 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a9ace-279b-4f70-a4fb-eca61715c201 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:32.447667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c02a9-c8db-4885-a36e-86278d7e6e39 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:32.447667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c02a9-c8db-4885-a36e-86278d7e6e39 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:32.447667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c02a9-c8db-4885-a36e-86278d7e6e39 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:32.448466 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 158/300] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:28:32.453961 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed032f-f069-4746-a130-c8e188d6338b None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:32.455042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed032f-f069-4746-a130-c8e188d6338b None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:32.455694 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed032f-f069-4746-a130-c8e188d6338b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:32.474715 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-64ed032f-f069-4746-a130-c8e188d6338b None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:32.476263 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-64ed032f-f069-4746-a130-c8e188d6338b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:32.535795 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:32.557312 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:32.592168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 159/301] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:28:32.616168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a9ace-279b-4f70-a4fb-eca61715c201 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:32.657809 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b97b0d-4a58-4447-8274-b32ad5a9af24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:32.658746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b97b0d-4a58-4447-8274-b32ad5a9af24 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:32.659038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b97b0d-4a58-4447-8274-b32ad5a9af24 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:32.659315 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b97b0d-4a58-4447-8274-b32ad5a9af24 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:32.659988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b97b0d-4a58-4447-8274-b32ad5a9af24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:32.660290 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b97b0d-4a58-4447-8274-b32ad5a9af24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:32.661669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b97b0d-4a58-4447-8274-b32ad5a9af24 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:32.670381 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 143/302] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:28:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:32.675769 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed032f-f069-4746-a130-c8e188d6338b None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:32.820180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed032f-f069-4746-a130-c8e188d6338b None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:32.855146 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116557-7193-40a0-becf-8b787b2f3d48 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:32.855146 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116557-7193-40a0-becf-8b787b2f3d48 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:32.855420 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116557-7193-40a0-becf-8b787b2f3d48 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:32.856870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 144/303] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:32.863649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d3c9f-0415-48c6-bd8e-a8c5a77a45bc None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:32.864166 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d3c9f-0415-48c6-bd8e-a8c5a77a45bc None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:32.864467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d3c9f-0415-48c6-bd8e-a8c5a77a45bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:32.871714 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2f1bd-e4e9-45ce-be0e-6c8452169cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:32.872571 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2f1bd-e4e9-45ce-be0e-6c8452169cef None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:32.873047 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2f1bd-e4e9-45ce-be0e-6c8452169cef None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:32.873514 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2f1bd-e4e9-45ce-be0e-6c8452169cef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:32.893127 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-e17d3c9f-0415-48c6-bd8e-a8c5a77a45bc None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:32.894762 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e17d3c9f-0415-48c6-bd8e-a8c5a77a45bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:32.985231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:33.009946 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 145/304] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:33.027939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2f1bd-e4e9-45ce-be0e-6c8452169cef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:33.029425 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2f1bd-e4e9-45ce-be0e-6c8452169cef None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:33.049149 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d3c9f-0415-48c6-bd8e-a8c5a77a45bc None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:33.112855 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:33.189564 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 160/305] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:28:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 14:28:33.191495 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d3c9f-0415-48c6-bd8e-a8c5a77a45bc None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:33.195582 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2f1bd-e4e9-45ce-be0e-6c8452169cef None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:33.245193 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b23b90-4632-4bc9-960c-49a78186b758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:33.245823 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b23b90-4632-4bc9-960c-49a78186b758 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:33.246123 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b23b90-4632-4bc9-960c-49a78186b758 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:33.246391 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b23b90-4632-4bc9-960c-49a78186b758 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:33.266723 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b23b90-4632-4bc9-960c-49a78186b758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:33.278174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-c6b23b90-4632-4bc9-960c-49a78186b758 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:33.278174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:33.278174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:33.278174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:33.278174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:33.278174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:33.278174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:33.278174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:33.278174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:33.278174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:33.278174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:33.278174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:33.278174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:33.278174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:33.278174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:33.278174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:33.279038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:33.279038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:33.279038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:33.279038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:33.279038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:33.279038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:33.279038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:33.279038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:33.279038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:33.279038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:33.279038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:33.279038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:33.279038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:33.279038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:33.279038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:33.279038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:33.279847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:33.279847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:33.279847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:33.279847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:33.279847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:33.279847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:33.279847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:33.279847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:33.279847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:33.279847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:33.279847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:33.279847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:33.281242 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 146/306] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:33.288292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b23b90-4632-4bc9-960c-49a78186b758 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:33.359127 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:33.383306 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2f1bd-e4e9-45ce-be0e-6c8452169cef None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:33.434158 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de453b17-6d81-43da-b60a-d9a7c5a579dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:33.434829 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de453b17-6d81-43da-b60a-d9a7c5a579dd None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:33.435109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de453b17-6d81-43da-b60a-d9a7c5a579dd None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:33.435379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de453b17-6d81-43da-b60a-d9a7c5a579dd None admin] PATH_INFO: `/v3/projects/81bdccd201354a0081d7dcd17670b72a` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:33.436936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de453b17-6d81-43da-b60a-d9a7c5a579dd None admin] RBAC: Authorizing `identity:get_project(project_id=81bdccd201354a0081d7dcd17670b72a)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:33.439679 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de453b17-6d81-43da-b60a-d9a7c5a579dd None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:33.445886 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 161/307] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:28:33 2022] GET /identity/v3/projects/81bdccd201354a0081d7dcd17670b72a => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:33.445886 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de453b17-6d81-43da-b60a-d9a7c5a579dd None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:33.448744 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:33.455722 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b23b90-4632-4bc9-960c-49a78186b758 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:33.502943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07285398-720b-4023-b83c-6b40345d53c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:33.504294 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07285398-720b-4023-b83c-6b40345d53c1 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:33.505050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07285398-720b-4023-b83c-6b40345d53c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:33.505520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07285398-720b-4023-b83c-6b40345d53c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:33.506519 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07285398-720b-4023-b83c-6b40345d53c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:33.507015 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07285398-720b-4023-b83c-6b40345d53c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:33.508661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07285398-720b-4023-b83c-6b40345d53c1 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:33.522285 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 147/308] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Oct 20 14:28:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:33.527225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07285398-720b-4023-b83c-6b40345d53c1 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:33.591724 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de453b17-6d81-43da-b60a-d9a7c5a579dd None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:33.630314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b48ca-f023-4d7b-b5bf-bf2dd0fb055c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:33.630954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b48ca-f023-4d7b-b5bf-bf2dd0fb055c None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:33.631236 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b48ca-f023-4d7b-b5bf-bf2dd0fb055c None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:33.631508 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b48ca-f023-4d7b-b5bf-bf2dd0fb055c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:33.644282 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b48ca-f023-4d7b-b5bf-bf2dd0fb055c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:33.650400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07285398-720b-4023-b83c-6b40345d53c1 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:33.650523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-3e5b48ca-f023-4d7b-b5bf-bf2dd0fb055c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:33.650523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:33.650523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:33.650523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:33.650523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:33.650523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:33.650523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:33.650523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:33.650523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:33.650523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:33.650523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:33.650523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:33.650523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:33.650523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:33.650523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:33.650523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:33.651393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:33.651393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:33.651393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:33.651393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:33.651393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:33.651393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:33.651393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:33.651393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:33.651393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:33.651393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:33.651393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:33.651393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:33.651393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:33.651393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:33.651393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:33.651393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:33.652168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:33.652168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:33.652168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:33.652168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:33.652168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:33.652168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:33.652168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:33.652168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:33.652168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:33.652168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:33.652168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 14:28:33.652168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:33.652168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 162/309] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:33.652168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b48ca-f023-4d7b-b5bf-bf2dd0fb055c None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:33.670942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:33.698812 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474a722-dec6-4f21-b5dc-054b3aae4b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:33.700528 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474a722-dec6-4f21-b5dc-054b3aae4b0b None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:33.700528 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474a722-dec6-4f21-b5dc-054b3aae4b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:33.700528 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474a722-dec6-4f21-b5dc-054b3aae4b0b None admin] PATH_INFO: `/v3/groups/47dadb317d284753aa8b134e9bae3c9d` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:33.702429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474a722-dec6-4f21-b5dc-054b3aae4b0b None admin] RBAC: Authorizing `identity:get_group(group_id=47dadb317d284753aa8b134e9bae3c9d)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:33.703885 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474a722-dec6-4f21-b5dc-054b3aae4b0b None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:33.706106 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 148/310] 10.222.0.17 () {56 vars in 1180 bytes} [Thu Oct 20 14:28:33 2022] GET /identity/v3/groups/47dadb317d284753aa8b134e9bae3c9d => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:33.707271 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dd5fd-fe35-4ba0-8670-30230fd4aa1d None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:33.707550 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dd5fd-fe35-4ba0-8670-30230fd4aa1d None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:33.707821 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dd5fd-fe35-4ba0-8670-30230fd4aa1d None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:33.709332 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 149/311] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:33.710535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4dd5fd-fe35-4ba0-8670-30230fd4aa1d None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:33.747222 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:33.779126 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b48ca-f023-4d7b-b5bf-bf2dd0fb055c None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:33.830948 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0346d-b6c6-4524-bff2-66bbd1dd15ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:33.831566 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0346d-b6c6-4524-bff2-66bbd1dd15ea None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:33.832185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0346d-b6c6-4524-bff2-66bbd1dd15ea None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:33.832185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0346d-b6c6-4524-bff2-66bbd1dd15ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:33.836585 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4dd5fd-fe35-4ba0-8670-30230fd4aa1d None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:33.879253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd052c3-5574-4828-82b8-9f769001ca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:33.879885 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd052c3-5574-4828-82b8-9f769001ca9c None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:33.880165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd052c3-5574-4828-82b8-9f769001ca9c None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:33.880437 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd052c3-5574-4828-82b8-9f769001ca9c None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:33.881123 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd052c3-5574-4828-82b8-9f769001ca9c None admin] RBAC: Adding query filter params (name=member) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:33.881433 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd052c3-5574-4828-82b8-9f769001ca9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:33.882951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd052c3-5574-4828-82b8-9f769001ca9c None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:33.894586 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 150/312] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Oct 20 14:28:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:33.895340 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd052c3-5574-4828-82b8-9f769001ca9c None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:33.920233 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0346d-b6c6-4524-bff2-66bbd1dd15ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:33.921825 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0346d-b6c6-4524-bff2-66bbd1dd15ea None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:33.941554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:34.019018 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:34.031260 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd052c3-5574-4828-82b8-9f769001ca9c None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:34.043402 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 163/313] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:28:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 14:28:34.044804 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ce49e-eed2-48d7-be71-4bc2b11365fa None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:34.045080 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ce49e-eed2-48d7-be71-4bc2b11365fa None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:34.045351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ce49e-eed2-48d7-be71-4bc2b11365fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:34.064922 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-c13ce49e-eed2-48d7-be71-4bc2b11365fa None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:34.066461 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-c13ce49e-eed2-48d7-be71-4bc2b11365fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:34.074463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ee770-717d-4842-8f2b-13a2eb0e70b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:34.075069 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ee770-717d-4842-8f2b-13a2eb0e70b3 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:34.075341 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ee770-717d-4842-8f2b-13a2eb0e70b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:34.075605 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ee770-717d-4842-8f2b-13a2eb0e70b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:34.076319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ee770-717d-4842-8f2b-13a2eb0e70b3 None admin] RBAC: Adding query filter params (group.id=47dadb317d284753aa8b134e9bae3c9d, role.id=e37d07e878834488b4da4408ae42afd2, scope.project.id=81bdccd201354a0081d7dcd17670b72a) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:34.076618 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ee770-717d-4842-8f2b-13a2eb0e70b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:34.078880 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ee770-717d-4842-8f2b-13a2eb0e70b3 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:34.088352 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 151/314] 10.222.0.17 () {56 vars in 1376 bytes} [Thu Oct 20 14:28:33 2022] GET /identity/v3/role_assignments?group.id=47dadb317d284753aa8b134e9bae3c9d&scope.project.id=81bdccd201354a0081d7dcd17670b72a&role.id=e37d07e878834488b4da4408ae42afd2 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:34.089167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ee770-717d-4842-8f2b-13a2eb0e70b3 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:34.160115 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 164/315] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:34.161765 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cdef6-9887-4d26-bdd2-d046d7168af9 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:34.162952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cdef6-9887-4d26-bdd2-d046d7168af9 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:34.163436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cdef6-9887-4d26-bdd2-d046d7168af9 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:34.165902 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 165/316] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:34.167388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cdef6-9887-4d26-bdd2-d046d7168af9 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:34.241040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ee770-717d-4842-8f2b-13a2eb0e70b3 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:34.245230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:34.291118 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e94d01-3a00-4ab3-b050-141120551d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:34.291731 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e94d01-3a00-4ab3-b050-141120551d39 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:34.292006 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e94d01-3a00-4ab3-b050-141120551d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:34.292270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e94d01-3a00-4ab3-b050-141120551d39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:34.327245 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:34.332421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cdef6-9887-4d26-bdd2-d046d7168af9 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:34.374372 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4acfc6-98a4-42ca-ac6c-f90fe9caae99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:34.375042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4acfc6-98a4-42ca-ac6c-f90fe9caae99 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:34.375272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4acfc6-98a4-42ca-ac6c-f90fe9caae99 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:34.375542 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4acfc6-98a4-42ca-ac6c-f90fe9caae99 None admin] PATH_INFO: `/v3/projects/81bdccd201354a0081d7dcd17670b72a` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:34.377081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4acfc6-98a4-42ca-ac6c-f90fe9caae99 None admin] RBAC: Authorizing `identity:get_project(project_id=81bdccd201354a0081d7dcd17670b72a)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:34.378570 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4acfc6-98a4-42ca-ac6c-f90fe9caae99 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:34.380187 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 166/317] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:28:34 2022] GET /identity/v3/projects/81bdccd201354a0081d7dcd17670b72a => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:34.381307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02263f00-547b-4404-ac63-4b9ca418d588 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:34.381584 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02263f00-547b-4404-ac63-4b9ca418d588 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:34.381891 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02263f00-547b-4404-ac63-4b9ca418d588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:34.385779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e94d01-3a00-4ab3-b050-141120551d39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:34.387676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e94d01-3a00-4ab3-b050-141120551d39 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:34.404780 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-02263f00-547b-4404-ac63-4b9ca418d588 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:34.406003 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-02263f00-547b-4404-ac63-4b9ca418d588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:34.493698 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 167/318] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:34.494509 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02263f00-547b-4404-ac63-4b9ca418d588 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:34.518174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 152/319] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:28:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 14:28:34.519092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e94d01-3a00-4ab3-b050-141120551d39 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:34.544444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:34.600175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:34.613245 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02263f00-547b-4404-ac63-4b9ca418d588 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:34.653909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4205a-07da-4c67-969a-7e201a7dfdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:34.654550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4205a-07da-4c67-969a-7e201a7dfdf2 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:34.654828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4205a-07da-4c67-969a-7e201a7dfdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:34.655104 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4205a-07da-4c67-969a-7e201a7dfdf2 None admin] PATH_INFO: `/v3/groups/47dadb317d284753aa8b134e9bae3c9d` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:34.656213 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4205a-07da-4c67-969a-7e201a7dfdf2 None admin] RBAC: Authorizing `identity:get_group(group_id=47dadb317d284753aa8b134e9bae3c9d)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:34.657734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4205a-07da-4c67-969a-7e201a7dfdf2 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:34.658518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e94d01-3a00-4ab3-b050-141120551d39 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:34.659511 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 168/320] 10.222.0.17 () {56 vars in 1180 bytes} [Thu Oct 20 14:28:34 2022] GET /identity/v3/groups/47dadb317d284753aa8b134e9bae3c9d => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:34.660117 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4205a-07da-4c67-969a-7e201a7dfdf2 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:34.699913 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245067fd-36f7-4de8-9f50-419c1eb8c1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:34.700542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245067fd-36f7-4de8-9f50-419c1eb8c1bc None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:34.701245 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245067fd-36f7-4de8-9f50-419c1eb8c1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:34.701526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245067fd-36f7-4de8-9f50-419c1eb8c1bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:34.715477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245067fd-36f7-4de8-9f50-419c1eb8c1bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:34.721249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-245067fd-36f7-4de8-9f50-419c1eb8c1bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 14:28:34.721249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:34.721249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:34.721249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:34.721249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:34.721249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:34.721249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:34.721249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:34.721249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:34.721249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:34.721249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:34.721249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:34.721249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:34.721249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:34.721249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:34.721249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:34.722400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:34.722400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:34.722400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:34.722400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:34.722400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:34.722400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:34.722400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:34.722400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:34.722400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:34.722400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:34.722400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:34.722400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:34.722400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:34.722400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:34.722400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:34.722400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:34.723314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:34.723314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:34.723314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:34.723314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:34.723314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:34.723314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:34.723314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:34.723314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:34.723314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:34.723314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:34.723314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 14:28:34.723314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:34.723314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 153/321] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Oct 20 14:28:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:34.723314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245067fd-36f7-4de8-9f50-419c1eb8c1bc None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:34.781525 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4205a-07da-4c67-969a-7e201a7dfdf2 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:34.792638 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:34.819826 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403c208-8e01-43b1-aca7-6ee790921c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:34.820757 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403c208-8e01-43b1-aca7-6ee790921c05 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:34.821029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403c208-8e01-43b1-aca7-6ee790921c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:34.821307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403c208-8e01-43b1-aca7-6ee790921c05 None admin] PATH_INFO: `/v3/projects/52926432875245df81bfd82b5824c1f0` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:34.822443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403c208-8e01-43b1-aca7-6ee790921c05 None admin] RBAC: Authorizing `identity:get_project(project_id=52926432875245df81bfd82b5824c1f0)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:34.823910 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403c208-8e01-43b1-aca7-6ee790921c05 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:34.825537 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 169/322] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:28:34 2022] GET /identity/v3/projects/52926432875245df81bfd82b5824c1f0 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:34.826414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403c208-8e01-43b1-aca7-6ee790921c05 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:34.845372 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245067fd-36f7-4de8-9f50-419c1eb8c1bc None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:34.867199 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:34.885011 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecffaf-f60a-45f5-998e-f7e655e51ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:34.885605 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecffaf-f60a-45f5-998e-f7e655e51ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:34.885908 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecffaf-f60a-45f5-998e-f7e655e51ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:34.886178 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecffaf-f60a-45f5-998e-f7e655e51ee5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:34.886898 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ecffaf-f60a-45f5-998e-f7e655e51ee5 None admin] RBAC: Adding query filter params (group.id=47dadb317d284753aa8b134e9bae3c9d, role.id=59cd13c6b53b4329b0af96ce23f01e5e, scope.project.id=81bdccd201354a0081d7dcd17670b72a) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:34.887199 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ecffaf-f60a-45f5-998e-f7e655e51ee5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:34.888623 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ecffaf-f60a-45f5-998e-f7e655e51ee5 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:34.894912 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 154/323] 10.222.0.17 () {56 vars in 1376 bytes} [Thu Oct 20 14:28:34 2022] GET /identity/v3/role_assignments?group.id=47dadb317d284753aa8b134e9bae3c9d&scope.project.id=81bdccd201354a0081d7dcd17670b72a&role.id=59cd13c6b53b4329b0af96ce23f01e5e => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:34.895681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecffaf-f60a-45f5-998e-f7e655e51ee5 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:34.933885 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403c208-8e01-43b1-aca7-6ee790921c05 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:34.972680 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71be80c-ca4b-4010-93a5-928772159ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:34.973322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71be80c-ca4b-4010-93a5-928772159ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:34.973630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71be80c-ca4b-4010-93a5-928772159ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:34.973899 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71be80c-ca4b-4010-93a5-928772159ec8 None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:34.974592 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71be80c-ca4b-4010-93a5-928772159ec8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:34.974898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71be80c-ca4b-4010-93a5-928772159ec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:34.976347 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71be80c-ca4b-4010-93a5-928772159ec8 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:34.985882 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 170/324] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:28:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:34.986785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71be80c-ca4b-4010-93a5-928772159ec8 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:35.017873 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecffaf-f60a-45f5-998e-f7e655e51ee5 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:35.034899 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:35.062423 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69feec8d-a3ba-4d13-935f-4b5661ac6230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:35.063161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feec8d-a3ba-4d13-935f-4b5661ac6230 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:35.063971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feec8d-a3ba-4d13-935f-4b5661ac6230 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:35.064244 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feec8d-a3ba-4d13-935f-4b5661ac6230 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:35.076970 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69feec8d-a3ba-4d13-935f-4b5661ac6230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:35.081972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-69feec8d-a3ba-4d13-935f-4b5661ac6230 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:28:35.081972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:35.081972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:35.081972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:35.081972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:35.081972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:35.081972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:35.081972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:35.081972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:35.081972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:35.081972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:35.081972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:35.081972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:35.081972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:35.081972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:35.081972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:35.082834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:35.082834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:35.082834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:35.082834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:35.082834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:35.082834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:35.082834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:35.082834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:35.082834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:35.082834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:35.082834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:35.082834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:35.082834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:35.082834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:35.082834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:35.082834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:35.083600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:35.083600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:35.083600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:35.083600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:35.083600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:35.083600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:35.083600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:35.083600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:35.083600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:35.083600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:35.083600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:28:35.083600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:35.083600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 155/325] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:28:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:35.084223 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69feec8d-a3ba-4d13-935f-4b5661ac6230 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:35.108365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71be80c-ca4b-4010-93a5-928772159ec8 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:35.132304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:35.154848 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af358224-8819-4fb5-8b1a-797cc8f2c26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:35.155494 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af358224-8819-4fb5-8b1a-797cc8f2c26d None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:35.155773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af358224-8819-4fb5-8b1a-797cc8f2c26d None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:35.156043 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af358224-8819-4fb5-8b1a-797cc8f2c26d None admin] PATH_INFO: `/v3/groups/47dadb317d284753aa8b134e9bae3c9d` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:35.158328 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af358224-8819-4fb5-8b1a-797cc8f2c26d None admin] RBAC: Authorizing `identity:get_group(group_id=47dadb317d284753aa8b134e9bae3c9d)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:35.160126 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af358224-8819-4fb5-8b1a-797cc8f2c26d None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:35.161409 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 171/326] 10.222.0.17 () {56 vars in 1180 bytes} [Thu Oct 20 14:28:34 2022] GET /identity/v3/groups/47dadb317d284753aa8b134e9bae3c9d => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:35.162533 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af358224-8819-4fb5-8b1a-797cc8f2c26d None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:35.215998 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69feec8d-a3ba-4d13-935f-4b5661ac6230 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:35.256078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5604cd-ef9c-411c-bc77-93d5816a1805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:35.256930 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5604cd-ef9c-411c-bc77-93d5816a1805 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:35.257204 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5604cd-ef9c-411c-bc77-93d5816a1805 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:35.257467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5604cd-ef9c-411c-bc77-93d5816a1805 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:35.284490 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af358224-8819-4fb5-8b1a-797cc8f2c26d None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:35.293620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:35.323356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd21370-82fd-4821-a339-5b84ee236bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:35.323974 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd21370-82fd-4821-a339-5b84ee236bdf None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:35.324255 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd21370-82fd-4821-a339-5b84ee236bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:35.324526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd21370-82fd-4821-a339-5b84ee236bdf None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:35.325200 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd21370-82fd-4821-a339-5b84ee236bdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:35.325504 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd21370-82fd-4821-a339-5b84ee236bdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:35.326948 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd21370-82fd-4821-a339-5b84ee236bdf None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:35.337027 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 172/327] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:35.338155 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd21370-82fd-4821-a339-5b84ee236bdf None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:35.338280 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5604cd-ef9c-411c-bc77-93d5816a1805 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:35.339836 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5604cd-ef9c-411c-bc77-93d5816a1805 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:35.387099 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:35.456079 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd21370-82fd-4821-a339-5b84ee236bdf None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:35.459468 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 156/328] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:28:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 14:28:35.460315 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5604cd-ef9c-411c-bc77-93d5816a1805 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:35.489542 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413eca5-4cbe-455d-a001-2a81253f2128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:35.490190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413eca5-4cbe-455d-a001-2a81253f2128 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:35.490472 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413eca5-4cbe-455d-a001-2a81253f2128 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:35.490747 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413eca5-4cbe-455d-a001-2a81253f2128 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:35.491463 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413eca5-4cbe-455d-a001-2a81253f2128 None admin] RBAC: Adding query filter params (group.id=47dadb317d284753aa8b134e9bae3c9d, role.id=59cd13c6b53b4329b0af96ce23f01e5e, scope.project.id=52926432875245df81bfd82b5824c1f0) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:35.491769 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413eca5-4cbe-455d-a001-2a81253f2128 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:35.493309 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413eca5-4cbe-455d-a001-2a81253f2128 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:35.498986 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 173/329] 10.222.0.17 () {56 vars in 1376 bytes} [Thu Oct 20 14:28:35 2022] GET /identity/v3/role_assignments?group.id=47dadb317d284753aa8b134e9bae3c9d&scope.project.id=52926432875245df81bfd82b5824c1f0&role.id=59cd13c6b53b4329b0af96ce23f01e5e => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:35.499766 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413eca5-4cbe-455d-a001-2a81253f2128 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:35.538770 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:35.570951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5604cd-ef9c-411c-bc77-93d5816a1805 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:35.611402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3dab0-2efc-452f-b940-481a116f48bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:35.612035 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3dab0-2efc-452f-b940-481a116f48bb None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:35.612320 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3dab0-2efc-452f-b940-481a116f48bb None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:35.612593 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3dab0-2efc-452f-b940-481a116f48bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:35.617586 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413eca5-4cbe-455d-a001-2a81253f2128 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:35.625759 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:35.654760 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0f989-7dad-4e5f-a746-b30454db251e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:35.655408 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0f989-7dad-4e5f-a746-b30454db251e None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:35.655695 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0f989-7dad-4e5f-a746-b30454db251e None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:35.655971 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0f989-7dad-4e5f-a746-b30454db251e None admin] PATH_INFO: `/v3/projects/52926432875245df81bfd82b5824c1f0` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:35.657676 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0f989-7dad-4e5f-a746-b30454db251e None admin] RBAC: Authorizing `identity:get_project(project_id=52926432875245df81bfd82b5824c1f0)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:35.659196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0f989-7dad-4e5f-a746-b30454db251e None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:35.660887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 174/330] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:28:35 2022] GET /identity/v3/projects/52926432875245df81bfd82b5824c1f0 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:35.666492 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0f989-7dad-4e5f-a746-b30454db251e None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:35.699663 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3dab0-2efc-452f-b940-481a116f48bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:35.701125 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3dab0-2efc-452f-b940-481a116f48bb None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:35.779831 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0f989-7dad-4e5f-a746-b30454db251e None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:35.782775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:35.818914 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 157/331] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:28:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 14:28:35.823352 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58044dd5-6700-4f66-824f-69396299a888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:35.823956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58044dd5-6700-4f66-824f-69396299a888 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:35.824125 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3dab0-2efc-452f-b940-481a116f48bb None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:35.824276 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58044dd5-6700-4f66-824f-69396299a888 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:35.824512 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58044dd5-6700-4f66-824f-69396299a888 None admin] PATH_INFO: `/v3/groups/47dadb317d284753aa8b134e9bae3c9d` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:35.825741 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58044dd5-6700-4f66-824f-69396299a888 None admin] RBAC: Authorizing `identity:get_group(group_id=47dadb317d284753aa8b134e9bae3c9d)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:35.827420 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58044dd5-6700-4f66-824f-69396299a888 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:35.829211 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 175/332] 10.222.0.17 () {56 vars in 1180 bytes} [Thu Oct 20 14:28:35 2022] GET /identity/v3/groups/47dadb317d284753aa8b134e9bae3c9d => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:35.835407 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58044dd5-6700-4f66-824f-69396299a888 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:35.881978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:35.940637 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3dab0-2efc-452f-b940-481a116f48bb None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:35.944280 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58044dd5-6700-4f66-824f-69396299a888 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:35.973534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc752e98-6903-415d-92c7-df2d0ec52139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:35.974184 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc752e98-6903-415d-92c7-df2d0ec52139 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:35.974462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc752e98-6903-415d-92c7-df2d0ec52139 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:35.974731 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc752e98-6903-415d-92c7-df2d0ec52139 None admin] PATH_INFO: `/v3/projects/e7ff2453910940f2bc733ed16c90677b` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:35.975818 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc752e98-6903-415d-92c7-df2d0ec52139 None admin] RBAC: Authorizing `identity:get_project(project_id=e7ff2453910940f2bc733ed16c90677b)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:35.976072 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f5cf4-5349-4db6-ab6d-dccc115d3eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:35.976667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f5cf4-5349-4db6-ab6d-dccc115d3eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:35.976943 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f5cf4-5349-4db6-ab6d-dccc115d3eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:35.977211 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f5cf4-5349-4db6-ab6d-dccc115d3eb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:35.977300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc752e98-6903-415d-92c7-df2d0ec52139 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:35.977957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f5cf4-5349-4db6-ab6d-dccc115d3eb1 None admin] RBAC: Adding query filter params (group.id=47dadb317d284753aa8b134e9bae3c9d, role.id=e37d07e878834488b4da4408ae42afd2, scope.project.id=52926432875245df81bfd82b5824c1f0) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:35.978262 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f5cf4-5349-4db6-ab6d-dccc115d3eb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:35.978869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 158/333] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:28:35 2022] GET /identity/v3/projects/e7ff2453910940f2bc733ed16c90677b => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:35.979765 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f5cf4-5349-4db6-ab6d-dccc115d3eb1 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:35.984218 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc752e98-6903-415d-92c7-df2d0ec52139 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:35.986269 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 176/334] 10.222.0.17 () {56 vars in 1376 bytes} [Thu Oct 20 14:28:35 2022] GET /identity/v3/role_assignments?group.id=47dadb317d284753aa8b134e9bae3c9d&scope.project.id=52926432875245df81bfd82b5824c1f0&role.id=e37d07e878834488b4da4408ae42afd2 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:36.087239 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc752e98-6903-415d-92c7-df2d0ec52139 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:36.097173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:36.122532 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21814cb1-19e9-4350-91cf-eb65d465aaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:36.123165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21814cb1-19e9-4350-91cf-eb65d465aaea None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:36.123441 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21814cb1-19e9-4350-91cf-eb65d465aaea None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:36.123706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21814cb1-19e9-4350-91cf-eb65d465aaea None admin] PATH_INFO: `/v3/groups/c0636541284d409f9d7a3a4c738e5abc` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:36.124811 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21814cb1-19e9-4350-91cf-eb65d465aaea None admin] RBAC: Authorizing `identity:get_group(group_id=c0636541284d409f9d7a3a4c738e5abc)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:36.126873 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21814cb1-19e9-4350-91cf-eb65d465aaea None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:36.128682 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 159/335] 10.222.0.17 () {56 vars in 1180 bytes} [Thu Oct 20 14:28:35 2022] GET /identity/v3/groups/c0636541284d409f9d7a3a4c738e5abc => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:36.134512 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f5cf4-5349-4db6-ab6d-dccc115d3eb1 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:36.171068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:36.240912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f5cf4-5349-4db6-ab6d-dccc115d3eb1 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:36.275659 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa2b9d-1097-425f-9388-18c6c33f8e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:36.276262 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa2b9d-1097-425f-9388-18c6c33f8e38 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:36.276537 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa2b9d-1097-425f-9388-18c6c33f8e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:36.276809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa2b9d-1097-425f-9388-18c6c33f8e38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:36.277530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa2b9d-1097-425f-9388-18c6c33f8e38 None admin] RBAC: Adding query filter params (group.id=c0636541284d409f9d7a3a4c738e5abc, role.id=fe3ee5741c6143adb5459b5de54450c8, scope.project.id=e7ff2453910940f2bc733ed16c90677b) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:36.277831 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa2b9d-1097-425f-9388-18c6c33f8e38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:36.279288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa2b9d-1097-425f-9388-18c6c33f8e38 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:36.285340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 177/336] 10.222.0.17 () {56 vars in 1376 bytes} [Thu Oct 20 14:28:36 2022] GET /identity/v3/role_assignments?group.id=c0636541284d409f9d7a3a4c738e5abc&scope.project.id=e7ff2453910940f2bc733ed16c90677b&role.id=fe3ee5741c6143adb5459b5de54450c8 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:38.994882 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611afc7d-15dd-4b5e-9cc2-8edcc44c02da None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:38.995970 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611afc7d-15dd-4b5e-9cc2-8edcc44c02da None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:38.996455 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611afc7d-15dd-4b5e-9cc2-8edcc44c02da None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:38.998507 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 160/337] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:39.004042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b9693-daff-4f38-bea3-f3f0d8e0a08f None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:39.004986 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b9693-daff-4f38-bea3-f3f0d8e0a08f None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:39.005549 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b9693-daff-4f38-bea3-f3f0d8e0a08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:39.024928 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-665b9693-daff-4f38-bea3-f3f0d8e0a08f None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:39.030551 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-665b9693-daff-4f38-bea3-f3f0d8e0a08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:39.124111 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 178/338] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:39.196693 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd64d7-4702-45b7-863f-25ede3d4f3c5 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:39.197340 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd64d7-4702-45b7-863f-25ede3d4f3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:39.197814 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd64d7-4702-45b7-863f-25ede3d4f3c5 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:39.199439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 161/339] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:39.205885 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffb1cb-8692-44f3-ae4d-667c7f00df6e None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:39.206522 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffb1cb-8692-44f3-ae4d-667c7f00df6e None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:39.206990 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffb1cb-8692-44f3-ae4d-667c7f00df6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:39.227942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-34ffb1cb-8692-44f3-ae4d-667c7f00df6e None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:39.229430 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-34ffb1cb-8692-44f3-ae4d-667c7f00df6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:39.259342 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:39.302249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983c102-6db7-4526-a127-f2029ff43d59 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:39.302913 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983c102-6db7-4526-a127-f2029ff43d59 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:39.303398 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983c102-6db7-4526-a127-f2029ff43d59 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:39.305186 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 162/340] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:28:39.318703 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e9feb-c284-4d0d-911c-a3d9e58f3136 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:39.319287 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e9feb-c284-4d0d-911c-a3d9e58f3136 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:39.319510 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 179/341] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:39.319981 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e9feb-c284-4d0d-911c-a3d9e58f3136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:39.358851 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-cb2e9feb-c284-4d0d-911c-a3d9e58f3136 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:39.360080 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-cb2e9feb-c284-4d0d-911c-a3d9e58f3136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:39.437369 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffb1cb-8692-44f3-ae4d-667c7f00df6e None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:39.449055 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 163/342] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:39.600067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffb1cb-8692-44f3-ae4d-667c7f00df6e None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:39.607329 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e9feb-c284-4d0d-911c-a3d9e58f3136 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:39.644373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f411281-1c59-48b9-b7aa-d53754cd780c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:39.648404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f411281-1c59-48b9-b7aa-d53754cd780c None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:39.648903 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f411281-1c59-48b9-b7aa-d53754cd780c None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:39.649350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f411281-1c59-48b9-b7aa-d53754cd780c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:39.669158 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f411281-1c59-48b9-b7aa-d53754cd780c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:39.672966 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f411281-1c59-48b9-b7aa-d53754cd780c None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:39.706334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-2f411281-1c59-48b9-b7aa-d53754cd780c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:39.706334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:39.706334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:39.706334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:39.706334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:39.706334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:39.706334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:39.706334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:39.706334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:39.706334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:39.706334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:39.706334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:39.706334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:39.706334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:39.706334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:39.706334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:39.707350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:39.707350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:39.707350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:39.707350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:39.707350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:39.707350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:39.707350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:39.707350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:39.707350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:39.707350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:39.707350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:39.707350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:39.707350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:39.707350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:39.707350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:39.707350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:39.707350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:39.708208 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:39.708208 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:39.708208 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:39.708208 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 180/343] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:28:39.714441 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f411281-1c59-48b9-b7aa-d53754cd780c None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:39.738831 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:39.771862 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e9feb-c284-4d0d-911c-a3d9e58f3136 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:39.779842 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:39.813191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67680d-9139-4015-9c9b-7489e8fe3314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:39.814225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67680d-9139-4015-9c9b-7489e8fe3314 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:39.814690 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67680d-9139-4015-9c9b-7489e8fe3314 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:39.815135 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67680d-9139-4015-9c9b-7489e8fe3314 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:39.825964 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67680d-9139-4015-9c9b-7489e8fe3314 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:39.827959 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67680d-9139-4015-9c9b-7489e8fe3314 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:39.846000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-ac67680d-9139-4015-9c9b-7489e8fe3314 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:39.846000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:39.846000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:39.846000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:39.846000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:39.846000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:39.846000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:39.846000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:39.846000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:39.846000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:39.846000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:39.846000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:39.846000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:39.846000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:39.846000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:39.846000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:39.846925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:39.846925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:39.846925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:39.846925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:39.846925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:39.846925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:39.846925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:39.846925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:39.846925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:39.846925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:39.846925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:39.846925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:39.846925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:39.846925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:39.846925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:39.846925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:39.846925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:39.847762 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:39.847762 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:39.847762 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:39.847762 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 164/344] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:28:39.848138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67680d-9139-4015-9c9b-7489e8fe3314 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:39.855697 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f411281-1c59-48b9-b7aa-d53754cd780c None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:39.894941 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1edda-2c83-44db-a529-ab66c12e3e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:39.896015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1edda-2c83-44db-a529-ab66c12e3e46 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:39.896599 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1edda-2c83-44db-a529-ab66c12e3e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:39.897074 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1edda-2c83-44db-a529-ab66c12e3e46 None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:39.897962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1edda-2c83-44db-a529-ab66c12e3e46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:39.898478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1edda-2c83-44db-a529-ab66c12e3e46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:39.900205 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1edda-2c83-44db-a529-ab66c12e3e46 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:39.919116 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 181/345] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:39.920580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69585637-0d1f-4678-88b8-9bdd366d6d0e None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:39.921098 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69585637-0d1f-4678-88b8-9bdd366d6d0e None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:39.921552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69585637-0d1f-4678-88b8-9bdd366d6d0e None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:39.923441 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 182/346] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:39.928081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69585637-0d1f-4678-88b8-9bdd366d6d0e None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:39.958091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67680d-9139-4015-9c9b-7489e8fe3314 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:39.994158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b14f0-f173-47a8-8192-8cbb1791eb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:39.994789 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b14f0-f173-47a8-8192-8cbb1791eb16 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:39.995087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b14f0-f173-47a8-8192-8cbb1791eb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:39.995634 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b14f0-f173-47a8-8192-8cbb1791eb16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:40.003742 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:40.007753 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b14f0-f173-47a8-8192-8cbb1791eb16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:40.009632 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b14f0-f173-47a8-8192-8cbb1791eb16 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:40.025518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-527b14f0-f173-47a8-8192-8cbb1791eb16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:40.025518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:40.025518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:40.025518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:40.025518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:40.025518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:40.025518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:40.025518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:40.025518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:40.025518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:40.025518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:40.025518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:40.025518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:40.025518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:40.025518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:40.025518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:40.026501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:40.026501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:40.026501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:40.026501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:40.026501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:40.026501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:40.026501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:40.026501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:40.026501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:40.026501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:40.026501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:40.026501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:40.026501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:40.026501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:40.026501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:40.026501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:40.026501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:40.033258 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:40.033258 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:40.033258 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:40.033258 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 165/347] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:40.033258 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b14f0-f173-47a8-8192-8cbb1791eb16 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:40.041823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69585637-0d1f-4678-88b8-9bdd366d6d0e None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:40.043720 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:40.082552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c029aa-163c-4e78-9bb3-4097ae0563e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:40.083232 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c029aa-163c-4e78-9bb3-4097ae0563e7 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:40.083521 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c029aa-163c-4e78-9bb3-4097ae0563e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:40.083794 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c029aa-163c-4e78-9bb3-4097ae0563e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:40.084441 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c029aa-163c-4e78-9bb3-4097ae0563e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:40.084754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c029aa-163c-4e78-9bb3-4097ae0563e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:40.086168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c029aa-163c-4e78-9bb3-4097ae0563e7 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:40.098321 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 183/348] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:40.099701 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a730d3b-70f1-4a5b-9186-d0d9521d3448 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:40.099995 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a730d3b-70f1-4a5b-9186-d0d9521d3448 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:40.100273 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a730d3b-70f1-4a5b-9186-d0d9521d3448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:40.118108 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-8a730d3b-70f1-4a5b-9186-d0d9521d3448 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:40.119221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-8a730d3b-70f1-4a5b-9186-d0d9521d3448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:40.145168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b14f0-f173-47a8-8192-8cbb1791eb16 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:40.186578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 184/349] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:40.187494 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a730d3b-70f1-4a5b-9186-d0d9521d3448 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:40.194770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167166b-2173-4751-9580-cb0b7f56a784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:40.195664 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167166b-2173-4751-9580-cb0b7f56a784 None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:40.196168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167166b-2173-4751-9580-cb0b7f56a784 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:40.197209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167166b-2173-4751-9580-cb0b7f56a784 None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:40.198091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167166b-2173-4751-9580-cb0b7f56a784 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:40.200577 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167166b-2173-4751-9580-cb0b7f56a784 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:40.229343 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 166/350] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Oct 20 14:28:40 2022] POST /identity/v3/users => generated 246 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:28:40.229343 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167166b-2173-4751-9580-cb0b7f56a784 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:40.278354 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:40.372056 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a730d3b-70f1-4a5b-9186-d0d9521d3448 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:40.382232 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:40.446023 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167166b-2173-4751-9580-cb0b7f56a784 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:40.454360 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b8979-3f86-41bc-9eae-7bcfb78b479e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:40.455316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b8979-3f86-41bc-9eae-7bcfb78b479e None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:40.455813 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b8979-3f86-41bc-9eae-7bcfb78b479e None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:40.456286 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b8979-3f86-41bc-9eae-7bcfb78b479e None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:40.457180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b8979-3f86-41bc-9eae-7bcfb78b479e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:40.457680 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b8979-3f86-41bc-9eae-7bcfb78b479e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:40.459530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b8979-3f86-41bc-9eae-7bcfb78b479e None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:40.476706 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 185/351] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:40.482496 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b8979-3f86-41bc-9eae-7bcfb78b479e None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:40.484639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e6e5b-9ff5-4871-b3f2-4e9a356f3fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:40.485285 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e6e5b-9ff5-4871-b3f2-4e9a356f3fa7 None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:40.485561 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e6e5b-9ff5-4871-b3f2-4e9a356f3fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:40.485830 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e6e5b-9ff5-4871-b3f2-4e9a356f3fa7 None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:40.486490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e6e5b-9ff5-4871-b3f2-4e9a356f3fa7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:40.488110 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e6e5b-9ff5-4871-b3f2-4e9a356f3fa7 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:40.515087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 167/352] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Oct 20 14:28:40 2022] POST /identity/v3/users => generated 248 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:28:40.516964 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e6e5b-9ff5-4871-b3f2-4e9a356f3fa7 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:40.620767 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b8979-3f86-41bc-9eae-7bcfb78b479e None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:40.642652 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e6e5b-9ff5-4871-b3f2-4e9a356f3fa7 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:40.647991 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:40.665185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf860a-7a2c-4acb-997f-5c512fd7f020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:40.666253 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf860a-7a2c-4acb-997f-5c512fd7f020 None admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:40.666706 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf860a-7a2c-4acb-997f-5c512fd7f020 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:40.667177 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf860a-7a2c-4acb-997f-5c512fd7f020 None admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:40.668020 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf860a-7a2c-4acb-997f-5c512fd7f020 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:40.669681 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf860a-7a2c-4acb-997f-5c512fd7f020 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:40.670236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:40.694983 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67722ff9-0940-44d3-ad1d-b5631cdd0bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:40.695703 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67722ff9-0940-44d3-ad1d-b5631cdd0bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:40.696317 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67722ff9-0940-44d3-ad1d-b5631cdd0bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:40.696590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67722ff9-0940-44d3-ad1d-b5631cdd0bb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:40.706744 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 186/353] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Oct 20 14:28:40 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:28:40.708626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10daa2e-bf9d-46c7-9fb6-1daa5ac7eff6 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:40.708908 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10daa2e-bf9d-46c7-9fb6-1daa5ac7eff6 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:40.709181 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10daa2e-bf9d-46c7-9fb6-1daa5ac7eff6 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:40.711206 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 187/354] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:40.711547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67722ff9-0940-44d3-ad1d-b5631cdd0bb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:40.713262 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67722ff9-0940-44d3-ad1d-b5631cdd0bb8 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:40.717686 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa232b-50ab-41a9-bfc3-81e0794e158a None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:40.718026 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa232b-50ab-41a9-bfc3-81e0794e158a None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:40.718303 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa232b-50ab-41a9-bfc3-81e0794e158a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:40.731067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-67722ff9-0940-44d3-ad1d-b5631cdd0bb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:40.731067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:40.731067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:40.731067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:40.731067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:40.731067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:40.731067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:40.731067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:40.731067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:40.731067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:40.731067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:40.731067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:40.731067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:40.731067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:40.731067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:40.731067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:40.732033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:40.732033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:40.732033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:40.732033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:40.732033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:40.732033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:40.732033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:40.732033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:40.732033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:40.732033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:40.732033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:40.732033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:40.732033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:40.732033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:40.732033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:40.732033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:40.732033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:40.732870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:40.732870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:40.732870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:40.732870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 168/355] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:40.739073 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-bfaa232b-50ab-41a9-bfc3-81e0794e158a None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:40.739864 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67722ff9-0940-44d3-ad1d-b5631cdd0bb8 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:40.740276 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-bfaa232b-50ab-41a9-bfc3-81e0794e158a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:40.842147 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 188/356] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:28:40.889980 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67722ff9-0940-44d3-ad1d-b5631cdd0bb8 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:40.927361 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b505a67-2359-413e-aed9-3cf90678fcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:40.928292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b505a67-2359-413e-aed9-3cf90678fcaa None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:40.928749 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b505a67-2359-413e-aed9-3cf90678fcaa None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:40.929213 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b505a67-2359-413e-aed9-3cf90678fcaa None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:40.930367 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b505a67-2359-413e-aed9-3cf90678fcaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:40.930853 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b505a67-2359-413e-aed9-3cf90678fcaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:40.932442 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b505a67-2359-413e-aed9-3cf90678fcaa None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:40.945578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 169/357] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:40.951375 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa232b-50ab-41a9-bfc3-81e0794e158a None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:41.058439 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa232b-50ab-41a9-bfc3-81e0794e158a None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:41.068904 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:41.099621 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87116b-492f-4588-9eb0-cf4bd481eecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:41.100542 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87116b-492f-4588-9eb0-cf4bd481eecc None admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:41.101012 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87116b-492f-4588-9eb0-cf4bd481eecc None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:41.101486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87116b-492f-4588-9eb0-cf4bd481eecc None admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:41.102364 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87116b-492f-4588-9eb0-cf4bd481eecc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:41.103995 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87116b-492f-4588-9eb0-cf4bd481eecc None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:41.128287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 189/358] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Oct 20 14:28:40 2022] POST /identity/v3/users => generated 249 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:28:41.165389 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b505a67-2359-413e-aed9-3cf90678fcaa None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:41.216429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:41.295527 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b505a67-2359-413e-aed9-3cf90678fcaa None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:41.333434 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232061e-a52b-4b37-b8e1-54994562a453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:41.334081 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232061e-a52b-4b37-b8e1-54994562a453 None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:41.334367 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232061e-a52b-4b37-b8e1-54994562a453 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:41.334639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232061e-a52b-4b37-b8e1-54994562a453 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:41.335319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232061e-a52b-4b37-b8e1-54994562a453 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:41.336693 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232061e-a52b-4b37-b8e1-54994562a453 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:41.346256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.sql.core [None req-7232061e-a52b-4b37-b8e1-54994562a453 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 20 14:28:41.346256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 20 14:28:41.346256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [parameters: {'id': 'e7b8ec3e157a401c97467826068206d7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 20 14:28:41.346256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81802) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 20 14:28:41.353194 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-7232061e-a52b-4b37-b8e1-54994562a453 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 20 14:28:41.353194 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:41.353194 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 14:28:41.353194 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 14:28:41.353194 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 14:28:41.353194 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 14:28:41.353194 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 14:28:41.353194 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 14:28:41.353194 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 14:28:41.353194 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application conn.query(q) Oct 20 14:28:41.353194 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 14:28:41.353194 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 14:28:41.353194 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 14:28:41.353194 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application result.read() Oct 20 14:28:41.353194 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 14:28:41.354067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 14:28:41.354067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 14:28:41.354067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 14:28:41.354067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 14:28:41.354067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 14:28:41.354067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 14:28:41.354067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 14:28:41.354067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 20 14:28:41.354067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:41.354067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 20 14:28:41.354067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:41.354067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:41.354067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 20 14:28:41.354067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 20 14:28:41.354067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 20 14:28:41.354067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return ref.to_dict() Oct 20 14:28:41.354067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 14:28:41.354067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application next(self.gen) Oct 20 14:28:41.354978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 20 14:28:41.354978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application yield resource Oct 20 14:28:41.354978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 14:28:41.354978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application next(self.gen) Oct 20 14:28:41.354978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 20 14:28:41.354978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self.session.rollback() Oct 20 14:28:41.354978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 20 14:28:41.354978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self.force_reraise() Oct 20 14:28:41.354978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 20 14:28:41.354978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise self.value Oct 20 14:28:41.354978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 20 14:28:41.354978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 20 14:28:41.354978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 20 14:28:41.354978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application session.commit() Oct 20 14:28:41.354978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 20 14:28:41.354978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 20 14:28:41.354978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 20 14:28:41.355779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._prepare_impl() Oct 20 14:28:41.355779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 20 14:28:41.355779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self.session.flush() Oct 20 14:28:41.355779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 20 14:28:41.355779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._flush(objects) Oct 20 14:28:41.355779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 20 14:28:41.355779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 20 14:28:41.355779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 20 14:28:41.355779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application compat.raise_( Oct 20 14:28:41.355779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 14:28:41.355779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception Oct 20 14:28:41.355779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 20 14:28:41.355779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application flush_context.execute() Oct 20 14:28:41.355779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 20 14:28:41.355779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rec.execute(self) Oct 20 14:28:41.355779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 20 14:28:41.355779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 20 14:28:41.356625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 20 14:28:41.356625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 20 14:28:41.356625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 20 14:28:41.356625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 20 14:28:41.356625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 20 14:28:41.356625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 20 14:28:41.356625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 20 14:28:41.356625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 20 14:28:41.356625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 20 14:28:41.356625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 20 14:28:41.356625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 20 14:28:41.356625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 20 14:28:41.356625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 20 14:28:41.356625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 20 14:28:41.356625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 14:28:41.356625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception Oct 20 14:28:41.357411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 14:28:41.357411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 14:28:41.357411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 14:28:41.357411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 14:28:41.357411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 14:28:41.357411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 14:28:41.357411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 14:28:41.357411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application conn.query(q) Oct 20 14:28:41.357411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 14:28:41.357411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 14:28:41.357411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 14:28:41.357411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application result.read() Oct 20 14:28:41.357411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 14:28:41.357411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 14:28:41.357411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 14:28:41.357411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 14:28:41.358279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 14:28:41.358279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 14:28:41.358279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 14:28:41.358279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 14:28:41.358279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 20 14:28:41.358279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 20 14:28:41.358279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [parameters: {'id': 'e7b8ec3e157a401c97467826068206d7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 20 14:28:41.358279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 20 14:28:41.358279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:41.358279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:28:41.358279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:41.358279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:41.358279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:41.358279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:41.358279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:41.358279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:41.359036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:41.359036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:41.359036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:41.359036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:41.359036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:41.359036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:41.359036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 20 14:28:41.359036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 20 14:28:41.359036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:41.359036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:41.359036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 20 14:28:41.359036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 20 14:28:41.359036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 20 14:28:41.359036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 20 14:28:41.359036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 20 14:28:41.359036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:41.359884 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 170/359] 10.222.0.17 () {60 vars in 1131 bytes} [Thu Oct 20 14:28:41 2022] POST /identity/v3/roles => generated 144 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:41.367005 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87116b-492f-4588-9eb0-cf4bd481eecc None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:41.482435 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87116b-492f-4588-9eb0-cf4bd481eecc None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:41.520026 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971aae7-4ddf-4c0a-907e-c7615753baad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:41.520892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971aae7-4ddf-4c0a-907e-c7615753baad None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:41.521308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971aae7-4ddf-4c0a-907e-c7615753baad None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:41.521714 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971aae7-4ddf-4c0a-907e-c7615753baad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:41.532581 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971aae7-4ddf-4c0a-907e-c7615753baad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:41.538096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-4971aae7-4ddf-4c0a-907e-c7615753baad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 14:28:41.538096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:41.538096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:41.538096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:41.538096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:41.538096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:41.538096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:41.538096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:41.538096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:41.538096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:41.538096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:41.538096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:41.538096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:41.538096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:41.538096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:41.538096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:41.539199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:41.539199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:41.539199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:41.539199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:41.539199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:41.539199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:41.539199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:41.539199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:41.539199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:41.539199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:41.539199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:41.539199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:41.539199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:41.539199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:41.539199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:41.539199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:41.540190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:41.540190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:41.540190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:41.540190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:41.540190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:41.540190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:41.540190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:41.540190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:41.540190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:41.540190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:41.540190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 14:28:41.540190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:41.542436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 190/360] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Oct 20 14:28:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:41.549259 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232061e-a52b-4b37-b8e1-54994562a453 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:41.667060 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:41.670666 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232061e-a52b-4b37-b8e1-54994562a453 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:41.711807 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96bfb8-0c29-4f42-86a3-47d705468557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:41.712415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96bfb8-0c29-4f42-86a3-47d705468557 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:41.712693 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96bfb8-0c29-4f42-86a3-47d705468557 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:41.712962 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96bfb8-0c29-4f42-86a3-47d705468557 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:41.713628 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96bfb8-0c29-4f42-86a3-47d705468557 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:41.713955 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96bfb8-0c29-4f42-86a3-47d705468557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:41.715372 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96bfb8-0c29-4f42-86a3-47d705468557 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:41.724196 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 171/361] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:28:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:42.938530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e06d67-4d91-4d8b-a1cf-6563b0ae6ab6 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:42.939044 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e06d67-4d91-4d8b-a1cf-6563b0ae6ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:42.939044 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e06d67-4d91-4d8b-a1cf-6563b0ae6ab6 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:42.940633 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 191/362] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:42.946102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66b2b6-4d02-46a4-aa59-666d5576bb69 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:42.946531 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66b2b6-4d02-46a4-aa59-666d5576bb69 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:42.946702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66b2b6-4d02-46a4-aa59-666d5576bb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:42.970660 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-2c66b2b6-4d02-46a4-aa59-666d5576bb69 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:42.971850 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-2c66b2b6-4d02-46a4-aa59-666d5576bb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:43.062609 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 172/363] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:43.298028 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036664c-5ed7-43d4-8fe3-c62b2aab319f None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:43.298317 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036664c-5ed7-43d4-8fe3-c62b2aab319f None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:43.298487 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036664c-5ed7-43d4-8fe3-c62b2aab319f None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:43.300135 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 192/364] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:43.311015 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb25f63-7ae7-4628-8c56-7512f2c7926a None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:43.311296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb25f63-7ae7-4628-8c56-7512f2c7926a None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:43.311571 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb25f63-7ae7-4628-8c56-7512f2c7926a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:43.333172 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-deb25f63-7ae7-4628-8c56-7512f2c7926a None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:43.334382 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-deb25f63-7ae7-4628-8c56-7512f2c7926a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:43.424344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 173/365] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:43.461321 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036664c-5ed7-43d4-8fe3-c62b2aab319f None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:43.495793 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:43.538099 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301beb8f-dc87-4f8e-b71a-a06fb33a0f15 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:43.538427 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301beb8f-dc87-4f8e-b71a-a06fb33a0f15 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:43.538649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301beb8f-dc87-4f8e-b71a-a06fb33a0f15 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:43.540225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 174/366] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:43.549423 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc1908-d258-4c37-b29a-7caaa09de37d None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:43.549982 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc1908-d258-4c37-b29a-7caaa09de37d None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:43.550481 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc1908-d258-4c37-b29a-7caaa09de37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:43.569361 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-4ecc1908-d258-4c37-b29a-7caaa09de37d None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:43.570710 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-4ecc1908-d258-4c37-b29a-7caaa09de37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:43.590013 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036664c-5ed7-43d4-8fe3-c62b2aab319f None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:43.598215 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:43.626974 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c51c10-e993-4712-a3c9-406a76bcfb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:43.627672 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c51c10-e993-4712-a3c9-406a76bcfb73 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:43.627950 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c51c10-e993-4712-a3c9-406a76bcfb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:43.628221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c51c10-e993-4712-a3c9-406a76bcfb73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:43.639676 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c51c10-e993-4712-a3c9-406a76bcfb73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:43.645526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-82c51c10-e993-4712-a3c9-406a76bcfb73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:28:43.645526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:43.645526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:43.645526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:43.645526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:43.645526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:43.645526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:43.645526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:43.645526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:43.645526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:43.645526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:43.645526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:43.645526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:43.645526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:43.645526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:43.645526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:43.646457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:43.646457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:43.646457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:43.646457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:43.646457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:43.646457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:43.646457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:43.646457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:43.646457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:43.646457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:43.646457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:43.646457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:43.646457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:43.646457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:43.646457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:43.646457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:43.647244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:43.647244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:43.647244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:43.647244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:43.647244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:43.647244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:43.647244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:43.647244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:43.647244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:43.647244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:43.647244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:28:43.647244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:43.647244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 193/367] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Oct 20 14:28:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:43.652825 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c51c10-e993-4712-a3c9-406a76bcfb73 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:43.706352 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 175/368] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:28:43.769932 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:43.796141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc1908-d258-4c37-b29a-7caaa09de37d None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:43.797329 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c51c10-e993-4712-a3c9-406a76bcfb73 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:43.866145 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef498eba-9800-454f-bac7-c668c8b8ebb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:43.867274 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef498eba-9800-454f-bac7-c668c8b8ebb0 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:43.867764 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef498eba-9800-454f-bac7-c668c8b8ebb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:43.868237 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef498eba-9800-454f-bac7-c668c8b8ebb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:43.869105 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef498eba-9800-454f-bac7-c668c8b8ebb0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:43.869812 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef498eba-9800-454f-bac7-c668c8b8ebb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:43.872794 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef498eba-9800-454f-bac7-c668c8b8ebb0 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:43.888501 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 194/369] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Oct 20 14:28:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:43.894770 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef498eba-9800-454f-bac7-c668c8b8ebb0 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:43.966849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc1908-d258-4c37-b29a-7caaa09de37d None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:44.007934 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1984fe9-cfe1-4228-8341-3a965e2d88b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:44.009509 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1984fe9-cfe1-4228-8341-3a965e2d88b4 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:44.010031 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1984fe9-cfe1-4228-8341-3a965e2d88b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:44.010686 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1984fe9-cfe1-4228-8341-3a965e2d88b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:44.024338 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1984fe9-cfe1-4228-8341-3a965e2d88b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:44.030869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-c1984fe9-cfe1-4228-8341-3a965e2d88b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:28:44.030869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:44.030869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:44.030869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:44.030869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:44.030869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:44.030869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:44.030869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:44.030869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:44.030869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:44.030869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:44.030869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:44.030869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:44.030869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:44.030869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:44.030869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:44.032278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:44.032278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:44.032278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:44.032278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:44.032278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:44.032278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:44.032278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:44.032278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:44.032278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:44.032278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:44.032278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:44.032278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:44.032278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:44.032278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:44.032278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:44.032278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:44.033074 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:44.033074 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:44.033074 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:44.033074 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:44.033074 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:44.033074 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:44.033074 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:44.033074 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:44.033074 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:44.033074 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:44.033074 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:28:44.033074 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:44.035645 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 176/370] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Oct 20 14:28:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:28:44.041607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1984fe9-cfe1-4228-8341-3a965e2d88b4 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:44.056457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:44.067988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef498eba-9800-454f-bac7-c668c8b8ebb0 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:44.107190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39470b-bc64-45e0-bb20-6c4b783112c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:44.108225 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39470b-bc64-45e0-bb20-6c4b783112c0 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:44.108705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39470b-bc64-45e0-bb20-6c4b783112c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:44.109170 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39470b-bc64-45e0-bb20-6c4b783112c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:44.121575 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39470b-bc64-45e0-bb20-6c4b783112c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:44.123359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39470b-bc64-45e0-bb20-6c4b783112c0 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:44.126456 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:44.139221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-1b39470b-bc64-45e0-bb20-6c4b783112c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:44.139221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:44.139221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:44.139221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:44.139221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:44.139221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:44.139221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:44.139221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:44.139221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:44.139221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:44.139221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:44.139221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:44.139221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:44.139221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:44.139221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:44.139221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:44.140349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:44.140349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:44.140349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:44.140349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:44.140349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:44.140349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:44.140349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:44.140349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:44.140349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:44.140349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:44.140349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:44.140349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:44.140349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:44.140349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:44.140349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:44.140349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:44.140349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:44.141729 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:44.141729 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:44.141729 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:44.143996 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 195/371] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:44.145133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39470b-bc64-45e0-bb20-6c4b783112c0 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:44.162401 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1984fe9-cfe1-4228-8341-3a965e2d88b4 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:44.201166 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4eb801-0809-4635-acba-2f681fe0eb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:44.201790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eb801-0809-4635-acba-2f681fe0eb1e None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:44.202105 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eb801-0809-4635-acba-2f681fe0eb1e None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:44.202359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eb801-0809-4635-acba-2f681fe0eb1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:44.214489 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4eb801-0809-4635-acba-2f681fe0eb1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:44.220399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-4b4eb801-0809-4635-acba-2f681fe0eb1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:28:44.220399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:44.220399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:44.220399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:44.220399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:44.220399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:44.220399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:44.220399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:44.220399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:44.220399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:44.220399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:44.220399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:44.220399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:44.220399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:44.220399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:44.220399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:44.221298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:44.221298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:44.221298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:44.221298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:44.221298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:44.221298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:44.221298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:44.221298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:44.221298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:44.221298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:44.221298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:44.221298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:44.221298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:44.221298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:44.221298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:44.221298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:44.222624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:44.222624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:44.222624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:44.222624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:44.222624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:44.222624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:44.222624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:44.222624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:44.222624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:44.222624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:44.222624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:28:44.222624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:44.222624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 177/372] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Oct 20 14:28:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:44.222624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4eb801-0809-4635-acba-2f681fe0eb1e None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:44.258850 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39470b-bc64-45e0-bb20-6c4b783112c0 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:44.295864 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29da54-5e81-4352-81f2-0b02dc8fcdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:44.296809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29da54-5e81-4352-81f2-0b02dc8fcdf1 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:44.297257 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29da54-5e81-4352-81f2-0b02dc8fcdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:44.297544 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29da54-5e81-4352-81f2-0b02dc8fcdf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:44.297654 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:44.298306 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29da54-5e81-4352-81f2-0b02dc8fcdf1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:44.298612 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29da54-5e81-4352-81f2-0b02dc8fcdf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:44.300257 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29da54-5e81-4352-81f2-0b02dc8fcdf1 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:44.309887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 196/373] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Oct 20 14:28:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:44.309887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6adaa-8723-41a3-95b5-f34a9046059e None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:44.310308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6adaa-8723-41a3-95b5-f34a9046059e None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:44.310453 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6adaa-8723-41a3-95b5-f34a9046059e None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:44.311777 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 197/374] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:44.316409 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6adaa-8723-41a3-95b5-f34a9046059e None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:44.336541 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4eb801-0809-4635-acba-2f681fe0eb1e None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:44.371149 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede35172-6490-4fb9-ada8-cebcce36dad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:44.371812 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede35172-6490-4fb9-ada8-cebcce36dad9 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:44.372039 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede35172-6490-4fb9-ada8-cebcce36dad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:44.372313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede35172-6490-4fb9-ada8-cebcce36dad9 None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:44.372955 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede35172-6490-4fb9-ada8-cebcce36dad9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:44.373257 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede35172-6490-4fb9-ada8-cebcce36dad9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:44.374649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede35172-6490-4fb9-ada8-cebcce36dad9 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:44.379305 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:44.391851 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 178/375] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:44.391851 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede35172-6490-4fb9-ada8-cebcce36dad9 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:44.430337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6adaa-8723-41a3-95b5-f34a9046059e None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:44.465710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dac242-db66-4b9a-80ae-22c007973a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:44.465710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dac242-db66-4b9a-80ae-22c007973a7e None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:44.466170 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dac242-db66-4b9a-80ae-22c007973a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:44.466243 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dac242-db66-4b9a-80ae-22c007973a7e None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:44.466907 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dac242-db66-4b9a-80ae-22c007973a7e None admin] RBAC: Adding query filter params (name=service) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:44.467211 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dac242-db66-4b9a-80ae-22c007973a7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:44.468590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dac242-db66-4b9a-80ae-22c007973a7e None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:44.481754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 198/376] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Oct 20 14:28:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:44.481754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c13e4-b10b-407d-afcd-f9319d235b0d None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:44.481754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c13e4-b10b-407d-afcd-f9319d235b0d None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:44.481754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c13e4-b10b-407d-afcd-f9319d235b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:44.497821 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-ee0c13e4-b10b-407d-afcd-f9319d235b0d None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:44.499043 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ee0c13e4-b10b-407d-afcd-f9319d235b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:44.503269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede35172-6490-4fb9-ada8-cebcce36dad9 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:44.535462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:44.541901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462414c0-94a2-4315-b1db-59d161e210e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:44.542550 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462414c0-94a2-4315-b1db-59d161e210e0 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:44.542826 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462414c0-94a2-4315-b1db-59d161e210e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:44.543149 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462414c0-94a2-4315-b1db-59d161e210e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:44.555152 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462414c0-94a2-4315-b1db-59d161e210e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:44.556673 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462414c0-94a2-4315-b1db-59d161e210e0 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:44.572573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-462414c0-94a2-4315-b1db-59d161e210e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:44.572573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:44.572573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:44.572573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:44.572573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:44.572573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:44.572573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:44.572573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:44.572573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:44.572573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:44.572573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:44.572573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:44.572573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:44.572573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:44.572573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:44.572573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:44.573724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:44.573724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:44.573724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:44.573724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:44.573724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:44.573724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:44.573724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:44.573724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:44.573724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:44.573724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:44.573724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:44.573724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:44.573724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:44.573724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:44.573724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:44.573724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:44.573724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:44.574827 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:44.574827 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:44.574827 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:44.574827 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 179/377] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:44.579251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462414c0-94a2-4315-b1db-59d161e210e0 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:44.589871 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 199/378] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:44.589871 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c13e4-b10b-407d-afcd-f9319d235b0d None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:44.657161 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:44.682571 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462414c0-94a2-4315-b1db-59d161e210e0 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:44.715953 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c13e4-b10b-407d-afcd-f9319d235b0d None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:44.717344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd664c-9017-47d7-bec4-490139e7f185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:44.718001 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd664c-9017-47d7-bec4-490139e7f185 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:44.718294 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd664c-9017-47d7-bec4-490139e7f185 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:44.718563 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd664c-9017-47d7-bec4-490139e7f185 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:44.727660 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd664c-9017-47d7-bec4-490139e7f185 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:44.729115 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd664c-9017-47d7-bec4-490139e7f185 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:44.742543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-0cdd664c-9017-47d7-bec4-490139e7f185 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 14:28:44.742543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:44.742543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:44.742543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:44.742543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:44.742543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:44.742543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:44.742543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:44.742543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:44.742543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:44.742543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:44.742543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:44.742543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:28:44.742543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:28:44.742543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:28:44.742543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:28:44.743457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:44.743457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:44.743457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:28:44.743457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:44.743457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:28:44.743457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:44.743457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:44.743457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:44.743457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:44.743457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:44.743457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:44.743457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:44.743457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:44.743457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:44.743457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:44.743457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:44.743457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:44.743457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:44.744325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:44.744325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:44.744325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:28:44.744325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:28:44.744325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:28:44.744325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:28:44.744325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:28:44.744325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:28:44.744325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 14:28:44.744325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:44.744325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 180/379] 10.222.0.17 () {56 vars in 1093 bytes} [Thu Oct 20 14:28:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:44.744874 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd664c-9017-47d7-bec4-490139e7f185 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:44.758153 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d783e-e78b-4a9c-84b6-e00627846470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:44.758787 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d783e-e78b-4a9c-84b6-e00627846470 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:44.759068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d783e-e78b-4a9c-84b6-e00627846470 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:44.759340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d783e-e78b-4a9c-84b6-e00627846470 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:44.769757 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d783e-e78b-4a9c-84b6-e00627846470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:44.771250 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d783e-e78b-4a9c-84b6-e00627846470 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:44.786174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-b40d783e-e78b-4a9c-84b6-e00627846470 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:44.786174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:44.786174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:44.786174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:44.786174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:44.786174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:44.786174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:44.786174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:44.786174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:44.786174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:44.786174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:44.786174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:44.786174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:44.786174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:44.786174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:44.786174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:44.787109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:44.787109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:44.787109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:44.787109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:44.787109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:44.787109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:44.787109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:44.787109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:44.787109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:44.787109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:44.787109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:44.787109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:44.787109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:44.787109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:44.787109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:44.787109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:44.787109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:44.787957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:44.787957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:44.787957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:44.787957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 200/380] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:44.788555 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba29b1-66cb-41fb-a618-0d60ae8e9349 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:44.788841 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba29b1-66cb-41fb-a618-0d60ae8e9349 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:44.789115 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba29b1-66cb-41fb-a618-0d60ae8e9349 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:44.790376 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 201/381] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:44.791067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba29b1-66cb-41fb-a618-0d60ae8e9349 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:44.801451 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:44.862656 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd664c-9017-47d7-bec4-490139e7f185 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:44.896573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf91493-5b17-4a7a-ae31-58824a80de89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:44.897182 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf91493-5b17-4a7a-ae31-58824a80de89 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:44.897466 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf91493-5b17-4a7a-ae31-58824a80de89 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:44.897743 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf91493-5b17-4a7a-ae31-58824a80de89 None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:44.898413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf91493-5b17-4a7a-ae31-58824a80de89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:44.898715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf91493-5b17-4a7a-ae31-58824a80de89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:44.900089 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf91493-5b17-4a7a-ae31-58824a80de89 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:44.902197 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba29b1-66cb-41fb-a618-0d60ae8e9349 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:44.903676 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:44.912101 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 181/382] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:44.912854 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf91493-5b17-4a7a-ae31-58824a80de89 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:44.942046 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec47240-c153-47c0-837c-010c90a0fea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:44.942646 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec47240-c153-47c0-837c-010c90a0fea4 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:44.942916 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec47240-c153-47c0-837c-010c90a0fea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:44.943185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec47240-c153-47c0-837c-010c90a0fea4 None admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:44.943919 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec47240-c153-47c0-837c-010c90a0fea4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:44.944213 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec47240-c153-47c0-837c-010c90a0fea4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:44.945647 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec47240-c153-47c0-837c-010c90a0fea4 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:44.980069 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 202/383] 10.222.0.17 () {56 vars in 1133 bytes} [Thu Oct 20 14:28:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:44.981266 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e93cf-f427-4f8f-baca-4e2750b3938d None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:44.981544 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e93cf-f427-4f8f-baca-4e2750b3938d None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:44.981813 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e93cf-f427-4f8f-baca-4e2750b3938d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:45.000669 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-a68e93cf-f427-4f8f-baca-4e2750b3938d None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:45.001903 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a68e93cf-f427-4f8f-baca-4e2750b3938d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:45.010405 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf91493-5b17-4a7a-ae31-58824a80de89 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:45.011880 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:45.045990 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c94e60-a606-41b1-9aad-26ae1f101231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:45.046642 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c94e60-a606-41b1-9aad-26ae1f101231 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:45.047569 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c94e60-a606-41b1-9aad-26ae1f101231 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:45.047857 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c94e60-a606-41b1-9aad-26ae1f101231 None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:45.048613 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c94e60-a606-41b1-9aad-26ae1f101231 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:45.048910 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c94e60-a606-41b1-9aad-26ae1f101231 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:45.050287 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c94e60-a606-41b1-9aad-26ae1f101231 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:45.061304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 182/384] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:45.062110 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c94e60-a606-41b1-9aad-26ae1f101231 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:45.068330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 203/385] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:45.069665 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e93cf-f427-4f8f-baca-4e2750b3938d None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:45.172652 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c94e60-a606-41b1-9aad-26ae1f101231 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:45.175026 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:45.187285 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e93cf-f427-4f8f-baca-4e2750b3938d None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:45.212581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92b3fe-2c3f-4354-a448-0654c08fc85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:45.213236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92b3fe-2c3f-4354-a448-0654c08fc85e None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:45.213521 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92b3fe-2c3f-4354-a448-0654c08fc85e None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:45.213795 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92b3fe-2c3f-4354-a448-0654c08fc85e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:45.224249 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91c88d-2415-4d97-a0c5-f716a56cad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:45.225066 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91c88d-2415-4d97-a0c5-f716a56cad3f None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:45.225191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92b3fe-2c3f-4354-a448-0654c08fc85e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:45.225366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91c88d-2415-4d97-a0c5-f716a56cad3f None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:45.225612 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91c88d-2415-4d97-a0c5-f716a56cad3f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:45.230469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-be92b3fe-2c3f-4354-a448-0654c08fc85e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:28:45.230469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:45.230469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:45.230469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:45.230469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:45.230469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:45.230469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:45.230469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:45.230469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:45.230469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:45.230469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:45.230469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:45.230469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:45.230469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:45.230469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:45.230469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:45.231318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:45.231318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:45.231318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:45.231318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:45.231318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:45.231318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:45.231318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:45.231318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:45.231318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:45.231318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:45.231318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:45.231318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:45.231318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:45.231318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:45.231318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:45.231318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:45.232117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:45.232117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:45.232117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:45.232117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:45.232117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:45.232117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:45.232117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:45.232117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:45.232117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:45.232117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:45.232117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:28:45.232117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:45.232117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 183/386] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Oct 20 14:28:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:45.232744 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91c88d-2415-4d97-a0c5-f716a56cad3f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:45.232816 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92b3fe-2c3f-4354-a448-0654c08fc85e None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:45.234169 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91c88d-2415-4d97-a0c5-f716a56cad3f None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:45.247427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-2e91c88d-2415-4d97-a0c5-f716a56cad3f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 20 14:28:45.247427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:45.247427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:45.247427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:45.247427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:45.247427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:45.247427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:45.247427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:45.247427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:45.247427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:45.247427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:45.247427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:45.247427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:28:45.247427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:28:45.247427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:28:45.247427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:28:45.248311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:45.248311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:45.248311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:28:45.248311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:45.248311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:28:45.248311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:45.248311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:45.248311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:45.248311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:45.248311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:45.248311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:45.248311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:45.248311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:45.248311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:45.248311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:45.248311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:45.248311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:45.248311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:45.249167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:45.249167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:45.249167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:28:45.249167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:28:45.249167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:28:45.249167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:28:45.249167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:28:45.249167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:28:45.249167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 20 14:28:45.249167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:45.249167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 204/387] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:45.249708 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91c88d-2415-4d97-a0c5-f716a56cad3f None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:45.262672 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:45.340909 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92b3fe-2c3f-4354-a448-0654c08fc85e None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:45.357969 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91c88d-2415-4d97-a0c5-f716a56cad3f None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:45.373626 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34f200-6aa1-4d9d-8948-cb140eab7dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:45.374288 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34f200-6aa1-4d9d-8948-cb140eab7dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:45.374566 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34f200-6aa1-4d9d-8948-cb140eab7dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:45.374836 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34f200-6aa1-4d9d-8948-cb140eab7dd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:45.385484 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34f200-6aa1-4d9d-8948-cb140eab7dd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:45.386945 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34f200-6aa1-4d9d-8948-cb140eab7dd3 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:45.391352 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda98a2-34ff-4956-a003-05a3ae0be836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:45.391970 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda98a2-34ff-4956-a003-05a3ae0be836 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:45.392245 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda98a2-34ff-4956-a003-05a3ae0be836 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:45.392509 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda98a2-34ff-4956-a003-05a3ae0be836 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:45.399717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda98a2-34ff-4956-a003-05a3ae0be836 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:45.401188 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda98a2-34ff-4956-a003-05a3ae0be836 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:45.401459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-0b34f200-6aa1-4d9d-8948-cb140eab7dd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:45.401459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:45.401459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:45.401459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:45.401459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:45.401459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:45.401459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:45.401459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:45.401459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:45.401459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:45.401459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:45.401459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:45.401459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:45.401459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:45.401459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:45.401459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:45.402335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:45.402335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:45.402335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:45.402335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:45.402335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:45.402335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:45.402335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:45.402335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:45.402335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:45.402335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:45.402335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:45.402335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:45.402335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:45.402335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:45.402335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:45.402335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:45.402335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:45.403184 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:45.403184 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:45.403184 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:45.403184 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 184/388] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:45.403419 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34f200-6aa1-4d9d-8948-cb140eab7dd3 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:45.414021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-abda98a2-34ff-4956-a003-05a3ae0be836 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 14:28:45.414021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:45.414021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:45.414021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:45.414021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:45.414021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:45.414021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:45.414021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:45.414021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:45.414021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:45.414021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:45.414021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:45.414021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:28:45.414021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:28:45.414021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:28:45.414021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:28:45.415093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:45.415093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:45.415093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:28:45.415093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:45.415093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:28:45.415093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:45.415093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:45.415093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:45.415093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:45.415093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:45.415093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:45.415093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:45.415093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:45.415093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:45.415093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:45.415093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:45.415093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:45.415093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:45.416024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:45.416024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:45.416024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:28:45.416024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:28:45.416024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:28:45.416024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:28:45.416024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:28:45.416024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:28:45.416024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 14:28:45.416024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:45.416024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 205/389] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:45.416693 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda98a2-34ff-4956-a003-05a3ae0be836 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:45.430485 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:45.484435 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:45.508473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34f200-6aa1-4d9d-8948-cb140eab7dd3 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:45.518726 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda98a2-34ff-4956-a003-05a3ae0be836 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:45.542597 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135ea22-344b-4462-bc91-ba972d7b3971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:45.543203 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135ea22-344b-4462-bc91-ba972d7b3971 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:45.543545 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135ea22-344b-4462-bc91-ba972d7b3971 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:45.543825 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135ea22-344b-4462-bc91-ba972d7b3971 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:45.544489 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135ea22-344b-4462-bc91-ba972d7b3971 None admin] RBAC: Adding query filter params (name=service) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:45.544907 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135ea22-344b-4462-bc91-ba972d7b3971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:45.546329 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135ea22-344b-4462-bc91-ba972d7b3971 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:45.551411 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fe10f-f837-4305-b69a-5d169dd7c6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:45.552091 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fe10f-f837-4305-b69a-5d169dd7c6ce None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:45.552443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fe10f-f837-4305-b69a-5d169dd7c6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:45.552724 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fe10f-f837-4305-b69a-5d169dd7c6ce None admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:45.553441 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fe10f-f837-4305-b69a-5d169dd7c6ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:45.553744 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fe10f-f837-4305-b69a-5d169dd7c6ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:45.554018 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 185/390] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Oct 20 14:28:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:45.555049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135ea22-344b-4462-bc91-ba972d7b3971 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:45.555454 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fe10f-f837-4305-b69a-5d169dd7c6ce None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:45.572844 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 206/391] 10.222.0.17 () {56 vars in 1137 bytes} [Thu Oct 20 14:28:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:45.573637 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fe10f-f837-4305-b69a-5d169dd7c6ce None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:45.638247 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:45.654465 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135ea22-344b-4462-bc91-ba972d7b3971 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:45.672571 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fe10f-f837-4305-b69a-5d169dd7c6ce None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:45.688964 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c0ec8-f9d8-4d3b-af6f-802987e9a98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:45.689528 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c0ec8-f9d8-4d3b-af6f-802987e9a98f None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:45.689805 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c0ec8-f9d8-4d3b-af6f-802987e9a98f None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:45.690109 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c0ec8-f9d8-4d3b-af6f-802987e9a98f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:45.692695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:45.701207 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c0ec8-f9d8-4d3b-af6f-802987e9a98f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:45.702694 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c0ec8-f9d8-4d3b-af6f-802987e9a98f None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:45.707085 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449203d-cecc-42d6-b6da-848b150d57da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:45.707685 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449203d-cecc-42d6-b6da-848b150d57da None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:45.707966 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449203d-cecc-42d6-b6da-848b150d57da None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:45.708237 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449203d-cecc-42d6-b6da-848b150d57da None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:45.708872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449203d-cecc-42d6-b6da-848b150d57da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:45.709172 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449203d-cecc-42d6-b6da-848b150d57da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:45.710554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449203d-cecc-42d6-b6da-848b150d57da None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:45.717138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-412c0ec8-f9d8-4d3b-af6f-802987e9a98f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:45.717138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:45.717138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:45.717138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:45.717138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:45.717138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:45.717138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:45.717138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:45.717138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:45.717138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:45.717138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:45.717138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:45.717138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:45.717138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:45.717138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:45.717138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:45.718078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:45.718078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:45.718078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:45.718078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:45.718078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:45.718078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:45.718078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:45.718078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:45.718078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:45.718078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:45.718078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:45.718078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:45.718078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:45.718078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:45.718078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:45.718078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:45.718078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:45.719078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:45.719078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:45.719078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:45.719078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 186/392] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:45.719078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c0ec8-f9d8-4d3b-af6f-802987e9a98f None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:45.729917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 207/393] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:45.729917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449203d-cecc-42d6-b6da-848b150d57da None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:45.818353 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c0ec8-f9d8-4d3b-af6f-802987e9a98f None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:45.823277 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449203d-cecc-42d6-b6da-848b150d57da None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:45.847901 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:45.850545 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5994501-ab0b-4df0-9b2c-68e9c3377d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:45.851470 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5994501-ab0b-4df0-9b2c-68e9c3377d64 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:45.851754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5994501-ab0b-4df0-9b2c-68e9c3377d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:45.852030 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5994501-ab0b-4df0-9b2c-68e9c3377d64 None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:45.852760 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5994501-ab0b-4df0-9b2c-68e9c3377d64 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:45.853065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5994501-ab0b-4df0-9b2c-68e9c3377d64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:45.854514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5994501-ab0b-4df0-9b2c-68e9c3377d64 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:45.855608 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce168006-2a8d-427f-ac60-04b6cf90050c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:45.856363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce168006-2a8d-427f-ac60-04b6cf90050c None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:45.856718 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce168006-2a8d-427f-ac60-04b6cf90050c None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:45.856990 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce168006-2a8d-427f-ac60-04b6cf90050c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:45.868125 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce168006-2a8d-427f-ac60-04b6cf90050c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:45.869574 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce168006-2a8d-427f-ac60-04b6cf90050c None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:45.883488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-ce168006-2a8d-427f-ac60-04b6cf90050c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:45.883488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:45.883488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:45.883488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:45.883488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:45.883488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:45.883488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:45.883488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:45.883488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:45.883488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:45.883488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:45.883488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:45.883488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:45.883488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:45.883488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:45.883488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:45.884363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:45.884363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:45.884363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:45.884363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:45.884363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:45.884363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:45.884363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:45.884363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:45.884363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:45.884363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:45.884363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:45.884363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:45.884363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:45.884363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:45.884363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:45.884363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:45.884363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:45.885188 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:45.885188 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:45.885188 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:45.885188 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 208/394] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:45.885725 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce168006-2a8d-427f-ac60-04b6cf90050c None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:45.893486 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 187/395] 10.222.0.17 () {56 vars in 1137 bytes} [Thu Oct 20 14:28:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:45.894348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5994501-ab0b-4df0-9b2c-68e9c3377d64 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:45.940836 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:45.983749 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce168006-2a8d-427f-ac60-04b6cf90050c None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:45.992882 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5994501-ab0b-4df0-9b2c-68e9c3377d64 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:46.016746 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db3aa0-dcf8-43f1-b9f1-2d721699d41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:46.017361 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db3aa0-dcf8-43f1-b9f1-2d721699d41f None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:46.017635 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db3aa0-dcf8-43f1-b9f1-2d721699d41f None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:46.017935 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db3aa0-dcf8-43f1-b9f1-2d721699d41f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:46.026071 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f0cb5-1445-45ae-bb78-e2a3f21f9e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:46.026670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f0cb5-1445-45ae-bb78-e2a3f21f9e5d None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:46.026945 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f0cb5-1445-45ae-bb78-e2a3f21f9e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:46.027213 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f0cb5-1445-45ae-bb78-e2a3f21f9e5d None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:46.027847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f0cb5-1445-45ae-bb78-e2a3f21f9e5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:46.028145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f0cb5-1445-45ae-bb78-e2a3f21f9e5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:46.028454 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db3aa0-dcf8-43f1-b9f1-2d721699d41f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:46.029516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f0cb5-1445-45ae-bb78-e2a3f21f9e5d None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:46.029917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db3aa0-dcf8-43f1-b9f1-2d721699d41f None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:46.041067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 188/396] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:46.042206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f0cb5-1445-45ae-bb78-e2a3f21f9e5d None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:46.044960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-48db3aa0-dcf8-43f1-b9f1-2d721699d41f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:46.044960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:46.044960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:46.044960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:46.044960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:46.044960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:46.044960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:46.044960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:46.044960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:46.044960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:46.044960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:46.044960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:46.044960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:46.044960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:46.044960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:46.044960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:46.045810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:46.045810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:46.045810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:46.045810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:46.045810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:46.045810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:46.045810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:46.045810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:46.045810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:46.045810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:46.045810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:46.045810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:46.045810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:46.045810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:46.045810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:46.045810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:46.045810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:46.046686 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:46.046686 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:46.046686 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:46.046686 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 209/397] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:46.046962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db3aa0-dcf8-43f1-b9f1-2d721699d41f None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:46.077961 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:46.145320 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db3aa0-dcf8-43f1-b9f1-2d721699d41f None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:46.145501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f0cb5-1445-45ae-bb78-e2a3f21f9e5d None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:46.152652 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:46.180513 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f4024-65a3-4b16-9f77-061c2efab050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:46.181124 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f4024-65a3-4b16-9f77-061c2efab050 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:46.181222 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218eac45-4412-4bd6-8b5a-f4b74af109b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:46.181408 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f4024-65a3-4b16-9f77-061c2efab050 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:46.181683 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f4024-65a3-4b16-9f77-061c2efab050 None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:46.181782 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218eac45-4412-4bd6-8b5a-f4b74af109b5 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:46.182044 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218eac45-4412-4bd6-8b5a-f4b74af109b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:46.182311 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218eac45-4412-4bd6-8b5a-f4b74af109b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:46.182396 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f4024-65a3-4b16-9f77-061c2efab050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:46.182652 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f4024-65a3-4b16-9f77-061c2efab050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:46.184167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f4024-65a3-4b16-9f77-061c2efab050 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:46.188860 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218eac45-4412-4bd6-8b5a-f4b74af109b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:46.190338 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218eac45-4412-4bd6-8b5a-f4b74af109b5 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:46.195448 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 210/398] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:46.196204 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f4024-65a3-4b16-9f77-061c2efab050 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:46.201657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-218eac45-4412-4bd6-8b5a-f4b74af109b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:46.201657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:46.201657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:46.201657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:46.201657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:46.201657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:46.201657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:46.201657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:46.201657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:46.201657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:46.201657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:46.201657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:46.201657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:28:46.201657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:28:46.201657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:28:46.202661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:28:46.202661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:46.202661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:46.202661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:46.202661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:46.202661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:46.202661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:46.202661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:46.202661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:46.202661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:46.202661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:46.202661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:46.202661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:46.202661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:46.202661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:46.202661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:46.202661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:46.203526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:28:46.203526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:28:46.203526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:28:46.203526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:28:46.203526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:28:46.203526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:28:46.203526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:46.203526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:46.203526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 189/399] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:28:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:46.203979 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218eac45-4412-4bd6-8b5a-f4b74af109b5 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:46.286845 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:46.295497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f4024-65a3-4b16-9f77-061c2efab050 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:46.302273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218eac45-4412-4bd6-8b5a-f4b74af109b5 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:46.330131 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7632a36-aa29-424a-92f7-b110a2f0c11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:46.330761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7632a36-aa29-424a-92f7-b110a2f0c11b None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:46.331043 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7632a36-aa29-424a-92f7-b110a2f0c11b None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:46.331322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7632a36-aa29-424a-92f7-b110a2f0c11b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:46.335859 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6a579-c6fe-4e3b-9ce6-556baeda7aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:46.336460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6a579-c6fe-4e3b-9ce6-556baeda7aea None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:46.336743 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6a579-c6fe-4e3b-9ce6-556baeda7aea None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:46.337019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6a579-c6fe-4e3b-9ce6-556baeda7aea None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:46.337667 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6a579-c6fe-4e3b-9ce6-556baeda7aea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:46.339128 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6a579-c6fe-4e3b-9ce6-556baeda7aea None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:46.341512 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7632a36-aa29-424a-92f7-b110a2f0c11b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:46.342934 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7632a36-aa29-424a-92f7-b110a2f0c11b None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:46.357009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-e7632a36-aa29-424a-92f7-b110a2f0c11b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:46.357009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:46.357009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:46.357009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:46.357009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:46.357009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:46.357009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:46.357009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:46.357009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:46.357009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:46.357009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:46.357009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:46.357009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:46.357009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:46.357009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:46.357009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:46.358140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:46.358140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:46.358140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:46.358140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:46.358140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:46.358140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:46.358140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:46.358140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:46.358140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:46.358140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:46.358140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:46.358140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:46.358140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:46.358140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:46.358140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:46.358140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:46.358140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:46.358992 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:46.358992 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:46.358992 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:46.358992 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 211/400] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:46.368123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7632a36-aa29-424a-92f7-b110a2f0c11b None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:46.368352 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 190/401] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Oct 20 14:28:46 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:28:46.368352 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6a579-c6fe-4e3b-9ce6-556baeda7aea None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:46.391453 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:46.478162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6a579-c6fe-4e3b-9ce6-556baeda7aea None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:46.487407 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7632a36-aa29-424a-92f7-b110a2f0c11b None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:46.517041 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f625eb-11c0-4a1a-9999-bddc92663ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:46.517805 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f625eb-11c0-4a1a-9999-bddc92663ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:46.518116 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f625eb-11c0-4a1a-9999-bddc92663ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:46.518504 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f625eb-11c0-4a1a-9999-bddc92663ab1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:46.523686 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188d496-9f09-4649-9358-920b19059b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:46.524296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188d496-9f09-4649-9358-920b19059b74 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:46.524575 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188d496-9f09-4649-9358-920b19059b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:46.524846 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188d496-9f09-4649-9358-920b19059b74 None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:46.525493 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188d496-9f09-4649-9358-920b19059b74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:46.525792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188d496-9f09-4649-9358-920b19059b74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:46.527570 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f625eb-11c0-4a1a-9999-bddc92663ab1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:46.527680 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188d496-9f09-4649-9358-920b19059b74 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:46.528218 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f625eb-11c0-4a1a-9999-bddc92663ab1 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:46.542602 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 212/402] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:46.542785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-d9f625eb-11c0-4a1a-9999-bddc92663ab1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 20 14:28:46.542785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:46.542785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:46.542785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:46.542785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:46.542785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:46.542785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:46.542785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:46.542785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:46.542785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:46.542785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:46.542785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:46.542785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:28:46.542785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:28:46.542785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:28:46.542785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:28:46.543829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:46.543829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:46.543829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:28:46.543829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:46.543829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:28:46.543829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:46.543829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:46.543829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:46.543829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:46.543829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:46.543829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:46.543829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:46.543829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:46.543829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:46.543829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:46.543829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:46.543829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:46.543829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:46.544924 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:46.544924 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:46.544924 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:28:46.544924 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:28:46.544924 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:28:46.544924 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:28:46.544924 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:28:46.544924 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:28:46.544924 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 20 14:28:46.544924 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:46.545537 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188d496-9f09-4649-9358-920b19059b74 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:46.545615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 191/403] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Oct 20 14:28:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:46.545615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f625eb-11c0-4a1a-9999-bddc92663ab1 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:46.549774 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:46.636433 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:46.656859 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f625eb-11c0-4a1a-9999-bddc92663ab1 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:46.657588 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188d496-9f09-4649-9358-920b19059b74 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:46.691190 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c29bc8-44f0-4247-8ee7-9b790a629900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:46.691621 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64078c33-2b11-4268-aae1-d81e2bd2f8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:46.691813 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c29bc8-44f0-4247-8ee7-9b790a629900 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:46.692068 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c29bc8-44f0-4247-8ee7-9b790a629900 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:46.692276 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078c33-2b11-4268-aae1-d81e2bd2f8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:46.692372 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c29bc8-44f0-4247-8ee7-9b790a629900 None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:46.692583 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078c33-2b11-4268-aae1-d81e2bd2f8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:46.692853 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078c33-2b11-4268-aae1-d81e2bd2f8a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:46.692978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c29bc8-44f0-4247-8ee7-9b790a629900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:46.693240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c29bc8-44f0-4247-8ee7-9b790a629900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:46.693597 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64078c33-2b11-4268-aae1-d81e2bd2f8a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:46.693919 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64078c33-2b11-4268-aae1-d81e2bd2f8a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:46.694641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c29bc8-44f0-4247-8ee7-9b790a629900 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:46.695355 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64078c33-2b11-4268-aae1-d81e2bd2f8a5 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:46.707851 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 192/404] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:46.708676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c29bc8-44f0-4247-8ee7-9b790a629900 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:46.717942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 213/405] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:28:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:46.717942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64078c33-2b11-4268-aae1-d81e2bd2f8a5 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:46.791854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:46.826050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c29bc8-44f0-4247-8ee7-9b790a629900 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:46.833925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64078c33-2b11-4268-aae1-d81e2bd2f8a5 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:46.866581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53340e7-6afe-4b0a-af8a-a0390492a876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:46.867232 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53340e7-6afe-4b0a-af8a-a0390492a876 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:46.867512 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53340e7-6afe-4b0a-af8a-a0390492a876 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:46.867785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53340e7-6afe-4b0a-af8a-a0390492a876 None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:46.868513 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53340e7-6afe-4b0a-af8a-a0390492a876 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:46.868816 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53340e7-6afe-4b0a-af8a-a0390492a876 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:46.869906 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f53ef-be98-422c-8058-f9b0f57a6fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:46.870312 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53340e7-6afe-4b0a-af8a-a0390492a876 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:46.870537 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f53ef-be98-422c-8058-f9b0f57a6fcc None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:46.870815 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f53ef-be98-422c-8058-f9b0f57a6fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:46.871085 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f53ef-be98-422c-8058-f9b0f57a6fcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:46.878424 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f53ef-be98-422c-8058-f9b0f57a6fcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:46.879876 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f53ef-be98-422c-8058-f9b0f57a6fcc None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:46.886719 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:46.895606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 193/406] 10.222.0.17 () {56 vars in 1139 bytes} [Thu Oct 20 14:28:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:46.895606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53340e7-6afe-4b0a-af8a-a0390492a876 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:46.895828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-b19f53ef-be98-422c-8058-f9b0f57a6fcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:46.895828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:46.895828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:46.895828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:46.895828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:46.895828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:46.895828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:46.895828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:46.895828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:46.895828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:46.895828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:46.895828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:46.895828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:28:46.895828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:28:46.895828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:28:46.896609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:28:46.896609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:46.896609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:46.896609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:46.896609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:46.896609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:46.896609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:46.896609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:46.896609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:46.896609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:46.896609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:46.896609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:46.896609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:46.896609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:46.896609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:46.896609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:46.896609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:46.897422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:28:46.897422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:28:46.897422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:28:46.897422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:28:46.897422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:28:46.897422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:28:46.897422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:46.897422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:46.898632 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 214/407] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:28:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:46.898946 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f53ef-be98-422c-8058-f9b0f57a6fcc None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:47.002421 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53340e7-6afe-4b0a-af8a-a0390492a876 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:47.007606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f53ef-be98-422c-8058-f9b0f57a6fcc None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:47.033149 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:47.038177 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4e176-831f-4510-9073-73e33434f9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:47.038808 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4e176-831f-4510-9073-73e33434f9d0 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:47.039080 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4e176-831f-4510-9073-73e33434f9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:47.039341 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4e176-831f-4510-9073-73e33434f9d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:47.047097 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4e176-831f-4510-9073-73e33434f9d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:47.048491 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4e176-831f-4510-9073-73e33434f9d0 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:47.049415 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917093e-3c84-4c13-bedb-e73c21978fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:47.050271 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917093e-3c84-4c13-bedb-e73c21978fed None admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:47.050562 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917093e-3c84-4c13-bedb-e73c21978fed None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:47.051143 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917093e-3c84-4c13-bedb-e73c21978fed None admin] PATH_INFO: `/v3/projects/88613722e7dc4950b5e47a1d92331575/users/172b859c0d774c8f8a98ce23bdc237d5/roles/af10f9c70a5d4fcb999f273845290676` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:47.059842 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-21d4e176-831f-4510-9073-73e33434f9d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:47.059842 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:47.059842 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:47.059842 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:47.059842 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:47.059842 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:47.059842 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:47.059842 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:47.059842 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:47.059842 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:47.059842 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:47.059842 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:47.059842 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:28:47.059842 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:28:47.059842 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:28:47.060684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:28:47.060684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:47.060684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:47.060684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:47.060684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:47.060684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:47.060684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:47.060684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:47.060684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:47.060684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:47.060684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:47.060684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:47.060684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:47.060684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:47.060684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:47.060684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:47.060684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:47.061611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:28:47.061611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:28:47.061611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:28:47.061611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:28:47.061611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:28:47.061611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:28:47.061611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:47.061611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:47.061611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 194/408] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:28:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:47.063560 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4e176-831f-4510-9073-73e33434f9d0 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:47.072195 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917093e-3c84-4c13-bedb-e73c21978fed None admin] RBAC: Authorizing `identity:create_grant(project_id=88613722e7dc4950b5e47a1d92331575, user_id=172b859c0d774c8f8a98ce23bdc237d5, role_id=af10f9c70a5d4fcb999f273845290676)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:47.073641 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917093e-3c84-4c13-bedb-e73c21978fed None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:47.086423 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 215/409] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:28:46 2022] PUT /identity/v3/projects/88613722e7dc4950b5e47a1d92331575/users/172b859c0d774c8f8a98ce23bdc237d5/roles/af10f9c70a5d4fcb999f273845290676 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:28:47.098844 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917093e-3c84-4c13-bedb-e73c21978fed None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:47.136259 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:47.199366 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4e176-831f-4510-9073-73e33434f9d0 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:47.244772 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409f4b3-760e-4428-a6e7-3d202b0049e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:47.246788 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409f4b3-760e-4428-a6e7-3d202b0049e8 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:47.247716 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409f4b3-760e-4428-a6e7-3d202b0049e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:47.248167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409f4b3-760e-4428-a6e7-3d202b0049e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:47.255393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917093e-3c84-4c13-bedb-e73c21978fed None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:47.264195 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409f4b3-760e-4428-a6e7-3d202b0049e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:47.266741 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409f4b3-760e-4428-a6e7-3d202b0049e8 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:47.287856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-e409f4b3-760e-4428-a6e7-3d202b0049e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:47.287856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:47.287856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:47.287856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:47.287856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:47.287856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:47.287856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:47.287856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:47.287856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:47.287856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:47.287856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:47.287856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:47.287856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:47.287856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:47.287856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:47.287856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:47.288978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:47.288978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:47.288978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:47.288978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:47.288978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:47.288978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:47.288978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:47.288978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:47.288978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:47.288978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:47.288978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:47.288978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:47.288978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:47.288978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:47.288978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:47.288978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:47.288978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:47.290027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:47.290027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:47.290027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:47.291231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 195/410] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:47.295952 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409f4b3-760e-4428-a6e7-3d202b0049e8 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:47.303851 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae92365-1ec5-475b-aa49-04aee35e34e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:47.304398 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae92365-1ec5-475b-aa49-04aee35e34e9 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:47.305004 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae92365-1ec5-475b-aa49-04aee35e34e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:47.305191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae92365-1ec5-475b-aa49-04aee35e34e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:47.305912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae92365-1ec5-475b-aa49-04aee35e34e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:47.306218 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae92365-1ec5-475b-aa49-04aee35e34e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:47.307654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae92365-1ec5-475b-aa49-04aee35e34e9 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:47.320649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 216/411] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:28:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:47.321581 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae92365-1ec5-475b-aa49-04aee35e34e9 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:47.356630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:47.430938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae92365-1ec5-475b-aa49-04aee35e34e9 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:47.446460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409f4b3-760e-4428-a6e7-3d202b0049e8 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:47.465002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:47.468081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f00c2-1bdc-4d7c-9441-8797fe90b961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:47.469541 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f00c2-1bdc-4d7c-9441-8797fe90b961 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:47.470680 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f00c2-1bdc-4d7c-9441-8797fe90b961 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:47.471223 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f00c2-1bdc-4d7c-9441-8797fe90b961 None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:47.473102 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f00c2-1bdc-4d7c-9441-8797fe90b961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:47.474561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f00c2-1bdc-4d7c-9441-8797fe90b961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:47.476140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f00c2-1bdc-4d7c-9441-8797fe90b961 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:47.491749 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723d7aa-e1bc-4f8d-8302-c42401d2d360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:47.492481 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723d7aa-e1bc-4f8d-8302-c42401d2d360 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:47.492977 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723d7aa-e1bc-4f8d-8302-c42401d2d360 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:47.493345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723d7aa-e1bc-4f8d-8302-c42401d2d360 None admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:47.493889 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 217/412] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:47.497891 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723d7aa-e1bc-4f8d-8302-c42401d2d360 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:47.497891 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723d7aa-e1bc-4f8d-8302-c42401d2d360 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:47.497891 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723d7aa-e1bc-4f8d-8302-c42401d2d360 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:47.498819 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f00c2-1bdc-4d7c-9441-8797fe90b961 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:47.521836 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 196/413] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:28:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:47.522731 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723d7aa-e1bc-4f8d-8302-c42401d2d360 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:47.631658 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:47.631991 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723d7aa-e1bc-4f8d-8302-c42401d2d360 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:47.642536 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f00c2-1bdc-4d7c-9441-8797fe90b961 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:47.670304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98317074-7e58-4301-b05a-e95ab82d5c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:47.670925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98317074-7e58-4301-b05a-e95ab82d5c15 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:47.671202 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98317074-7e58-4301-b05a-e95ab82d5c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:47.671918 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98317074-7e58-4301-b05a-e95ab82d5c15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:47.679267 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98317074-7e58-4301-b05a-e95ab82d5c15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:47.680770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98317074-7e58-4301-b05a-e95ab82d5c15 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:47.688875 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7fa89-e892-4f20-b2af-d926f1c6886a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:47.689758 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7fa89-e892-4f20-b2af-d926f1c6886a None admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:47.690230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7fa89-e892-4f20-b2af-d926f1c6886a None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:47.690646 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7fa89-e892-4f20-b2af-d926f1c6886a None admin] PATH_INFO: `/v3/projects/88613722e7dc4950b5e47a1d92331575/users/077f50ca034b4d12817543377815393b/roles/af10f9c70a5d4fcb999f273845290676` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:47.694678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-98317074-7e58-4301-b05a-e95ab82d5c15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:47.694678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:47.694678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:47.694678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:47.694678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:47.694678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:47.694678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:47.694678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:47.694678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:47.694678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:47.694678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:47.694678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:47.694678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:28:47.694678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:28:47.694678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:28:47.695669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:28:47.695669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:47.695669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:47.695669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:47.695669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:47.695669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:47.695669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:47.695669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:47.695669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:47.695669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:47.695669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:47.695669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:47.695669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:47.695669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:47.695669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:47.695669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:47.695669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:47.696713 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:28:47.696713 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:28:47.696713 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:28:47.696713 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:28:47.696713 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:28:47.696713 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:28:47.696713 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:47.696713 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:47.700424 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 197/414] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:28:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:47.701227 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98317074-7e58-4301-b05a-e95ab82d5c15 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:47.710595 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7fa89-e892-4f20-b2af-d926f1c6886a None admin] RBAC: Authorizing `identity:create_grant(project_id=88613722e7dc4950b5e47a1d92331575, user_id=077f50ca034b4d12817543377815393b, role_id=af10f9c70a5d4fcb999f273845290676)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:47.712790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7fa89-e892-4f20-b2af-d926f1c6886a None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:47.731331 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 218/415] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:28:47 2022] PUT /identity/v3/projects/88613722e7dc4950b5e47a1d92331575/users/077f50ca034b4d12817543377815393b/roles/af10f9c70a5d4fcb999f273845290676 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:28:47.733134 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7fa89-e892-4f20-b2af-d926f1c6886a None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:47.742385 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:47.844438 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98317074-7e58-4301-b05a-e95ab82d5c15 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:47.873645 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7fa89-e892-4f20-b2af-d926f1c6886a None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:47.920033 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04c910-d3e7-4df9-b7e3-42087421e85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:47.920578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04c910-d3e7-4df9-b7e3-42087421e85b None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:47.920854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04c910-d3e7-4df9-b7e3-42087421e85b None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:47.921122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04c910-d3e7-4df9-b7e3-42087421e85b None admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:47.922370 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04c910-d3e7-4df9-b7e3-42087421e85b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:47.922675 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04c910-d3e7-4df9-b7e3-42087421e85b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:47.924440 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04c910-d3e7-4df9-b7e3-42087421e85b None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:47.939157 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 219/416] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:28:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:47.946187 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04c910-d3e7-4df9-b7e3-42087421e85b None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:47.950228 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:47.966620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213ad5c-4eb9-40b8-af81-5d8eeba6ae15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:47.967548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213ad5c-4eb9-40b8-af81-5d8eeba6ae15 None admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:47.967831 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213ad5c-4eb9-40b8-af81-5d8eeba6ae15 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:47.968105 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213ad5c-4eb9-40b8-af81-5d8eeba6ae15 None admin] PATH_INFO: `/v3/projects/88613722e7dc4950b5e47a1d92331575/users/c1f0806ae4544d7b99d4d6e3b5069b9d/roles/af10f9c70a5d4fcb999f273845290676` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:47.985328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213ad5c-4eb9-40b8-af81-5d8eeba6ae15 None admin] RBAC: Authorizing `identity:create_grant(project_id=88613722e7dc4950b5e47a1d92331575, user_id=c1f0806ae4544d7b99d4d6e3b5069b9d, role_id=af10f9c70a5d4fcb999f273845290676)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:47.986930 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213ad5c-4eb9-40b8-af81-5d8eeba6ae15 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:48.007107 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 198/417] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:28:47 2022] PUT /identity/v3/projects/88613722e7dc4950b5e47a1d92331575/users/c1f0806ae4544d7b99d4d6e3b5069b9d/roles/af10f9c70a5d4fcb999f273845290676 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:28:48.088887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04c910-d3e7-4df9-b7e3-42087421e85b None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:48.141242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c97864-09ed-4a56-9449-c818b8601330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:48.142364 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c97864-09ed-4a56-9449-c818b8601330 None admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:48.142854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c97864-09ed-4a56-9449-c818b8601330 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:48.143323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c97864-09ed-4a56-9449-c818b8601330 None admin] PATH_INFO: `/v3/projects/88613722e7dc4950b5e47a1d92331575/users/359e9d904b0d43acae86337c1eb6a71d/roles/af10f9c70a5d4fcb999f273845290676` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:48.167389 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c97864-09ed-4a56-9449-c818b8601330 None admin] RBAC: Authorizing `identity:create_grant(project_id=88613722e7dc4950b5e47a1d92331575, user_id=359e9d904b0d43acae86337c1eb6a71d, role_id=af10f9c70a5d4fcb999f273845290676)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:48.169245 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c97864-09ed-4a56-9449-c818b8601330 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:48.202639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 220/418] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:28:47 2022] PUT /identity/v3/projects/88613722e7dc4950b5e47a1d92331575/users/359e9d904b0d43acae86337c1eb6a71d/roles/af10f9c70a5d4fcb999f273845290676 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:28:48.602116 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f8c7a-ebec-4ec9-b996-a5277d04687b None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:48.602603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f8c7a-ebec-4ec9-b996-a5277d04687b None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:48.602675 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f8c7a-ebec-4ec9-b996-a5277d04687b None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:48.604235 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 199/419] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:48.610064 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7e143-c891-4802-ab7c-b4779170aaf1 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:48.610376 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7e143-c891-4802-ab7c-b4779170aaf1 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:48.610649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7e143-c891-4802-ab7c-b4779170aaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:48.629794 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-b1b7e143-c891-4802-ab7c-b4779170aaf1 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:48.631020 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b1b7e143-c891-4802-ab7c-b4779170aaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:48.697752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:48.722568 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 221/420] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:28:49.011157 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f8c7a-ebec-4ec9-b996-a5277d04687b None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:49.112886 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:49.142536 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f8c7a-ebec-4ec9-b996-a5277d04687b None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:49.185423 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88b8b6-4b30-4123-8ede-db6ddb0800e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:49.186089 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88b8b6-4b30-4123-8ede-db6ddb0800e4 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:49.186370 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88b8b6-4b30-4123-8ede-db6ddb0800e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:49.186643 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88b8b6-4b30-4123-8ede-db6ddb0800e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:49.202926 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88b8b6-4b30-4123-8ede-db6ddb0800e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:49.207738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-5e88b8b6-4b30-4123-8ede-db6ddb0800e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:28:49.207738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:49.207738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:49.207738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:49.207738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:49.207738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:49.207738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:49.207738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:49.207738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:49.207738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:49.207738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:49.207738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:49.207738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:49.207738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:49.207738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:49.207738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:49.208594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:49.208594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:49.208594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:49.208594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:49.208594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:49.208594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:49.208594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:49.208594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:49.208594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:49.208594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:49.208594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:49.208594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:49.208594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:49.208594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:49.208594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:49.208594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:49.209750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:49.209750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:49.209750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:49.209750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:49.209750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:49.209750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:49.209750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:49.209750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:49.209750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:49.209750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:49.209750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:28:49.209750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:49.209750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 200/421] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Oct 20 14:28:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:49.214910 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7e143-c891-4802-ab7c-b4779170aaf1 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:49.340830 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7e143-c891-4802-ab7c-b4779170aaf1 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:49.382763 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc085e91-44a0-46fd-abfc-fb0dacff0ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:49.383372 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc085e91-44a0-46fd-abfc-fb0dacff0ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:49.383652 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc085e91-44a0-46fd-abfc-fb0dacff0ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:49.383925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc085e91-44a0-46fd-abfc-fb0dacff0ae9 None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:49.384657 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc085e91-44a0-46fd-abfc-fb0dacff0ae9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:49.384960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc085e91-44a0-46fd-abfc-fb0dacff0ae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:49.386491 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc085e91-44a0-46fd-abfc-fb0dacff0ae9 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:49.400223 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 222/422] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Oct 20 14:28:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:49.405791 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88b8b6-4b30-4123-8ede-db6ddb0800e4 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:49.528443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88b8b6-4b30-4123-8ede-db6ddb0800e4 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:49.568864 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd629d02-7219-4250-bd5a-c9b710a8efbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:49.569492 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd629d02-7219-4250-bd5a-c9b710a8efbd None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:49.569771 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd629d02-7219-4250-bd5a-c9b710a8efbd None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:49.570065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd629d02-7219-4250-bd5a-c9b710a8efbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:49.580637 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd629d02-7219-4250-bd5a-c9b710a8efbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:49.582112 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd629d02-7219-4250-bd5a-c9b710a8efbd None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:49.587258 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:49.607304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-fd629d02-7219-4250-bd5a-c9b710a8efbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:49.607304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:49.607304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:49.607304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:49.607304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:49.607304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:49.607304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:49.607304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:49.607304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:49.607304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:49.607304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:49.607304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:49.607304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:49.607304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:49.607304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:49.607304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:49.608935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:49.608935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:49.608935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:49.608935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:49.608935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:49.608935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:49.608935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:49.608935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:49.608935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:49.608935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:49.608935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:49.608935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:49.608935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:49.608935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:49.608935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:49.608935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:49.608935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:49.611534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:49.611534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:49.611534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:49.611534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 201/423] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:49.614866 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc085e91-44a0-46fd-abfc-fb0dacff0ae9 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:49.700664 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:49.767694 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63065294-c212-4f9a-8d7e-961a868f3436 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:49.768024 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63065294-c212-4f9a-8d7e-961a868f3436 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:49.768352 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63065294-c212-4f9a-8d7e-961a868f3436 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:49.770098 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 202/424] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:49.774411 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc085e91-44a0-46fd-abfc-fb0dacff0ae9 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:49.775350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55521d8f-cbdd-41a1-8a10-0f642ddd2514 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:49.775637 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55521d8f-cbdd-41a1-8a10-0f642ddd2514 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:49.776019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55521d8f-cbdd-41a1-8a10-0f642ddd2514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:49.796471 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-55521d8f-cbdd-41a1-8a10-0f642ddd2514 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:49.798215 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-55521d8f-cbdd-41a1-8a10-0f642ddd2514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:49.810429 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76a8b3-d597-4921-b72a-9fa12818d5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:49.811039 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76a8b3-d597-4921-b72a-9fa12818d5de None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:49.811313 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76a8b3-d597-4921-b72a-9fa12818d5de None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:49.811584 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76a8b3-d597-4921-b72a-9fa12818d5de None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:49.812768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76a8b3-d597-4921-b72a-9fa12818d5de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:49.813063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76a8b3-d597-4921-b72a-9fa12818d5de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:49.814580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76a8b3-d597-4921-b72a-9fa12818d5de None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:49.828424 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 223/425] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:49.839769 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76a8b3-d597-4921-b72a-9fa12818d5de None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:49.903395 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 203/426] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:28:50.000608 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76a8b3-d597-4921-b72a-9fa12818d5de None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:50.012406 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:50.039878 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03748b-892f-4f9a-9b26-7297a5f6a6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:50.040501 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03748b-892f-4f9a-9b26-7297a5f6a6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:50.040778 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03748b-892f-4f9a-9b26-7297a5f6a6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:50.041047 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03748b-892f-4f9a-9b26-7297a5f6a6f7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:50.048575 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03748b-892f-4f9a-9b26-7297a5f6a6f7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:50.050130 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03748b-892f-4f9a-9b26-7297a5f6a6f7 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:50.062041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-5d03748b-892f-4f9a-9b26-7297a5f6a6f7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 20 14:28:50.062041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:50.062041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:50.062041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:50.062041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:50.062041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:50.062041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:50.062041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:50.062041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:50.062041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:50.062041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:50.062041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:50.062041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:28:50.062041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:28:50.062041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:28:50.062041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:28:50.063619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:50.063619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:50.063619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:28:50.063619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:50.063619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:28:50.063619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:50.063619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:50.063619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:50.063619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:50.063619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:50.063619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:50.063619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:50.063619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:50.063619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:50.063619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:50.063619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:50.063619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:50.063619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:50.064880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:50.064880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:50.064880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:28:50.064880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:28:50.064880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:28:50.064880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:28:50.064880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:28:50.064880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:28:50.064880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 20 14:28:50.064880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:50.064880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 224/427] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:28:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:28:50.069265 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55521d8f-cbdd-41a1-8a10-0f642ddd2514 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:50.223220 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03748b-892f-4f9a-9b26-7297a5f6a6f7 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:50.229787 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55521d8f-cbdd-41a1-8a10-0f642ddd2514 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:50.256990 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:50.268548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd4e49-13df-4d87-b8eb-3059bd6c577e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:50.269158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd4e49-13df-4d87-b8eb-3059bd6c577e None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:50.269434 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd4e49-13df-4d87-b8eb-3059bd6c577e None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:50.269703 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd4e49-13df-4d87-b8eb-3059bd6c577e None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:50.270462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd4e49-13df-4d87-b8eb-3059bd6c577e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:50.270779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd4e49-13df-4d87-b8eb-3059bd6c577e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:50.272295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd4e49-13df-4d87-b8eb-3059bd6c577e None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:50.290941 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 204/428] 10.222.0.17 () {56 vars in 1135 bytes} [Thu Oct 20 14:28:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:50.296345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd4e49-13df-4d87-b8eb-3059bd6c577e None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:50.389338 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03748b-892f-4f9a-9b26-7297a5f6a6f7 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:50.410305 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd4e49-13df-4d87-b8eb-3059bd6c577e None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:50.426143 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b684150-372c-42d2-8147-859b65cc695c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:50.427087 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b684150-372c-42d2-8147-859b65cc695c None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:50.427559 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b684150-372c-42d2-8147-859b65cc695c None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:50.428017 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b684150-372c-42d2-8147-859b65cc695c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:50.439572 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b684150-372c-42d2-8147-859b65cc695c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:50.445048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-4b684150-372c-42d2-8147-859b65cc695c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:28:50.445048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:50.445048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:50.445048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:50.445048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:50.445048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:50.445048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:50.445048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:50.445048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:50.445048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:50.445048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:50.445048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:50.445048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:50.445048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:50.445048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:50.445048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:50.445923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:50.445923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:50.445923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:50.445923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:50.445923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:50.445923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:50.445923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:50.445923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:50.445923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:50.445923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:50.445923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:50.445923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:50.445923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:50.445923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:50.445923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:50.445923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:50.446849 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:50.446849 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:50.446849 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:50.446849 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:50.446849 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:50.446849 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:50.446849 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:50.446849 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:50.446849 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:50.446849 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:50.446849 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:28:50.446849 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:50.449308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 225/429] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Oct 20 14:28:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:50.449544 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ee41e-3932-4c59-b773-17470defb0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:50.450319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ee41e-3932-4c59-b773-17470defb0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:50.450598 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ee41e-3932-4c59-b773-17470defb0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:50.450867 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ee41e-3932-4c59-b773-17470defb0e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:50.451598 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74b842-2234-440e-89a5-4e4b2d978114 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:50.452067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74b842-2234-440e-89a5-4e4b2d978114 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:50.452526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74b842-2234-440e-89a5-4e4b2d978114 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:50.459087 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 226/430] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:50.460110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74b842-2234-440e-89a5-4e4b2d978114 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:50.462019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ee41e-3932-4c59-b773-17470defb0e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:50.463668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ee41e-3932-4c59-b773-17470defb0e3 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:50.481133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-bb9ee41e-3932-4c59-b773-17470defb0e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:50.481133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:50.481133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:50.481133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:50.481133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:50.481133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:50.481133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:50.481133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:50.481133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:50.481133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:50.481133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:50.481133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:50.481133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:50.481133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:50.481133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:50.481133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:50.482091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:50.482091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:50.482091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:50.482091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:50.482091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:50.482091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:50.482091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:50.482091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:50.482091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:50.482091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:50.482091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:50.482091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:50.482091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:50.482091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:50.482091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:50.482091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:50.482091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:50.483486 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:50.483486 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:50.483486 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:50.483486 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 205/431] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:50.483823 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de56b2-33b9-4261-b4b3-1c5a295bc993 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:50.484054 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de56b2-33b9-4261-b4b3-1c5a295bc993 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:50.484326 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de56b2-33b9-4261-b4b3-1c5a295bc993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:50.493460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:50.507062 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-54de56b2-33b9-4261-b4b3-1c5a295bc993 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:50.508254 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-54de56b2-33b9-4261-b4b3-1c5a295bc993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:50.542321 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:50.573209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74b842-2234-440e-89a5-4e4b2d978114 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:50.595201 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 206/432] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:50.595201 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de56b2-33b9-4261-b4b3-1c5a295bc993 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:50.634560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae7615-bf61-4364-9e7b-6a2894888581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:50.635427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae7615-bf61-4364-9e7b-6a2894888581 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:50.635933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae7615-bf61-4364-9e7b-6a2894888581 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:50.636341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae7615-bf61-4364-9e7b-6a2894888581 None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:50.637257 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae7615-bf61-4364-9e7b-6a2894888581 None admin] RBAC: Adding query filter params (name=service) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:50.637689 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae7615-bf61-4364-9e7b-6a2894888581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:50.639235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae7615-bf61-4364-9e7b-6a2894888581 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:50.661169 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 227/433] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Oct 20 14:28:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:50.666504 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae7615-bf61-4364-9e7b-6a2894888581 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:50.701265 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de56b2-33b9-4261-b4b3-1c5a295bc993 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:50.736999 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b2c7c-deb5-4885-9622-6aa05f4de7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:50.737755 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2c7c-deb5-4885-9622-6aa05f4de7cc None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:50.738154 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2c7c-deb5-4885-9622-6aa05f4de7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:50.738546 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2c7c-deb5-4885-9622-6aa05f4de7cc None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:50.739394 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b2c7c-deb5-4885-9622-6aa05f4de7cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:50.739786 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b2c7c-deb5-4885-9622-6aa05f4de7cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:50.741276 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b2c7c-deb5-4885-9622-6aa05f4de7cc None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:50.754133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 207/434] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:50.764366 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b2c7c-deb5-4885-9622-6aa05f4de7cc None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:50.826247 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:50.855494 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:50.880676 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae7615-bf61-4364-9e7b-6a2894888581 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:50.931957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b769958-5fe8-4242-a55e-95cc7432c65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:50.932589 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b769958-5fe8-4242-a55e-95cc7432c65f None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:50.932868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b769958-5fe8-4242-a55e-95cc7432c65f None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:50.933136 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b769958-5fe8-4242-a55e-95cc7432c65f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:50.941703 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b2c7c-deb5-4885-9622-6aa05f4de7cc None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:50.944381 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b769958-5fe8-4242-a55e-95cc7432c65f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:50.945870 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b769958-5fe8-4242-a55e-95cc7432c65f None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:50.961404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-8b769958-5fe8-4242-a55e-95cc7432c65f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:50.961404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:50.961404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:50.961404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:50.961404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:50.961404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:50.961404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:50.961404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:50.961404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:50.961404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:50.961404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:50.961404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:50.961404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:50.961404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:50.961404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:50.961404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:50.962373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:50.962373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:50.962373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:50.962373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:50.962373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:50.962373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:50.962373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:50.962373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:50.962373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:50.962373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:50.962373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:50.962373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:50.962373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:50.962373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:50.962373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:50.962373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:50.962373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:50.963693 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:50.963693 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:50.963693 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:50.963693 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 228/435] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:28:50.964001 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9daaba2-7af5-4b33-bfcc-36450a976258 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:50.964204 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9daaba2-7af5-4b33-bfcc-36450a976258 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:50.964475 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9daaba2-7af5-4b33-bfcc-36450a976258 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:50.970138 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 229/436] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:50.970138 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9daaba2-7af5-4b33-bfcc-36450a976258 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:50.985708 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de963ab3-f615-4179-ae2a-8f26e9263f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:50.986386 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de963ab3-f615-4179-ae2a-8f26e9263f17 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:50.986665 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de963ab3-f615-4179-ae2a-8f26e9263f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:50.986934 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de963ab3-f615-4179-ae2a-8f26e9263f17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:50.993998 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de963ab3-f615-4179-ae2a-8f26e9263f17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:50.995444 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de963ab3-f615-4179-ae2a-8f26e9263f17 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:51.009020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-de963ab3-f615-4179-ae2a-8f26e9263f17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:51.009020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:51.009020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:51.009020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:51.009020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:51.009020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:51.009020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:51.009020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:51.009020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:51.009020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:51.009020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:51.009020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:51.009020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:28:51.009020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:28:51.009020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:28:51.009901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:28:51.009901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:51.009901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:51.009901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:51.009901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:51.009901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:51.009901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:51.009901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:51.009901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:51.009901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:51.009901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:51.009901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:51.009901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:51.009901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:51.009901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:51.009901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:51.009901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:51.017002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:28:51.017002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:28:51.017002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:28:51.017002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:28:51.017002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:28:51.017002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:28:51.017002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:51.017002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:51.017002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 208/437] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:28:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:51.017002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de963ab3-f615-4179-ae2a-8f26e9263f17 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:51.078757 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9daaba2-7af5-4b33-bfcc-36450a976258 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:51.106007 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:51.112804 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946ac9b-e073-4dd1-9b20-677d9e213221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:51.113437 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946ac9b-e073-4dd1-9b20-677d9e213221 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:51.113720 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946ac9b-e073-4dd1-9b20-677d9e213221 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:51.114023 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946ac9b-e073-4dd1-9b20-677d9e213221 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:51.121767 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:51.125315 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946ac9b-e073-4dd1-9b20-677d9e213221 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:51.126095 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de963ab3-f615-4179-ae2a-8f26e9263f17 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:51.130445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-8946ac9b-e073-4dd1-9b20-677d9e213221 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:28:51.130445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:51.130445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:51.130445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:51.130445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:51.130445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:51.130445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:51.130445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:51.130445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:51.130445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:51.130445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:51.130445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:51.130445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:51.130445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:51.130445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:51.130445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:51.131507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:51.131507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:51.131507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:51.131507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:51.131507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:51.131507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:51.131507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:51.131507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:51.131507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:51.131507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:51.131507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:51.131507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:51.131507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:51.131507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:51.131507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:51.131507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:51.132295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:51.132295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:51.132295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:51.132295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:51.132295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:51.132295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:51.132295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:51.132295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:51.132295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:51.132295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:51.132295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:28:51.132295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:51.132295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 230/438] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Oct 20 14:28:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:51.133033 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda93295-1d6a-41a1-894e-cd5476e4501b None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:51.133196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda93295-1d6a-41a1-894e-cd5476e4501b None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:51.133662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda93295-1d6a-41a1-894e-cd5476e4501b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:51.152784 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-eda93295-1d6a-41a1-894e-cd5476e4501b None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:51.154008 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-eda93295-1d6a-41a1-894e-cd5476e4501b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:51.168014 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ab768-24f6-4a27-bcee-1686edf18bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:51.168897 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ab768-24f6-4a27-bcee-1686edf18bfb None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:51.169314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ab768-24f6-4a27-bcee-1686edf18bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:51.169932 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ab768-24f6-4a27-bcee-1686edf18bfb None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:51.170612 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ab768-24f6-4a27-bcee-1686edf18bfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:51.170910 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ab768-24f6-4a27-bcee-1686edf18bfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:51.173001 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ab768-24f6-4a27-bcee-1686edf18bfb None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:51.186977 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 209/439] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:51.188198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ab768-24f6-4a27-bcee-1686edf18bfb None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:51.238437 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 231/440] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:51.239140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda93295-1d6a-41a1-894e-cd5476e4501b None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:51.321311 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ab768-24f6-4a27-bcee-1686edf18bfb None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:51.342424 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda93295-1d6a-41a1-894e-cd5476e4501b None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:51.360257 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7794f30-4839-4577-b8bc-b1d37562588c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:51.360982 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7794f30-4839-4577-b8bc-b1d37562588c None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:51.361359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7794f30-4839-4577-b8bc-b1d37562588c None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:51.361731 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7794f30-4839-4577-b8bc-b1d37562588c None admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:51.362547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7794f30-4839-4577-b8bc-b1d37562588c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:51.362929 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7794f30-4839-4577-b8bc-b1d37562588c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:51.364361 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7794f30-4839-4577-b8bc-b1d37562588c None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:51.371161 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:51.376389 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 210/441] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:28:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:51.377370 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7794f30-4839-4577-b8bc-b1d37562588c None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:51.381592 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:51.383142 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad19660-eb4d-451e-bf40-d7733713e58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:51.383805 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad19660-eb4d-451e-bf40-d7733713e58e None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:51.384090 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad19660-eb4d-451e-bf40-d7733713e58e None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:51.384306 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad19660-eb4d-451e-bf40-d7733713e58e None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:51.384965 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad19660-eb4d-451e-bf40-d7733713e58e None admin] RBAC: Adding query filter params (name=service) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:51.385260 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad19660-eb4d-451e-bf40-d7733713e58e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:51.386659 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad19660-eb4d-451e-bf40-d7733713e58e None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:51.399416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 232/442] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Oct 20 14:28:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:51.399416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3ecc5-cc04-4a7a-a869-e58bed904887 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:51.399416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3ecc5-cc04-4a7a-a869-e58bed904887 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:51.399416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3ecc5-cc04-4a7a-a869-e58bed904887 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:51.399416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 233/443] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:51.399416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3ecc5-cc04-4a7a-a869-e58bed904887 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:51.497542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7794f30-4839-4577-b8bc-b1d37562588c None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:51.505066 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3ecc5-cc04-4a7a-a869-e58bed904887 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:51.530543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d771107-5b77-4db2-a477-763a37d983ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:51.531678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d771107-5b77-4db2-a477-763a37d983ce None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:51.531960 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d771107-5b77-4db2-a477-763a37d983ce None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:51.532230 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d771107-5b77-4db2-a477-763a37d983ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:51.539601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d771107-5b77-4db2-a477-763a37d983ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:51.540407 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7d7a4-1c40-4197-a7fd-e70f204fdb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:51.541029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d771107-5b77-4db2-a477-763a37d983ce None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:51.541120 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7d7a4-1c40-4197-a7fd-e70f204fdb18 None admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:51.541315 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7d7a4-1c40-4197-a7fd-e70f204fdb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:51.541584 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7d7a4-1c40-4197-a7fd-e70f204fdb18 None admin] PATH_INFO: `/v3/projects/88613722e7dc4950b5e47a1d92331575/users/8d60d62d14cd4042ab1bff5509e30f5c/roles/af10f9c70a5d4fcb999f273845290676` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:51.552922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-1d771107-5b77-4db2-a477-763a37d983ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 14:28:51.552922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:51.552922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:51.552922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:51.552922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:51.552922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:51.552922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:51.552922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:51.552922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:51.552922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:51.552922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:51.552922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:51.552922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:28:51.552922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:28:51.552922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:28:51.552922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:28:51.554021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:51.554021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:51.554021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:28:51.554021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:51.554021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:28:51.554021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:51.554021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:51.554021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:51.554021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:51.554021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:51.554021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:51.554021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:51.554021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:51.554021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:51.554021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:51.554021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:51.554021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:51.554021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:51.555175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:51.555175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:51.555175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:28:51.555175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:28:51.555175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:28:51.555175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:28:51.555175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:28:51.555175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:28:51.555175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 14:28:51.555175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:51.555175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 211/444] 10.222.0.17 () {56 vars in 1093 bytes} [Thu Oct 20 14:28:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:51.555719 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d771107-5b77-4db2-a477-763a37d983ce None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:51.557923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7d7a4-1c40-4197-a7fd-e70f204fdb18 None admin] RBAC: Authorizing `identity:create_grant(project_id=88613722e7dc4950b5e47a1d92331575, user_id=8d60d62d14cd4042ab1bff5509e30f5c, role_id=af10f9c70a5d4fcb999f273845290676)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:51.559443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7d7a4-1c40-4197-a7fd-e70f204fdb18 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:51.571457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 234/445] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:28:51 2022] PUT /identity/v3/projects/88613722e7dc4950b5e47a1d92331575/users/8d60d62d14cd4042ab1bff5509e30f5c/roles/af10f9c70a5d4fcb999f273845290676 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:28:51.572714 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b0401-1907-4e07-afcf-8ec14aff8be1 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:51.572999 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b0401-1907-4e07-afcf-8ec14aff8be1 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:51.573269 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b0401-1907-4e07-afcf-8ec14aff8be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:51.598790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-625b0401-1907-4e07-afcf-8ec14aff8be1 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:51.600196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-625b0401-1907-4e07-afcf-8ec14aff8be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:51.628484 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:51.641119 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:51.678439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d771107-5b77-4db2-a477-763a37d983ce None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:51.681453 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 235/446] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:51.682406 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b0401-1907-4e07-afcf-8ec14aff8be1 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:51.724256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b7fd9-c997-45e5-b3fe-45a3ce0301d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:51.724956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b7fd9-c997-45e5-b3fe-45a3ce0301d2 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:51.725303 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b7fd9-c997-45e5-b3fe-45a3ce0301d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:51.725650 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b7fd9-c997-45e5-b3fe-45a3ce0301d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:51.738557 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b7fd9-c997-45e5-b3fe-45a3ce0301d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:51.740120 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b7fd9-c997-45e5-b3fe-45a3ce0301d2 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:51.756148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-7e8b7fd9-c997-45e5-b3fe-45a3ce0301d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:51.756148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:51.756148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:51.756148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:51.756148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:51.756148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:51.756148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:51.756148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:51.756148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:51.756148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:51.756148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:51.756148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:51.756148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:51.756148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:51.756148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:51.756148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:51.757250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:51.757250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:51.757250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:51.757250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:51.757250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:51.757250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:51.757250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:51.757250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:51.757250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:51.757250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:51.757250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:51.757250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:51.757250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:51.757250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:51.757250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:51.757250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:51.757250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:51.758300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:51.758300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:51.758300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:51.758300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 212/447] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:51.759196 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b7fd9-c997-45e5-b3fe-45a3ce0301d2 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:51.816161 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b0401-1907-4e07-afcf-8ec14aff8be1 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:51.859407 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb31c7f-2192-4f42-949f-e47a0612a77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:51.860261 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb31c7f-2192-4f42-949f-e47a0612a77c None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:51.860811 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb31c7f-2192-4f42-949f-e47a0612a77c None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:51.861146 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb31c7f-2192-4f42-949f-e47a0612a77c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:51.868571 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b7fd9-c997-45e5-b3fe-45a3ce0301d2 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:51.876933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb31c7f-2192-4f42-949f-e47a0612a77c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:51.882365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-9cb31c7f-2192-4f42-949f-e47a0612a77c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:28:51.882365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:51.882365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:51.882365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:51.882365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:51.882365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:51.882365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:51.882365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:51.882365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:51.882365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:51.882365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:51.882365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:51.882365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:51.882365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:51.882365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:51.882365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:51.883310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:51.883310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:51.883310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:51.883310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:51.883310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:51.883310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:51.883310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:51.883310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:51.883310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:51.883310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:51.883310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:51.883310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:51.883310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:51.883310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:51.883310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:51.883310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:51.884289 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:51.884289 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:51.884289 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:51.884289 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:51.884289 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:51.884289 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:51.884289 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:51.884289 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:51.884289 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:51.884289 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:51.884289 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:28:51.884289 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:51.886355 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 236/448] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Oct 20 14:28:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:51.886980 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:51.888144 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb31c7f-2192-4f42-949f-e47a0612a77c None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:51.909472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c5bff-4df5-46b4-a5a9-1ce30bec2a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:51.910341 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c5bff-4df5-46b4-a5a9-1ce30bec2a48 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:51.910694 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c5bff-4df5-46b4-a5a9-1ce30bec2a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:51.911032 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c5bff-4df5-46b4-a5a9-1ce30bec2a48 None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:51.911870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c5bff-4df5-46b4-a5a9-1ce30bec2a48 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:51.912240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c5bff-4df5-46b4-a5a9-1ce30bec2a48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:51.913874 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c5bff-4df5-46b4-a5a9-1ce30bec2a48 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:51.924028 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:51.935540 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 213/449] 10.222.0.17 () {56 vars in 1133 bytes} [Thu Oct 20 14:28:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:51.936700 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c5bff-4df5-46b4-a5a9-1ce30bec2a48 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:51.995739 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb31c7f-2192-4f42-949f-e47a0612a77c None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:52.031555 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777ebe4-955c-4a03-b710-d5fd0424ef31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:52.032076 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777ebe4-955c-4a03-b710-d5fd0424ef31 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:52.032350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777ebe4-955c-4a03-b710-d5fd0424ef31 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:52.032618 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777ebe4-955c-4a03-b710-d5fd0424ef31 None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:52.033691 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777ebe4-955c-4a03-b710-d5fd0424ef31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:52.034093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777ebe4-955c-4a03-b710-d5fd0424ef31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:52.035480 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777ebe4-955c-4a03-b710-d5fd0424ef31 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:52.045127 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c5bff-4df5-46b4-a5a9-1ce30bec2a48 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:52.050927 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 237/450] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:52.050927 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777ebe4-955c-4a03-b710-d5fd0424ef31 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:52.086841 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd347ac9-2ad9-4c3d-b7bb-bc7994b760be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:52.088870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd347ac9-2ad9-4c3d-b7bb-bc7994b760be None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:52.088870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd347ac9-2ad9-4c3d-b7bb-bc7994b760be None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:52.088870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd347ac9-2ad9-4c3d-b7bb-bc7994b760be None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:52.088870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd347ac9-2ad9-4c3d-b7bb-bc7994b760be None admin] RBAC: Adding query filter params (name=service) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:52.088870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd347ac9-2ad9-4c3d-b7bb-bc7994b760be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:52.090358 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd347ac9-2ad9-4c3d-b7bb-bc7994b760be None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:52.104614 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 214/451] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Oct 20 14:28:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:52.104614 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd347ac9-2ad9-4c3d-b7bb-bc7994b760be None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:52.141684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:52.143299 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:52.153647 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777ebe4-955c-4a03-b710-d5fd0424ef31 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:52.199150 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f04962-2e93-471c-983e-bae2ce91f2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:52.199753 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f04962-2e93-471c-983e-bae2ce91f2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:52.200026 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f04962-2e93-471c-983e-bae2ce91f2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:52.200294 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f04962-2e93-471c-983e-bae2ce91f2a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:52.214855 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd347ac9-2ad9-4c3d-b7bb-bc7994b760be None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:52.250123 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462aa908-05a7-4abd-a55e-84da0c1234f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:52.250770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462aa908-05a7-4abd-a55e-84da0c1234f6 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:52.251199 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462aa908-05a7-4abd-a55e-84da0c1234f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:52.251468 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462aa908-05a7-4abd-a55e-84da0c1234f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:52.263390 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462aa908-05a7-4abd-a55e-84da0c1234f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:52.269356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-462aa908-05a7-4abd-a55e-84da0c1234f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:28:52.269356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:52.269356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:52.269356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:52.269356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:52.269356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:52.269356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:52.269356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:52.269356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:52.269356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:52.269356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:52.269356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:52.269356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:52.269356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:52.269356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:52.269356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:52.270270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:52.270270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:52.270270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:52.270270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:52.270270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:52.270270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:52.270270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:52.270270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:52.270270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:52.270270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:52.270270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:52.270270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:52.270270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:52.270270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:52.270270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:52.270270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:52.271037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:52.271037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:52.271037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:52.271037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:52.271037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:52.271037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:52.271037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:52.271037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:52.271037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:52.271037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:52.271037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:28:52.271037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:52.271037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 215/452] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Oct 20 14:28:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:52.271706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462aa908-05a7-4abd-a55e-84da0c1234f6 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:52.278621 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f04962-2e93-471c-983e-bae2ce91f2a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:52.280106 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f04962-2e93-471c-983e-bae2ce91f2a8 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:52.374278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:52.380103 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:52.382646 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462aa908-05a7-4abd-a55e-84da0c1234f6 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:52.390852 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 238/453] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:28:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 14:28:52.391862 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f04962-2e93-471c-983e-bae2ce91f2a8 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:52.423605 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c80a27-5143-4d0f-9796-21cfb686dac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:52.424392 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c80a27-5143-4d0f-9796-21cfb686dac7 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:52.425002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c80a27-5143-4d0f-9796-21cfb686dac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:52.425378 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c80a27-5143-4d0f-9796-21cfb686dac7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:52.433963 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c80a27-5143-4d0f-9796-21cfb686dac7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:52.435403 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c80a27-5143-4d0f-9796-21cfb686dac7 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:52.447348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-f3c80a27-5143-4d0f-9796-21cfb686dac7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 20 14:28:52.447348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:52.447348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:52.447348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:52.447348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:52.447348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:52.447348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:52.447348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:52.447348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:52.447348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:52.447348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:52.447348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:52.447348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:28:52.447348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:28:52.447348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:28:52.447348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:28:52.448251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:52.448251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:52.448251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:28:52.448251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:52.448251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:28:52.448251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:52.448251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:52.448251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:52.448251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:52.448251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:52.448251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:52.448251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:52.448251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:52.448251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:52.448251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:52.448251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:52.448251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:52.448251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:52.449152 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:52.449152 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:52.449152 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:28:52.449152 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:28:52.449152 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:28:52.449152 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:28:52.449152 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:28:52.449152 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:28:52.449152 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 20 14:28:52.449152 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:52.449152 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 216/454] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:52.449699 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c80a27-5143-4d0f-9796-21cfb686dac7 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:52.504395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f04962-2e93-471c-983e-bae2ce91f2a8 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:52.540960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c12fcd-0cc5-4430-9331-20c86ca9beba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:52.541580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c12fcd-0cc5-4430-9331-20c86ca9beba None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:52.541862 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c12fcd-0cc5-4430-9331-20c86ca9beba None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:52.542144 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c12fcd-0cc5-4430-9331-20c86ca9beba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:52.552917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c12fcd-0cc5-4430-9331-20c86ca9beba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:52.554644 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c12fcd-0cc5-4430-9331-20c86ca9beba None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:52.558475 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c80a27-5143-4d0f-9796-21cfb686dac7 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:52.569123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-92c12fcd-0cc5-4430-9331-20c86ca9beba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:52.569123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:52.569123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:52.569123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:52.569123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:52.569123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:52.569123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:52.569123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:52.569123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:52.569123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:52.569123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:52.569123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:52.569123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:52.569123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:52.569123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:52.569123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:52.570058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:52.570058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:52.570058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:52.570058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:52.570058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:52.570058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:52.570058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:52.570058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:52.570058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:52.570058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:52.570058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:52.570058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:52.570058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:52.570058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:52.570058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:52.570058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:52.570058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:52.571062 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:52.571062 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:52.571062 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:52.574787 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 239/455] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:52.575666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c12fcd-0cc5-4430-9331-20c86ca9beba None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:52.597061 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d928feb-a285-4378-924b-77f6a9e4b741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:52.597663 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d928feb-a285-4378-924b-77f6a9e4b741 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:52.597991 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d928feb-a285-4378-924b-77f6a9e4b741 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:52.598272 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d928feb-a285-4378-924b-77f6a9e4b741 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:52.598915 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d928feb-a285-4378-924b-77f6a9e4b741 None admin] RBAC: Adding query filter params (name=service) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:52.599214 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d928feb-a285-4378-924b-77f6a9e4b741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:52.600593 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d928feb-a285-4378-924b-77f6a9e4b741 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:52.608603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 217/456] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Oct 20 14:28:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:52.609783 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d928feb-a285-4378-924b-77f6a9e4b741 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:52.625590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:52.629887 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:52.685419 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c12fcd-0cc5-4430-9331-20c86ca9beba None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:52.715619 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d928feb-a285-4378-924b-77f6a9e4b741 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:52.720646 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b990742-b87a-4ec2-9bc9-b5cf1cf2a4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:52.721333 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b990742-b87a-4ec2-9bc9-b5cf1cf2a4ca None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:52.721674 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b990742-b87a-4ec2-9bc9-b5cf1cf2a4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:52.722038 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b990742-b87a-4ec2-9bc9-b5cf1cf2a4ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:52.732955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b990742-b87a-4ec2-9bc9-b5cf1cf2a4ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:52.734767 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b990742-b87a-4ec2-9bc9-b5cf1cf2a4ca None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:52.749066 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43690e09-2a69-4d36-aacb-9068d9c27011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:52.750122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-5b990742-b87a-4ec2-9bc9-b5cf1cf2a4ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:52.750122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:52.750122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:52.750122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:52.750122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:52.750122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:52.750122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:52.750122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:52.750122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:52.750122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:52.750122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:52.750122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:52.750122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:52.750122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:52.750122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:52.750122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:52.751230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:52.751230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:52.751230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:52.751230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:52.751230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:52.751230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:52.751230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:52.751230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:52.751230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:52.751230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:52.751230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:52.751230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:52.751230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:52.751230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:52.751230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:52.751230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:52.751230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:52.752287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:52.752287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:52.752287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:52.752467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43690e09-2a69-4d36-aacb-9068d9c27011 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:52.752467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43690e09-2a69-4d36-aacb-9068d9c27011 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:52.752467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43690e09-2a69-4d36-aacb-9068d9c27011 None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:52.752467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43690e09-2a69-4d36-aacb-9068d9c27011 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:52.752467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43690e09-2a69-4d36-aacb-9068d9c27011 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:52.753192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43690e09-2a69-4d36-aacb-9068d9c27011 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:52.757150 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 240/457] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:52.757942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b990742-b87a-4ec2-9bc9-b5cf1cf2a4ca None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:52.775825 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 218/458] 10.222.0.17 () {56 vars in 1137 bytes} [Thu Oct 20 14:28:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:52.775825 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43690e09-2a69-4d36-aacb-9068d9c27011 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:52.853336 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:52.866296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:52.872430 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b990742-b87a-4ec2-9bc9-b5cf1cf2a4ca None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:52.880245 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43690e09-2a69-4d36-aacb-9068d9c27011 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:52.914762 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e083a9-157b-4783-a261-3ac998d5d74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:52.915594 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e083a9-157b-4783-a261-3ac998d5d74b None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:52.916047 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e083a9-157b-4783-a261-3ac998d5d74b None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:52.916483 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e083a9-157b-4783-a261-3ac998d5d74b None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:52.916629 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428dac79-1e18-4005-a104-9130db8312a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:52.917259 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428dac79-1e18-4005-a104-9130db8312a9 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:52.917543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428dac79-1e18-4005-a104-9130db8312a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:52.917682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e083a9-157b-4783-a261-3ac998d5d74b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:52.917813 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428dac79-1e18-4005-a104-9130db8312a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:52.918269 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e083a9-157b-4783-a261-3ac998d5d74b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:52.919960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e083a9-157b-4783-a261-3ac998d5d74b None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:52.928750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428dac79-1e18-4005-a104-9130db8312a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:52.930485 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428dac79-1e18-4005-a104-9130db8312a9 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:52.939029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 241/459] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:52.940025 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e083a9-157b-4783-a261-3ac998d5d74b None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:52.950170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-428dac79-1e18-4005-a104-9130db8312a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:52.950170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:52.950170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:52.950170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:52.950170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:52.950170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:52.950170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:52.950170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:52.950170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:52.950170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:52.950170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:52.950170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:52.950170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:52.950170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:52.950170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:52.950170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:52.951281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:52.951281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:52.951281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:52.951281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:52.951281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:52.951281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:52.951281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:52.951281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:52.951281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:52.951281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:52.951281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:52.951281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:52.951281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:52.951281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:52.951281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:52.951281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:52.951281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:52.952329 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:52.952329 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:52.952329 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:52.952329 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 219/460] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:52.952329 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428dac79-1e18-4005-a104-9130db8312a9 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:53.047219 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e083a9-157b-4783-a261-3ac998d5d74b None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:53.059250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428dac79-1e18-4005-a104-9130db8312a9 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:53.081626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd52b6-7405-4f28-ae26-0091315e1dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:53.082329 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd52b6-7405-4f28-ae26-0091315e1dce None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:53.082670 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd52b6-7405-4f28-ae26-0091315e1dce None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:53.083007 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd52b6-7405-4f28-ae26-0091315e1dce None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:53.083704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd52b6-7405-4f28-ae26-0091315e1dce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:53.084064 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd52b6-7405-4f28-ae26-0091315e1dce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:53.085497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd52b6-7405-4f28-ae26-0091315e1dce None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:53.087394 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:53.096478 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f6858-8644-4b6b-add9-acca809c342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:53.097086 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f6858-8644-4b6b-add9-acca809c342f None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:53.097373 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f6858-8644-4b6b-add9-acca809c342f None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:53.097648 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f6858-8644-4b6b-add9-acca809c342f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:53.101816 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 242/461] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:53.102594 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd52b6-7405-4f28-ae26-0091315e1dce None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:53.120327 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:53.172921 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f6858-8644-4b6b-add9-acca809c342f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:53.175566 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f6858-8644-4b6b-add9-acca809c342f None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:53.207919 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd52b6-7405-4f28-ae26-0091315e1dce None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:53.242098 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d91d0d-897a-455b-a7d5-7c5a0432a4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:53.242728 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d91d0d-897a-455b-a7d5-7c5a0432a4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:53.243010 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d91d0d-897a-455b-a7d5-7c5a0432a4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:53.243297 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d91d0d-897a-455b-a7d5-7c5a0432a4f2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:53.251274 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d91d0d-897a-455b-a7d5-7c5a0432a4f2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:53.252726 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d91d0d-897a-455b-a7d5-7c5a0432a4f2 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:53.263963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-e8d91d0d-897a-455b-a7d5-7c5a0432a4f2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 14:28:53.263963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:53.263963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:53.263963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:53.263963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:53.263963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:53.263963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:53.263963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:53.263963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:53.263963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:53.263963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:53.263963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:53.263963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:28:53.263963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:28:53.263963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:28:53.263963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:28:53.264859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:53.264859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:53.264859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:28:53.264859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:53.264859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:28:53.264859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:53.264859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:53.264859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:53.264859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:53.264859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:53.264859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:53.264859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:53.264859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:53.264859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:53.264859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:53.264859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:53.264859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:53.264859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:53.266912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:53.266912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:53.266912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:28:53.266912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:28:53.266912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:28:53.266912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:28:53.266912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:28:53.266912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:28:53.266912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 14:28:53.266912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:53.266912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 243/462] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:53.266912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d91d0d-897a-455b-a7d5-7c5a0432a4f2 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:53.289300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 220/463] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:28:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 14:28:53.290373 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f6858-8644-4b6b-add9-acca809c342f None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:53.321654 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:53.350202 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:53.373037 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d91d0d-897a-455b-a7d5-7c5a0432a4f2 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:53.403241 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f6858-8644-4b6b-add9-acca809c342f None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:53.415570 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb9dba-ecd0-4ac1-9817-bb45b488b859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:53.416185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb9dba-ecd0-4ac1-9817-bb45b488b859 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:53.416464 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb9dba-ecd0-4ac1-9817-bb45b488b859 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:53.416736 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb9dba-ecd0-4ac1-9817-bb45b488b859 None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:53.417376 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb9dba-ecd0-4ac1-9817-bb45b488b859 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:53.417680 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb9dba-ecd0-4ac1-9817-bb45b488b859 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:53.419115 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb9dba-ecd0-4ac1-9817-bb45b488b859 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:53.438480 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 244/464] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:53.438480 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb9dba-ecd0-4ac1-9817-bb45b488b859 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:53.445852 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5f87a-abbe-4cf4-9e36-1af473051190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:53.446561 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5f87a-abbe-4cf4-9e36-1af473051190 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:53.446936 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5f87a-abbe-4cf4-9e36-1af473051190 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:53.447247 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5f87a-abbe-4cf4-9e36-1af473051190 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:53.454592 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5f87a-abbe-4cf4-9e36-1af473051190 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:53.456120 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5f87a-abbe-4cf4-9e36-1af473051190 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:53.467027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-8af5f87a-abbe-4cf4-9e36-1af473051190 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:53.467027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:53.467027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:53.467027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:53.467027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:53.467027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:53.467027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:53.467027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:53.467027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:53.467027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:53.467027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:53.467027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:53.467027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:28:53.467027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:28:53.467027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:28:53.467849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:28:53.467849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:53.467849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:53.467849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:53.467849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:53.467849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:53.467849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:53.467849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:53.467849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:53.467849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:53.467849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:53.467849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:53.467849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:53.467849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:53.467849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:53.467849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:53.467849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:53.469226 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:28:53.469226 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:28:53.469226 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:28:53.469226 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:28:53.469226 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:28:53.469226 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:28:53.469226 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:53.469226 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:53.469226 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 221/465] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:28:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:53.469809 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5f87a-abbe-4cf4-9e36-1af473051190 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:53.553341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb9dba-ecd0-4ac1-9817-bb45b488b859 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:53.560948 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:53.575943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5f87a-abbe-4cf4-9e36-1af473051190 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:53.590247 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c684088-9692-461b-862e-597df97888bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:53.590855 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c684088-9692-461b-862e-597df97888bb None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:53.591135 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c684088-9692-461b-862e-597df97888bb None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:53.591407 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c684088-9692-461b-862e-597df97888bb None admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:53.592137 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c684088-9692-461b-862e-597df97888bb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:53.592440 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c684088-9692-461b-862e-597df97888bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:53.594780 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c684088-9692-461b-862e-597df97888bb None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:53.598113 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:53.613477 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 245/466] 10.222.0.17 () {56 vars in 1137 bytes} [Thu Oct 20 14:28:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:53.614582 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c684088-9692-461b-862e-597df97888bb None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:53.620847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289c93b-d880-4a71-b912-223f60c70eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:53.622307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289c93b-d880-4a71-b912-223f60c70eac None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:53.622696 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289c93b-d880-4a71-b912-223f60c70eac None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:53.623114 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289c93b-d880-4a71-b912-223f60c70eac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:53.635301 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289c93b-d880-4a71-b912-223f60c70eac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:53.637044 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289c93b-d880-4a71-b912-223f60c70eac None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:53.653192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-c289c93b-d880-4a71-b912-223f60c70eac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:53.653192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:53.653192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:53.653192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:53.653192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:53.653192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:53.653192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:53.653192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:53.653192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:53.653192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:53.653192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:53.653192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:53.653192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:53.653192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:53.653192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:53.653192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:53.654309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:53.654309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:53.654309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:53.654309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:53.654309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:53.654309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:53.654309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:53.654309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:53.654309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:53.654309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:53.654309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:53.654309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:53.654309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:53.654309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:53.654309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:53.654309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:53.654309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:53.655386 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:53.655386 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:53.655386 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:53.661240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 222/467] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:53.661240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289c93b-d880-4a71-b912-223f60c70eac None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:53.731700 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c684088-9692-461b-862e-597df97888bb None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:53.769205 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289c93b-d880-4a71-b912-223f60c70eac None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:53.770218 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2849ce-3eba-44c6-b9fc-f472ebcae937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:53.771206 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2849ce-3eba-44c6-b9fc-f472ebcae937 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:53.772371 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2849ce-3eba-44c6-b9fc-f472ebcae937 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:53.772767 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2849ce-3eba-44c6-b9fc-f472ebcae937 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:53.781692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2849ce-3eba-44c6-b9fc-f472ebcae937 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:53.783325 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2849ce-3eba-44c6-b9fc-f472ebcae937 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:53.798002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-5d2849ce-3eba-44c6-b9fc-f472ebcae937 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 20 14:28:53.798002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:53.798002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:53.798002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:53.798002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:53.798002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:53.798002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:53.798002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:53.798002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:53.798002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:53.798002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:53.798002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:53.798002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:28:53.798002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:28:53.798002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:28:53.798002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:28:53.799081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:53.799081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:53.799081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:28:53.799081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:53.799081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:28:53.799081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:53.799081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:53.799081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:53.799081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:53.799081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:53.799081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:53.799081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:53.799081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:53.799081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:53.799081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:53.799081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:53.799081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:53.799081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:53.799938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:53.799938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:53.799938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:28:53.799938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:28:53.799938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:28:53.799938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:28:53.799938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:28:53.799938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:28:53.799938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 20 14:28:53.799938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:53.799938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 246/468] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Oct 20 14:28:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:53.799938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2849ce-3eba-44c6-b9fc-f472ebcae937 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:53.809729 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa246c-1873-4a8a-a8d5-fce46586068c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:53.810369 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa246c-1873-4a8a-a8d5-fce46586068c None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:53.810646 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa246c-1873-4a8a-a8d5-fce46586068c None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:53.810917 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa246c-1873-4a8a-a8d5-fce46586068c None admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:53.811704 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa246c-1873-4a8a-a8d5-fce46586068c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:53.812513 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa246c-1873-4a8a-a8d5-fce46586068c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:53.813989 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa246c-1873-4a8a-a8d5-fce46586068c None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:53.823607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:53.831933 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 223/469] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:28:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:53.831933 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa246c-1873-4a8a-a8d5-fce46586068c None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:53.857941 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:53.902489 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2849ce-3eba-44c6-b9fc-f472ebcae937 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:53.929582 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa246c-1873-4a8a-a8d5-fce46586068c None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:53.935437 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f0be7-0015-442a-b631-a9800849025d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:53.936034 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f0be7-0015-442a-b631-a9800849025d None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:53.936307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f0be7-0015-442a-b631-a9800849025d None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:53.936573 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f0be7-0015-442a-b631-a9800849025d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:53.963355 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b224c-a324-4fd2-abfa-ccdbc1640473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:53.964157 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b224c-a324-4fd2-abfa-ccdbc1640473 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:53.964797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b224c-a324-4fd2-abfa-ccdbc1640473 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:53.965143 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b224c-a324-4fd2-abfa-ccdbc1640473 None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:53.965869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b224c-a324-4fd2-abfa-ccdbc1640473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:53.966251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b224c-a324-4fd2-abfa-ccdbc1640473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:53.967690 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b224c-a324-4fd2-abfa-ccdbc1640473 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:53.979127 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 224/470] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:53.980330 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942474d-c5c3-4b8c-a408-a00b60af42a8 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:53.980681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942474d-c5c3-4b8c-a408-a00b60af42a8 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:53.981028 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942474d-c5c3-4b8c-a408-a00b60af42a8 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:53.982556 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 225/471] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:53.983074 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942474d-c5c3-4b8c-a408-a00b60af42a8 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:54.008188 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f0be7-0015-442a-b631-a9800849025d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:54.009638 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f0be7-0015-442a-b631-a9800849025d None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:54.042229 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:54.063050 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:54.088491 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942474d-c5c3-4b8c-a408-a00b60af42a8 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:54.106511 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 247/472] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:28:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 14:28:54.107340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f0be7-0015-442a-b631-a9800849025d None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:54.125498 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e17d17-8d88-47c5-a16d-a864f3f28f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:54.126212 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e17d17-8d88-47c5-a16d-a864f3f28f43 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:54.126486 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e17d17-8d88-47c5-a16d-a864f3f28f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:54.126749 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e17d17-8d88-47c5-a16d-a864f3f28f43 None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:54.127463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e17d17-8d88-47c5-a16d-a864f3f28f43 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:54.127760 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e17d17-8d88-47c5-a16d-a864f3f28f43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:54.129173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e17d17-8d88-47c5-a16d-a864f3f28f43 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:54.146075 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 226/473] 10.222.0.17 () {56 vars in 1139 bytes} [Thu Oct 20 14:28:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:54.146862 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e17d17-8d88-47c5-a16d-a864f3f28f43 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:54.205943 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f0be7-0015-442a-b631-a9800849025d None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:54.239878 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8100504-d2c5-4164-8454-139b820ed589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:54.240415 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8100504-d2c5-4164-8454-139b820ed589 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:54.240690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8100504-d2c5-4164-8454-139b820ed589 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:54.240958 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8100504-d2c5-4164-8454-139b820ed589 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:54.241667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8100504-d2c5-4164-8454-139b820ed589 None admin] RBAC: Adding query filter params (role.id=af10f9c70a5d4fcb999f273845290676, scope.project.id=88613722e7dc4950b5e47a1d92331575, user.id=172b859c0d774c8f8a98ce23bdc237d5) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:54.242006 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8100504-d2c5-4164-8454-139b820ed589 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:54.243426 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8100504-d2c5-4164-8454-139b820ed589 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:54.249093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 248/474] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:28:54 2022] GET /identity/v3/role_assignments?user.id=172b859c0d774c8f8a98ce23bdc237d5&scope.project.id=88613722e7dc4950b5e47a1d92331575&role.id=af10f9c70a5d4fcb999f273845290676 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:54.250841 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ec279-bc4b-4462-aebf-834633a9f9e9 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:54.251120 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ec279-bc4b-4462-aebf-834633a9f9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:54.251389 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ec279-bc4b-4462-aebf-834633a9f9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:54.252040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e17d17-8d88-47c5-a16d-a864f3f28f43 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:54.271670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:54.279279 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-ab2ec279-bc4b-4462-aebf-834633a9f9e9 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:54.280993 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ab2ec279-bc4b-4462-aebf-834633a9f9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:54.293757 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02725fc-6d68-4f5d-8d3e-e68c7bd4c194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:54.294444 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02725fc-6d68-4f5d-8d3e-e68c7bd4c194 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:54.294725 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02725fc-6d68-4f5d-8d3e-e68c7bd4c194 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:54.294994 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02725fc-6d68-4f5d-8d3e-e68c7bd4c194 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:54.295458 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:54.304752 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02725fc-6d68-4f5d-8d3e-e68c7bd4c194 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:54.306295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02725fc-6d68-4f5d-8d3e-e68c7bd4c194 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:54.318784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-f02725fc-6d68-4f5d-8d3e-e68c7bd4c194 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:54.318784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:54.318784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:54.318784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:54.318784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:54.318784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:54.318784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:54.318784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:54.318784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:54.318784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:54.318784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:54.318784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:54.318784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:28:54.318784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:28:54.318784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:28:54.319718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:28:54.319718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:54.319718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:54.319718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:54.319718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:54.319718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:54.319718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:54.319718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:54.319718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:54.319718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:54.319718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:54.319718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:54.319718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:54.319718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:54.319718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:54.319718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:54.319718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:54.320575 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:28:54.320575 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:28:54.320575 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:28:54.320575 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:28:54.320575 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:28:54.320575 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:28:54.320575 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:54.320575 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:54.320575 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 227/475] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:28:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:54.321044 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02725fc-6d68-4f5d-8d3e-e68c7bd4c194 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:54.366720 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 249/476] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:54.367474 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ec279-bc4b-4462-aebf-834633a9f9e9 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:54.466023 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02725fc-6d68-4f5d-8d3e-e68c7bd4c194 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:54.485923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ec279-bc4b-4462-aebf-834633a9f9e9 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:54.507932 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4071da-cf19-4192-beac-04ea0997bfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:54.508489 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4071da-cf19-4192-beac-04ea0997bfeb None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:54.508844 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4071da-cf19-4192-beac-04ea0997bfeb None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:54.509476 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4071da-cf19-4192-beac-04ea0997bfeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:54.520404 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4071da-cf19-4192-beac-04ea0997bfeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:54.522198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4071da-cf19-4192-beac-04ea0997bfeb None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:54.524884 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3bca0-5776-4231-a373-2618ee2c9451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:54.525716 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3bca0-5776-4231-a373-2618ee2c9451 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:54.526219 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3bca0-5776-4231-a373-2618ee2c9451 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:54.526740 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3bca0-5776-4231-a373-2618ee2c9451 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:54.538151 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-9a4071da-cf19-4192-beac-04ea0997bfeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:54.538151 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:54.538151 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:54.538151 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:54.538151 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:54.538151 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:54.538151 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:54.538151 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:54.538151 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:54.538151 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:54.538151 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:54.538151 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:54.538151 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:54.538151 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:54.538151 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:54.538151 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:54.539087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:54.539087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:54.539087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:54.539087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:54.539087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:54.539087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:54.539087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:54.539087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:54.539087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:54.539087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:54.539087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:54.539087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:54.539087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:54.539087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:54.539087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:54.539087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:54.539087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:54.539915 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:54.539915 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:54.539915 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:54.539915 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 228/477] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:54.540592 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4071da-cf19-4192-beac-04ea0997bfeb None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:54.550826 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:54.574891 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:54.608755 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3bca0-5776-4231-a373-2618ee2c9451 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:54.610816 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3bca0-5776-4231-a373-2618ee2c9451 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:54.649722 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4071da-cf19-4192-beac-04ea0997bfeb None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:54.686465 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65245b-63cd-4191-a23b-413d499f5bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:54.687227 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65245b-63cd-4191-a23b-413d499f5bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:54.687682 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65245b-63cd-4191-a23b-413d499f5bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:54.688381 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65245b-63cd-4191-a23b-413d499f5bb1 None admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:54.689080 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65245b-63cd-4191-a23b-413d499f5bb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:54.689389 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65245b-63cd-4191-a23b-413d499f5bb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:54.691535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65245b-63cd-4191-a23b-413d499f5bb1 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:54.709039 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 229/478] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:28:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:54.709039 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65245b-63cd-4191-a23b-413d499f5bb1 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:54.723008 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 250/479] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:28:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 14:28:54.723008 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3bca0-5776-4231-a373-2618ee2c9451 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:54.769796 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:54.810458 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:54.822145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65245b-63cd-4191-a23b-413d499f5bb1 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:54.824814 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3bca0-5776-4231-a373-2618ee2c9451 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:54.860752 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee577b6f-df8f-4dc3-82b3-1915e3139739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:54.861364 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee577b6f-df8f-4dc3-82b3-1915e3139739 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:54.861643 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee577b6f-df8f-4dc3-82b3-1915e3139739 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:54.861950 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee577b6f-df8f-4dc3-82b3-1915e3139739 None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:54.862593 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee577b6f-df8f-4dc3-82b3-1915e3139739 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:54.862888 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee577b6f-df8f-4dc3-82b3-1915e3139739 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:54.864253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee577b6f-df8f-4dc3-82b3-1915e3139739 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:54.866857 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442f651-4541-46ed-962d-8e388beef432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:54.867693 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442f651-4541-46ed-962d-8e388beef432 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:54.868141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442f651-4541-46ed-962d-8e388beef432 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:54.868579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442f651-4541-46ed-962d-8e388beef432 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:54.876466 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 230/480] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:54.877092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee577b6f-df8f-4dc3-82b3-1915e3139739 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:54.885709 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442f651-4541-46ed-962d-8e388beef432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:54.890710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-9442f651-4541-46ed-962d-8e388beef432 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:28:54.890710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:54.890710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:54.890710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:54.890710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:54.890710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:54.890710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:54.890710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:54.890710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:54.890710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:54.890710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:54.890710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:54.890710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:54.890710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:54.890710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:54.890710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:54.891732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:54.891732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:54.891732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:54.891732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:54.891732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:54.891732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:54.891732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:54.891732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:54.891732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:54.891732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:54.891732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:54.891732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:54.891732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:54.891732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:54.891732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:54.891732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:54.892868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:54.892868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:54.892868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:54.892868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:54.892868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:54.892868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:54.892868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:54.892868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:54.892868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:54.892868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:54.892868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:28:54.892868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:54.892868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 251/481] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Oct 20 14:28:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:54.892868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442f651-4541-46ed-962d-8e388beef432 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:54.992481 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee577b6f-df8f-4dc3-82b3-1915e3139739 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:54.998888 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442f651-4541-46ed-962d-8e388beef432 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:55.008779 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:55.032186 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58252da9-85e0-41b3-87a9-50eed52f5bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:55.032832 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58252da9-85e0-41b3-87a9-50eed52f5bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:55.033113 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58252da9-85e0-41b3-87a9-50eed52f5bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:55.033378 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58252da9-85e0-41b3-87a9-50eed52f5bd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:55.034123 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58252da9-85e0-41b3-87a9-50eed52f5bd6 None admin] RBAC: Adding query filter params (role.id=af10f9c70a5d4fcb999f273845290676, scope.project.id=88613722e7dc4950b5e47a1d92331575, user.id=077f50ca034b4d12817543377815393b) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:55.034424 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58252da9-85e0-41b3-87a9-50eed52f5bd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:55.035844 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58252da9-85e0-41b3-87a9-50eed52f5bd6 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:55.037186 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641aab00-701f-471e-b14e-8d22df0a5e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:55.037813 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641aab00-701f-471e-b14e-8d22df0a5e54 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:55.038120 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641aab00-701f-471e-b14e-8d22df0a5e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:55.038392 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641aab00-701f-471e-b14e-8d22df0a5e54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:55.049926 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 231/482] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:28:54 2022] GET /identity/v3/role_assignments?user.id=077f50ca034b4d12817543377815393b&scope.project.id=88613722e7dc4950b5e47a1d92331575&role.id=af10f9c70a5d4fcb999f273845290676 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:55.049926 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58252da9-85e0-41b3-87a9-50eed52f5bd6 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:55.060623 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641aab00-701f-471e-b14e-8d22df0a5e54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:55.063316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641aab00-701f-471e-b14e-8d22df0a5e54 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:55.067115 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:55.084557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-641aab00-701f-471e-b14e-8d22df0a5e54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:55.084557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:55.084557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:55.084557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:55.084557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:55.084557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:55.084557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:55.084557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:55.084557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:55.084557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:55.084557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:55.084557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:55.084557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:55.084557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:55.084557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:55.084557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:55.085530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:55.085530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:55.085530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:55.085530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:55.085530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:55.085530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:55.085530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:55.085530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:55.085530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:55.085530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:55.085530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:55.085530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:55.085530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:55.085530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:55.085530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:55.085530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:55.085530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:55.086935 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:55.086935 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:55.086935 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:55.092335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 252/483] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:55.092335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641aab00-701f-471e-b14e-8d22df0a5e54 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:55.194003 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58252da9-85e0-41b3-87a9-50eed52f5bd6 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:55.232970 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab4b72-2ceb-4877-bcaa-21bc31a7bedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:55.235088 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab4b72-2ceb-4877-bcaa-21bc31a7bedf None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:55.235088 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab4b72-2ceb-4877-bcaa-21bc31a7bedf None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:55.235088 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab4b72-2ceb-4877-bcaa-21bc31a7bedf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:55.240395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641aab00-701f-471e-b14e-8d22df0a5e54 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:55.242157 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab4b72-2ceb-4877-bcaa-21bc31a7bedf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:55.243614 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab4b72-2ceb-4877-bcaa-21bc31a7bedf None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:55.255900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-7dab4b72-2ceb-4877-bcaa-21bc31a7bedf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:55.255900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:55.255900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:55.255900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:55.255900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:55.255900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:55.255900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:55.255900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:55.255900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:55.255900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:55.255900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:55.255900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:55.255900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:28:55.255900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:28:55.255900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:28:55.256754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:28:55.256754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:55.256754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:55.256754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:55.256754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:55.256754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:55.256754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:55.256754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:55.256754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:55.256754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:55.256754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:55.256754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:55.256754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:55.256754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:55.256754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:55.256754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:55.256754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:55.257568 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:28:55.257568 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:28:55.257568 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:28:55.257568 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:28:55.257568 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:28:55.257568 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:28:55.257568 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:55.257568 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:55.261794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 232/484] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:28:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:55.262711 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab4b72-2ceb-4877-bcaa-21bc31a7bedf None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:55.277684 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddffcc-5a63-4f37-9f8f-e3bd30823d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:55.278340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddffcc-5a63-4f37-9f8f-e3bd30823d4c None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:55.278618 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddffcc-5a63-4f37-9f8f-e3bd30823d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:55.278890 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddffcc-5a63-4f37-9f8f-e3bd30823d4c None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:55.279548 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ddffcc-5a63-4f37-9f8f-e3bd30823d4c None admin] RBAC: Adding query filter params (name=service) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:55.279851 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ddffcc-5a63-4f37-9f8f-e3bd30823d4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:55.281901 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ddffcc-5a63-4f37-9f8f-e3bd30823d4c None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:55.290431 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 253/485] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Oct 20 14:28:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:55.291164 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddffcc-5a63-4f37-9f8f-e3bd30823d4c None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:55.317228 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:55.360313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:55.389001 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab4b72-2ceb-4877-bcaa-21bc31a7bedf None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:55.419455 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddffcc-5a63-4f37-9f8f-e3bd30823d4c None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:55.426278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07949ab-83aa-4741-8731-f0ab0b2cebce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:55.426890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07949ab-83aa-4741-8731-f0ab0b2cebce None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:55.427172 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07949ab-83aa-4741-8731-f0ab0b2cebce None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:55.427444 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07949ab-83aa-4741-8731-f0ab0b2cebce None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:55.428087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07949ab-83aa-4741-8731-f0ab0b2cebce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:55.428386 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07949ab-83aa-4741-8731-f0ab0b2cebce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:55.430046 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07949ab-83aa-4741-8731-f0ab0b2cebce None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:55.443916 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 233/486] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:55.444760 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07949ab-83aa-4741-8731-f0ab0b2cebce None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:55.467679 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e3ecb-9107-4c62-a0ab-48715cd6e202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:55.469059 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e3ecb-9107-4c62-a0ab-48715cd6e202 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:55.469345 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e3ecb-9107-4c62-a0ab-48715cd6e202 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:55.469621 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e3ecb-9107-4c62-a0ab-48715cd6e202 None admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:55.470343 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e3ecb-9107-4c62-a0ab-48715cd6e202 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:55.470656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e3ecb-9107-4c62-a0ab-48715cd6e202 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:55.472099 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e3ecb-9107-4c62-a0ab-48715cd6e202 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:55.484965 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 254/487] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:28:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:55.485793 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e3ecb-9107-4c62-a0ab-48715cd6e202 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:55.560778 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07949ab-83aa-4741-8731-f0ab0b2cebce None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:55.571020 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:55.591209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e3ecb-9107-4c62-a0ab-48715cd6e202 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:55.599018 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11dd1a-46f2-46eb-84ae-350bb387a4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:55.600378 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11dd1a-46f2-46eb-84ae-350bb387a4ac None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:55.600808 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11dd1a-46f2-46eb-84ae-350bb387a4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:55.601253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11dd1a-46f2-46eb-84ae-350bb387a4ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:55.604745 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:55.618505 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11dd1a-46f2-46eb-84ae-350bb387a4ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:55.620708 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11dd1a-46f2-46eb-84ae-350bb387a4ac None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:55.634029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df25667-61ef-4213-8460-9e25943a703e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:55.634942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df25667-61ef-4213-8460-9e25943a703e None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:55.635227 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df25667-61ef-4213-8460-9e25943a703e None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:55.635502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df25667-61ef-4213-8460-9e25943a703e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:55.641620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-6e11dd1a-46f2-46eb-84ae-350bb387a4ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:55.641620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:55.641620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:55.641620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:55.641620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:55.641620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:55.641620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:55.641620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:55.641620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:55.641620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:55.641620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:55.641620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:55.641620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:55.641620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:55.641620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:55.641620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:55.642715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:55.642715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:55.642715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:55.642715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:55.642715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:55.642715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:55.642715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:55.642715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:55.642715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:55.642715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:55.642715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:55.642715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:55.642715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:55.642715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:55.642715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:55.642715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:55.642715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:55.643698 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:55.643698 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:55.643698 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:55.644897 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df25667-61ef-4213-8460-9e25943a703e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:55.645725 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 234/488] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:55.646399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df25667-61ef-4213-8460-9e25943a703e None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:55.646880 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11dd1a-46f2-46eb-84ae-350bb387a4ac None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:55.665900 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-5df25667-61ef-4213-8460-9e25943a703e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:55.665900 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:55.665900 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:55.665900 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:55.665900 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:55.665900 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:55.665900 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:55.665900 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:55.665900 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:55.665900 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:55.665900 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:55.665900 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:55.665900 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:28:55.665900 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:28:55.665900 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:28:55.666980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:28:55.666980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:55.666980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:55.666980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:55.666980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:55.666980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:55.666980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:55.666980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:55.666980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:55.666980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:55.666980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:55.666980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:55.666980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:55.666980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:55.666980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:55.666980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:55.666980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:55.667939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:28:55.667939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:28:55.667939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:28:55.667939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:28:55.667939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:28:55.667939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:28:55.667939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:55.667939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:55.672621 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 255/489] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:28:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:55.673516 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df25667-61ef-4213-8460-9e25943a703e None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:55.780090 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df25667-61ef-4213-8460-9e25943a703e None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:55.792202 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11dd1a-46f2-46eb-84ae-350bb387a4ac None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:55.815774 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7378cf-12e1-43bb-9747-5c265f4a474f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:55.816381 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7378cf-12e1-43bb-9747-5c265f4a474f None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:55.816911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7378cf-12e1-43bb-9747-5c265f4a474f None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:55.817018 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7378cf-12e1-43bb-9747-5c265f4a474f None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:55.817607 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7378cf-12e1-43bb-9747-5c265f4a474f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:55.817941 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7378cf-12e1-43bb-9747-5c265f4a474f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:55.819323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7378cf-12e1-43bb-9747-5c265f4a474f None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:55.837473 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 256/490] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:55.838301 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f4113-844d-49f8-8325-b40f5fae798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:55.838745 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7378cf-12e1-43bb-9747-5c265f4a474f None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:55.839592 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f4113-844d-49f8-8325-b40f5fae798d None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:55.840077 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f4113-844d-49f8-8325-b40f5fae798d None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:55.840540 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f4113-844d-49f8-8325-b40f5fae798d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:55.841679 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:55.842146 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f4113-844d-49f8-8325-b40f5fae798d None admin] RBAC: Adding query filter params (role.id=af10f9c70a5d4fcb999f273845290676, scope.project.id=88613722e7dc4950b5e47a1d92331575, user.id=c1f0806ae4544d7b99d4d6e3b5069b9d) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:55.842645 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f4113-844d-49f8-8325-b40f5fae798d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:55.846046 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f4113-844d-49f8-8325-b40f5fae798d None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:55.853807 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 235/491] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:28:55 2022] GET /identity/v3/role_assignments?user.id=c1f0806ae4544d7b99d4d6e3b5069b9d&scope.project.id=88613722e7dc4950b5e47a1d92331575&role.id=af10f9c70a5d4fcb999f273845290676 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:55.854932 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f4113-844d-49f8-8325-b40f5fae798d None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:55.918074 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:55.982086 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f4113-844d-49f8-8325-b40f5fae798d None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:56.023652 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87207165-87da-4f46-943c-3a1008e7b9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:56.024594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87207165-87da-4f46-943c-3a1008e7b9bb None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:56.025051 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87207165-87da-4f46-943c-3a1008e7b9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:56.025686 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87207165-87da-4f46-943c-3a1008e7b9bb None admin] PATH_INFO: `/v3/users/swift` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:56.036109 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87207165-87da-4f46-943c-3a1008e7b9bb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:56.038187 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87207165-87da-4f46-943c-3a1008e7b9bb None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:56.045179 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7378cf-12e1-43bb-9747-5c265f4a474f None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:56.052971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-87207165-87da-4f46-943c-3a1008e7b9bb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 20 14:28:56.052971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:56.052971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:56.052971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:56.052971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:56.052971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:56.052971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:56.052971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:56.052971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:56.052971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:56.052971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:56.052971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:56.052971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:28:56.052971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:28:56.052971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:28:56.052971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:28:56.054415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:56.054415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:56.054415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:28:56.054415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:56.054415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:28:56.054415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:56.054415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:56.054415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:56.054415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:56.054415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:56.054415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:56.054415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:56.054415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:56.054415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:56.054415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:56.054415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:56.054415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:56.054415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:56.055296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:56.055296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:56.055296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:28:56.055296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:28:56.055296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:28:56.055296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:28:56.055296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:28:56.055296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:28:56.055296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 20 14:28:56.055296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:56.058355 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 236/492] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:28:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:56.066919 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87207165-87da-4f46-943c-3a1008e7b9bb None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:56.114818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75dc713-cbcc-450e-bfb8-1eb2af1f63f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:56.115453 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75dc713-cbcc-450e-bfb8-1eb2af1f63f8 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:56.115734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75dc713-cbcc-450e-bfb8-1eb2af1f63f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:56.116006 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75dc713-cbcc-450e-bfb8-1eb2af1f63f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:56.116722 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75dc713-cbcc-450e-bfb8-1eb2af1f63f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:56.117028 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75dc713-cbcc-450e-bfb8-1eb2af1f63f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:56.118565 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75dc713-cbcc-450e-bfb8-1eb2af1f63f8 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:56.151138 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 257/493] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:28:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:56.159518 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75dc713-cbcc-450e-bfb8-1eb2af1f63f8 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:56.241779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87207165-87da-4f46-943c-3a1008e7b9bb None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:56.253721 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:56.254836 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:56.305627 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1b9b4-8382-4fed-a16f-0f010bbb50d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:56.306527 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1b9b4-8382-4fed-a16f-0f010bbb50d5 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:56.306975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1b9b4-8382-4fed-a16f-0f010bbb50d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:56.307380 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1b9b4-8382-4fed-a16f-0f010bbb50d5 None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:56.308258 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1b9b4-8382-4fed-a16f-0f010bbb50d5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:56.308737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1b9b4-8382-4fed-a16f-0f010bbb50d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:56.310338 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1b9b4-8382-4fed-a16f-0f010bbb50d5 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:56.323824 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75dc713-cbcc-450e-bfb8-1eb2af1f63f8 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:56.349193 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 237/494] 10.222.0.17 () {56 vars in 1135 bytes} [Thu Oct 20 14:28:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:56.354503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1b9b4-8382-4fed-a16f-0f010bbb50d5 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:56.395093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2adbfd-746d-4df2-947f-361d3e3d06cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:56.396177 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2adbfd-746d-4df2-947f-361d3e3d06cb None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:56.397571 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2adbfd-746d-4df2-947f-361d3e3d06cb None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:56.398178 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2adbfd-746d-4df2-947f-361d3e3d06cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:56.399666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2adbfd-746d-4df2-947f-361d3e3d06cb None admin] RBAC: Adding query filter params (role.id=af10f9c70a5d4fcb999f273845290676, scope.project.id=88613722e7dc4950b5e47a1d92331575, user.id=359e9d904b0d43acae86337c1eb6a71d) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:56.400351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2adbfd-746d-4df2-947f-361d3e3d06cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:56.402576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2adbfd-746d-4df2-947f-361d3e3d06cb None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:56.412350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 258/495] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:28:56 2022] GET /identity/v3/role_assignments?user.id=359e9d904b0d43acae86337c1eb6a71d&scope.project.id=88613722e7dc4950b5e47a1d92331575&role.id=af10f9c70a5d4fcb999f273845290676 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:56.520898 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1b9b4-8382-4fed-a16f-0f010bbb50d5 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:56.551419 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30655e85-b123-4944-8317-56d36c4a7490 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:56.551965 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30655e85-b123-4944-8317-56d36c4a7490 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:56.552175 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30655e85-b123-4944-8317-56d36c4a7490 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:56.553819 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 259/496] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:56.559386 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a188915-930c-4b83-9f27-9526d852b5dd None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:56.559772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a188915-930c-4b83-9f27-9526d852b5dd None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:56.560146 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a188915-930c-4b83-9f27-9526d852b5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:56.578411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fbdf5-b13f-4e27-9dc7-a583796ad545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:56.578965 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fbdf5-b13f-4e27-9dc7-a583796ad545 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:56.579247 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fbdf5-b13f-4e27-9dc7-a583796ad545 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:56.579517 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fbdf5-b13f-4e27-9dc7-a583796ad545 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:56.581223 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-5a188915-930c-4b83-9f27-9526d852b5dd None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:56.582577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-5a188915-930c-4b83-9f27-9526d852b5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:56.628464 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:56.688246 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fbdf5-b13f-4e27-9dc7-a583796ad545 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:56.689806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fbdf5-b13f-4e27-9dc7-a583796ad545 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:56.710797 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 260/497] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:28:56.796954 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 238/498] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:28:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 14:28:56.802108 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a188915-930c-4b83-9f27-9526d852b5dd None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:56.863090 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:56.909154 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a188915-930c-4b83-9f27-9526d852b5dd None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:56.944526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62026d92-23cc-47fd-ad70-10b9315ef8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:56.945328 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62026d92-23cc-47fd-ad70-10b9315ef8ba None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:56.945702 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62026d92-23cc-47fd-ad70-10b9315ef8ba None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:56.946091 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62026d92-23cc-47fd-ad70-10b9315ef8ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:56.957485 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62026d92-23cc-47fd-ad70-10b9315ef8ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:56.959119 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62026d92-23cc-47fd-ad70-10b9315ef8ba None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:56.974523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-62026d92-23cc-47fd-ad70-10b9315ef8ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:56.974523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:56.974523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:56.974523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:56.974523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:56.974523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:56.974523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:56.974523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:56.974523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:56.974523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:56.974523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:56.974523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:56.974523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:56.974523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:56.974523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:56.974523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:56.975754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:56.975754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:56.975754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:56.975754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:56.975754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:56.975754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:56.975754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:56.975754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:56.975754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:56.975754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:56.975754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:56.975754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:56.975754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:56.975754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:56.975754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:56.975754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:56.975754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:56.976809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:56.976809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:56.976809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:56.978135 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 261/499] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:28:56.986933 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fbdf5-b13f-4e27-9dc7-a583796ad545 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:57.008053 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62026d92-23cc-47fd-ad70-10b9315ef8ba None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:57.109553 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:57.157026 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fbdf5-b13f-4e27-9dc7-a583796ad545 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:57.195539 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62026d92-23cc-47fd-ad70-10b9315ef8ba None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:57.213240 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:57.233397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be997e20-2f36-44d0-b070-3c2c88640f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:57.233977 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be997e20-2f36-44d0-b070-3c2c88640f3e None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:57.234256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be997e20-2f36-44d0-b070-3c2c88640f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:57.234543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be997e20-2f36-44d0-b070-3c2c88640f3e None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:57.235193 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be997e20-2f36-44d0-b070-3c2c88640f3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:57.235491 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be997e20-2f36-44d0-b070-3c2c88640f3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:57.236883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be997e20-2f36-44d0-b070-3c2c88640f3e None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:57.252936 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 239/500] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:57.258666 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be997e20-2f36-44d0-b070-3c2c88640f3e None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:57.277682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990afe0-c07b-441d-a420-20322b14fb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:57.278821 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990afe0-c07b-441d-a420-20322b14fb94 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:57.279553 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990afe0-c07b-441d-a420-20322b14fb94 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:57.279998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990afe0-c07b-441d-a420-20322b14fb94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:57.312750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990afe0-c07b-441d-a420-20322b14fb94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:28:57.318067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-f990afe0-c07b-441d-a420-20322b14fb94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:28:57.318067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:57.318067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:57.318067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:57.318067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:57.318067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:57.318067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:57.318067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:57.318067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:57.318067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:57.318067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:57.318067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:57.318067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:28:57.318067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:28:57.318067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:28:57.318067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:28:57.318955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:28:57.318955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:28:57.318955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:28:57.318955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:28:57.318955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:57.318955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:57.318955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:57.318955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:57.318955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:57.318955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:57.318955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:57.318955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:57.318955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:57.318955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:57.318955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:57.318955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:57.320235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:57.320235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:57.320235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:57.320235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:57.320235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:28:57.320235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:28:57.320235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:28:57.320235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:28:57.320235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:28:57.320235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:28:57.320235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:28:57.320235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:57.326009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 262/501] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:28:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:28:57.331879 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990afe0-c07b-441d-a420-20322b14fb94 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:57.397525 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be997e20-2f36-44d0-b070-3c2c88640f3e None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:57.450087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:57.464788 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2120438-e910-4fac-a5d0-b6ee1a042213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:57.465575 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2120438-e910-4fac-a5d0-b6ee1a042213 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:57.465984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2120438-e910-4fac-a5d0-b6ee1a042213 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:57.466358 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2120438-e910-4fac-a5d0-b6ee1a042213 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:57.481737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2120438-e910-4fac-a5d0-b6ee1a042213 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:57.483376 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2120438-e910-4fac-a5d0-b6ee1a042213 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:57.499895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-f2120438-e910-4fac-a5d0-b6ee1a042213 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:57.499895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:57.499895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:57.499895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:57.499895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:57.499895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:57.499895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:57.499895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:57.499895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:57.499895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:57.499895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:57.499895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:57.499895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:28:57.499895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:28:57.499895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:28:57.500961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:28:57.500961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:57.500961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:57.500961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:57.500961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:57.500961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:57.500961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:57.500961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:57.500961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:57.500961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:57.500961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:57.500961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:57.500961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:57.500961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:57.500961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:57.500961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:57.500961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:57.502031 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:28:57.502031 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:28:57.502031 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:28:57.502031 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:28:57.502031 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:28:57.502031 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:28:57.502031 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:57.502031 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:57.503708 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 240/502] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:28:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:57.505094 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae40330-678d-4661-aef9-2a219b969464 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:57.505469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae40330-678d-4661-aef9-2a219b969464 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:57.505833 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae40330-678d-4661-aef9-2a219b969464 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:57.509891 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 241/503] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:57.509891 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae40330-678d-4661-aef9-2a219b969464 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:57.519829 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990afe0-c07b-441d-a420-20322b14fb94 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:57.562489 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331eafd8-f55b-4fee-ba2f-bf0306bcffde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:57.563144 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331eafd8-f55b-4fee-ba2f-bf0306bcffde None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:57.563369 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331eafd8-f55b-4fee-ba2f-bf0306bcffde None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:57.563620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331eafd8-f55b-4fee-ba2f-bf0306bcffde None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:57.564284 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331eafd8-f55b-4fee-ba2f-bf0306bcffde None admin] RBAC: Adding query filter params (name=admin) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:57.564621 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331eafd8-f55b-4fee-ba2f-bf0306bcffde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:57.566125 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331eafd8-f55b-4fee-ba2f-bf0306bcffde None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:57.581927 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 263/504] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:28:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:57.583514 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f261f-6b4c-43e7-9fb7-e5f8964f37ae None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:57.584015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f261f-6b4c-43e7-9fb7-e5f8964f37ae None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:57.584566 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f261f-6b4c-43e7-9fb7-e5f8964f37ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:57.604584 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-eb5f261f-6b4c-43e7-9fb7-e5f8964f37ae None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:57.606209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-eb5f261f-6b4c-43e7-9fb7-e5f8964f37ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:57.632450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:57.648667 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae40330-678d-4661-aef9-2a219b969464 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:57.685817 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 264/505] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:57.685817 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f261f-6b4c-43e7-9fb7-e5f8964f37ae None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:57.707507 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc483a9-a685-4b96-a13f-b665a8688160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:57.708452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc483a9-a685-4b96-a13f-b665a8688160 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:57.708927 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc483a9-a685-4b96-a13f-b665a8688160 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:57.709402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc483a9-a685-4b96-a13f-b665a8688160 None admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:57.710341 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc483a9-a685-4b96-a13f-b665a8688160 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:57.711746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc483a9-a685-4b96-a13f-b665a8688160 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:57.714906 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc483a9-a685-4b96-a13f-b665a8688160 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:57.740173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 242/506] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:28:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:57.744157 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc483a9-a685-4b96-a13f-b665a8688160 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:57.812000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:57.877633 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f261f-6b4c-43e7-9fb7-e5f8964f37ae None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:57.903130 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc483a9-a685-4b96-a13f-b665a8688160 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:57.941648 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da289eb-d220-44cf-9d39-3016314c5850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:57.942311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da289eb-d220-44cf-9d39-3016314c5850 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:57.942591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da289eb-d220-44cf-9d39-3016314c5850 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:57.942869 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da289eb-d220-44cf-9d39-3016314c5850 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:57.961473 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da289eb-d220-44cf-9d39-3016314c5850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:57.962899 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da289eb-d220-44cf-9d39-3016314c5850 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:57.966863 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c9f18-92f9-48f6-980e-da47ce6c6ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:57.967520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c9f18-92f9-48f6-980e-da47ce6c6ccd None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:57.968410 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c9f18-92f9-48f6-980e-da47ce6c6ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:57.969260 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c9f18-92f9-48f6-980e-da47ce6c6ccd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:57.970022 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c9f18-92f9-48f6-980e-da47ce6c6ccd None admin] RBAC: Adding query filter params (role.id=af10f9c70a5d4fcb999f273845290676, scope.project.id=88613722e7dc4950b5e47a1d92331575, user.id=8d60d62d14cd4042ab1bff5509e30f5c) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:57.970584 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c9f18-92f9-48f6-980e-da47ce6c6ccd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:57.972875 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c9f18-92f9-48f6-980e-da47ce6c6ccd None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:57.985536 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 243/507] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:28:57 2022] GET /identity/v3/role_assignments?user.id=8d60d62d14cd4042ab1bff5509e30f5c&scope.project.id=88613722e7dc4950b5e47a1d92331575&role.id=af10f9c70a5d4fcb999f273845290676 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:28:57.995696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-9da289eb-d220-44cf-9d39-3016314c5850 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:57.995696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:57.995696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:57.995696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:57.995696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:57.995696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:57.995696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:57.995696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:57.995696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:57.995696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:57.995696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:57.995696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:57.995696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:57.995696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:57.995696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:57.995696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:57.996820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:57.996820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:57.996820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:57.996820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:57.996820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:57.996820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:57.996820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:57.996820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:57.996820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:57.996820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:57.996820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:57.996820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:57.996820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:57.996820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:57.996820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:57.996820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:57.996820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:57.997894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:57.997894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:57.997894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:57.997894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 265/508] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:58.004764 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c9f18-92f9-48f6-980e-da47ce6c6ccd None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:58.026073 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da289eb-d220-44cf-9d39-3016314c5850 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:58.048877 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:58.205018 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c9f18-92f9-48f6-980e-da47ce6c6ccd None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:58.222814 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:58.228650 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da289eb-d220-44cf-9d39-3016314c5850 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:58.252946 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c685f27-6897-4e55-a2fa-6b9fd23f77a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:58.253960 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c685f27-6897-4e55-a2fa-6b9fd23f77a7 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:58.254449 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c685f27-6897-4e55-a2fa-6b9fd23f77a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:58.254953 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c685f27-6897-4e55-a2fa-6b9fd23f77a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:58.255797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c685f27-6897-4e55-a2fa-6b9fd23f77a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:58.256300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c685f27-6897-4e55-a2fa-6b9fd23f77a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:58.257895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c685f27-6897-4e55-a2fa-6b9fd23f77a7 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:58.267269 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02974df0-cdd0-4400-8366-23e93d3aff9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:58.267903 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02974df0-cdd0-4400-8366-23e93d3aff9e None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:58.268177 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02974df0-cdd0-4400-8366-23e93d3aff9e None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:58.268442 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02974df0-cdd0-4400-8366-23e93d3aff9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:58.274177 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 244/509] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:58.281868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02974df0-cdd0-4400-8366-23e93d3aff9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:58.282144 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c685f27-6897-4e55-a2fa-6b9fd23f77a7 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:58.282602 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02974df0-cdd0-4400-8366-23e93d3aff9e None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:58.299379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-02974df0-cdd0-4400-8366-23e93d3aff9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:58.299379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:58.299379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:58.299379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:58.299379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:58.299379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:58.299379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:58.299379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:58.299379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:58.299379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:58.299379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:58.299379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:58.299379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:58.299379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:58.299379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:58.299379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:58.300336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:58.300336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:58.300336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:58.300336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:58.300336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:58.300336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:58.300336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:58.300336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:58.300336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:58.300336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:58.300336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:58.300336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:58.300336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:58.300336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:58.300336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:58.300336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:58.300336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:58.301213 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:58.301213 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:58.301213 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:58.301213 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 266/510] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:28:58.307107 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02974df0-cdd0-4400-8366-23e93d3aff9e None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:58.409344 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:58.412006 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c685f27-6897-4e55-a2fa-6b9fd23f77a7 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:58.450965 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5705b7-ffe0-4e60-bc23-1875440873ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:58.451600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5705b7-ffe0-4e60-bc23-1875440873ad None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:58.451877 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5705b7-ffe0-4e60-bc23-1875440873ad None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:58.452662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5705b7-ffe0-4e60-bc23-1875440873ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:58.460718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5705b7-ffe0-4e60-bc23-1875440873ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:58.462189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5705b7-ffe0-4e60-bc23-1875440873ad None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:58.478111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-3e5705b7-ffe0-4e60-bc23-1875440873ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 14:28:58.478111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:58.478111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:58.478111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:58.478111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:58.478111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:58.478111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:58.478111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:58.478111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:58.478111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:58.478111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:58.478111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:58.478111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:28:58.478111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:28:58.478111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:28:58.478111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:28:58.479049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:58.479049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:58.479049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:28:58.479049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:58.479049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:28:58.479049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:28:58.479049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:58.479049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:58.479049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:58.479049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:58.479049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:58.479049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:58.479049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:58.479049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:58.479049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:58.479049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:58.479049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:58.479049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:58.479961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:58.479961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:58.479961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:28:58.479961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:28:58.479961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:28:58.479961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:28:58.479961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:28:58.479961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:28:58.479961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 14:28:58.479961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:58.479961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 245/511] 10.222.0.17 () {56 vars in 1093 bytes} [Thu Oct 20 14:28:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:58.482197 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02974df0-cdd0-4400-8366-23e93d3aff9e None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:58.485677 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5705b7-ffe0-4e60-bc23-1875440873ad None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:58.524660 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:58.538922 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea87e3-d380-4607-b6c6-0fcb340774aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:58.539526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea87e3-d380-4607-b6c6-0fcb340774aa None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:58.539804 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea87e3-d380-4607-b6c6-0fcb340774aa None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:58.540121 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea87e3-d380-4607-b6c6-0fcb340774aa None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:58.540929 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea87e3-d380-4607-b6c6-0fcb340774aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:58.541235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea87e3-d380-4607-b6c6-0fcb340774aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:58.542943 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea87e3-d380-4607-b6c6-0fcb340774aa None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:58.559264 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 267/512] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:58.565587 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b056be-10b3-4a8c-b35c-fc5f4314888f None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:58.566535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b056be-10b3-4a8c-b35c-fc5f4314888f None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:58.567012 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b056be-10b3-4a8c-b35c-fc5f4314888f None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:58.568733 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 268/513] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:58.569610 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b056be-10b3-4a8c-b35c-fc5f4314888f None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:58.602490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5705b7-ffe0-4e60-bc23-1875440873ad None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:58.642405 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf24a1-28ba-440d-a252-47a6407f5936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:58.643541 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf24a1-28ba-440d-a252-47a6407f5936 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:58.643997 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf24a1-28ba-440d-a252-47a6407f5936 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:58.644723 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf24a1-28ba-440d-a252-47a6407f5936 None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:58.645885 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf24a1-28ba-440d-a252-47a6407f5936 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:58.646367 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf24a1-28ba-440d-a252-47a6407f5936 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:58.647981 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf24a1-28ba-440d-a252-47a6407f5936 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:58.673972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 246/514] 10.222.0.17 () {56 vars in 1133 bytes} [Thu Oct 20 14:28:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:58.673972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7a71c-5780-442d-af0b-3db0a4c7f5eb None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:58.673972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7a71c-5780-442d-af0b-3db0a4c7f5eb None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:58.673972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7a71c-5780-442d-af0b-3db0a4c7f5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:58.694145 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b056be-10b3-4a8c-b35c-fc5f4314888f None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:58.700672 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-a9d7a71c-5780-442d-af0b-3db0a4c7f5eb None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:58.702696 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a9d7a71c-5780-442d-af0b-3db0a4c7f5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:58.725141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:58.740575 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3755d-41a3-4bee-a390-db3207d7c359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:58.741113 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3755d-41a3-4bee-a390-db3207d7c359 None admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:58.741396 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3755d-41a3-4bee-a390-db3207d7c359 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:58.741673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3755d-41a3-4bee-a390-db3207d7c359 None admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:58.742781 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3755d-41a3-4bee-a390-db3207d7c359 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:58.744538 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3755d-41a3-4bee-a390-db3207d7c359 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:58.777887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 269/515] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Oct 20 14:28:58 2022] POST /identity/v3/users => generated 254 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:28:58.777887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3755d-41a3-4bee-a390-db3207d7c359 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:58.807763 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 247/516] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:58.956053 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3755d-41a3-4bee-a390-db3207d7c359 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:58.994284 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626087f-d55f-4185-9393-d36fc36012eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:58.995250 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626087f-d55f-4185-9393-d36fc36012eb None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:58.995743 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626087f-d55f-4185-9393-d36fc36012eb None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:58.996205 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626087f-d55f-4185-9393-d36fc36012eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:59.008056 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626087f-d55f-4185-9393-d36fc36012eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:59.009820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626087f-d55f-4185-9393-d36fc36012eb None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:59.025330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-5626087f-d55f-4185-9393-d36fc36012eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:59.025330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:59.025330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:59.025330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:59.025330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:59.025330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:59.025330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:59.025330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:59.025330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:59.025330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:59.025330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:59.025330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:59.025330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:28:59.025330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:28:59.025330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:28:59.025330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:28:59.026337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:59.026337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:59.026337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:59.026337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:59.026337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:59.026337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:59.026337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:59.026337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:59.026337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:59.026337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:59.026337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:59.026337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:59.026337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:59.026337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:59.026337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:59.026337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:59.026337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:28:59.027285 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:28:59.027285 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:28:59.027285 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:59.029354 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 270/517] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:59.035116 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7a71c-5780-442d-af0b-3db0a4c7f5eb None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:59.057662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:59.138514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7a71c-5780-442d-af0b-3db0a4c7f5eb None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:59.153587 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626087f-d55f-4185-9393-d36fc36012eb None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:59.194142 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1228c8-5d30-4686-a1bb-31efa1d8c340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:59.194794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1228c8-5d30-4686-a1bb-31efa1d8c340 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:59.195057 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1228c8-5d30-4686-a1bb-31efa1d8c340 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:59.195326 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1228c8-5d30-4686-a1bb-31efa1d8c340 None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:59.195976 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1228c8-5d30-4686-a1bb-31efa1d8c340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:59.196285 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1228c8-5d30-4686-a1bb-31efa1d8c340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:59.198135 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1228c8-5d30-4686-a1bb-31efa1d8c340 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:59.212582 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:59.219323 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 248/518] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:59.224683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1228c8-5d30-4686-a1bb-31efa1d8c340 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:59.303448 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626087f-d55f-4185-9393-d36fc36012eb None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:59.312834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:59.333126 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1228c8-5d30-4686-a1bb-31efa1d8c340 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:59.343575 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f62108-6905-4fa2-a608-e122d06efcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:59.344512 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f62108-6905-4fa2-a608-e122d06efcae None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:59.345085 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f62108-6905-4fa2-a608-e122d06efcae None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:59.345550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f62108-6905-4fa2-a608-e122d06efcae None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:59.346353 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f62108-6905-4fa2-a608-e122d06efcae None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:59.348050 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f62108-6905-4fa2-a608-e122d06efcae None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:59.359773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-43f62108-6905-4fa2-a608-e122d06efcae None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 14:28:59.359773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:59.359773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:28:59.359773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:28:59.359773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:28:59.359773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:28:59.359773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:28:59.359773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:28:59.359773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 14:28:59.359773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:59.359773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:28:59.359773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:59.359773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:59.359773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:59.359773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:59.359773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:59.359773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:59.360750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:59.360750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:59.360750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:59.360750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:59.360750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:59.360750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:59.360750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:28:59.360750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:28:59.360750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:28:59.360750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:28:59.360750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:59.360750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:59.360750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:59.360750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:59.360750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:59.360750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:59.361569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:59.361569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:59.361569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:59.361569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:59.361569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:59.361569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:59.361569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:59.361569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:59.361569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:59.361569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:59.361569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:28:59.361569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:28:59.361569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 14:28:59.361569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:28:59.364433 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 271/519] 10.222.0.17 () {56 vars in 1129 bytes} [Thu Oct 20 14:28:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:59.365871 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c15be0-5bd4-438b-857b-2c61993929a7 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:59.366357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c15be0-5bd4-438b-857b-2c61993929a7 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:59.366837 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c15be0-5bd4-438b-857b-2c61993929a7 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:59.368232 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 272/520] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:28:59.370266 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c15be0-5bd4-438b-857b-2c61993929a7 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:59.374016 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdcae7-d255-4fe9-acfb-f77954952df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:59.374834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdcae7-d255-4fe9-acfb-f77954952df8 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:59.375117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdcae7-d255-4fe9-acfb-f77954952df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:59.375388 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdcae7-d255-4fe9-acfb-f77954952df8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:59.382599 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdcae7-d255-4fe9-acfb-f77954952df8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:59.384133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdcae7-d255-4fe9-acfb-f77954952df8 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:59.397050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-50fdcae7-d255-4fe9-acfb-f77954952df8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:59.397050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:28:59.397050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:28:59.397050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:28:59.397050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:28:59.397050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:28:59.397050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:28:59.397050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:28:59.397050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:28:59.397050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:28:59.397050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:28:59.397050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:28:59.397050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:28:59.397050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:28:59.397050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:28:59.397995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:28:59.397995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:28:59.397995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:28:59.397995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:28:59.397995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:28:59.397995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:28:59.397995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:28:59.397995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:28:59.397995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:28:59.397995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:28:59.397995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:28:59.397995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:28:59.397995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:28:59.397995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:28:59.397995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:28:59.397995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:28:59.397995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:28:59.398883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:28:59.398883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:28:59.398883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:28:59.398883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:28:59.398883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:28:59.398883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:28:59.398883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:28:59.398883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:28:59.398883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 249/521] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:28:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:28:59.399793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac4e38-fbb4-439d-a964-7fa16085a13c None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:59.399948 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac4e38-fbb4-439d-a964-7fa16085a13c None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:59.404726 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac4e38-fbb4-439d-a964-7fa16085a13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:59.424699 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-fbac4e38-fbb4-439d-a964-7fa16085a13c None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:28:59.426048 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-fbac4e38-fbb4-439d-a964-7fa16085a13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:28:59.481507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:59.490745 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c15be0-5bd4-438b-857b-2c61993929a7 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:59.496623 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 250/522] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:28:59.497294 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac4e38-fbb4-439d-a964-7fa16085a13c None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:59.532347 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4070de1-a09a-4b27-a068-5d8b489fddce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:59.533395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4070de1-a09a-4b27-a068-5d8b489fddce None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:59.533954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4070de1-a09a-4b27-a068-5d8b489fddce None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:59.534468 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4070de1-a09a-4b27-a068-5d8b489fddce None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:59.535285 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4070de1-a09a-4b27-a068-5d8b489fddce None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:59.535775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4070de1-a09a-4b27-a068-5d8b489fddce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:59.537351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4070de1-a09a-4b27-a068-5d8b489fddce None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:59.542849 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 273/523] 10.222.0.17 () {56 vars in 1124 bytes} [Thu Oct 20 14:28:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:59.556231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4070de1-a09a-4b27-a068-5d8b489fddce None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:59.576533 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:59.608993 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac4e38-fbb4-439d-a964-7fa16085a13c None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:59.645237 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedbae4-2e64-4788-b4ee-708fa2e12a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:59.645867 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedbae4-2e64-4788-b4ee-708fa2e12a17 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:59.646158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedbae4-2e64-4788-b4ee-708fa2e12a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:59.646433 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedbae4-2e64-4788-b4ee-708fa2e12a17 None admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:59.647130 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedbae4-2e64-4788-b4ee-708fa2e12a17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:59.647490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedbae4-2e64-4788-b4ee-708fa2e12a17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:59.648977 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedbae4-2e64-4788-b4ee-708fa2e12a17 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:59.662670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 251/524] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:28:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:59.668482 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedbae4-2e64-4788-b4ee-708fa2e12a17 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:59.684958 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4070de1-a09a-4b27-a068-5d8b489fddce None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:59.729219 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02278560-f50f-403c-96c6-858de3f64437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:59.729837 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02278560-f50f-403c-96c6-858de3f64437 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:59.730360 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02278560-f50f-403c-96c6-858de3f64437 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:59.730697 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02278560-f50f-403c-96c6-858de3f64437 None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:59.731333 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02278560-f50f-403c-96c6-858de3f64437 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:28:59.731635 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02278560-f50f-403c-96c6-858de3f64437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:59.733137 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02278560-f50f-403c-96c6-858de3f64437 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:59.739247 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 274/525] 10.222.0.17 () {56 vars in 1124 bytes} [Thu Oct 20 14:28:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:28:59.831461 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedbae4-2e64-4788-b4ee-708fa2e12a17 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:28:59.863056 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:28:59.865764 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02278560-f50f-403c-96c6-858de3f64437 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:28:59.883045 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13d238-d19a-46ca-9530-ec3821a7e4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:28:59.884143 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13d238-d19a-46ca-9530-ec3821a7e4a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:28:59.884623 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13d238-d19a-46ca-9530-ec3821a7e4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:28:59.885092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13d238-d19a-46ca-9530-ec3821a7e4a5 None admin] PATH_INFO: `/v3/projects/88613722e7dc4950b5e47a1d92331575/users/172b859c0d774c8f8a98ce23bdc237d5/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:28:59.887368 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13d238-d19a-46ca-9530-ec3821a7e4a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=88613722e7dc4950b5e47a1d92331575, user_id=172b859c0d774c8f8a98ce23bdc237d5, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:28:59.892157 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13d238-d19a-46ca-9530-ec3821a7e4a5 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:28:59.916808 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 252/526] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:28:59 2022] PUT /identity/v3/projects/88613722e7dc4950b5e47a1d92331575/users/172b859c0d774c8f8a98ce23bdc237d5/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:28:59.924616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:00.011082 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02278560-f50f-403c-96c6-858de3f64437 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:00.049679 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56247d14-0ad6-418c-b5a5-d8a5548bbfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:00.050761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56247d14-0ad6-418c-b5a5-d8a5548bbfcb None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:00.051243 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56247d14-0ad6-418c-b5a5-d8a5548bbfcb None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:00.051709 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56247d14-0ad6-418c-b5a5-d8a5548bbfcb None admin] PATH_INFO: `/v3/services/network` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:00.052497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56247d14-0ad6-418c-b5a5-d8a5548bbfcb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:00.054382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56247d14-0ad6-418c-b5a5-d8a5548bbfcb None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:00.064497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-56247d14-0ad6-418c-b5a5-d8a5548bbfcb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 14:29:00.064497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:00.064497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:00.064497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:00.064497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:00.064497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:00.064497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:00.064497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:00.064497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 14:29:00.064497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:00.064497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:00.064497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:00.064497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:00.064497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:00.064497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:00.064497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:00.064497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:00.065532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:00.065532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:00.065532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:00.065532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:00.065532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:00.065532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:00.065532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:00.065532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:00.065532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:00.065532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:00.065532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:00.065532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:00.065532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:00.065532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:00.065532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:00.065532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:00.066460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:00.066460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:00.066460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:00.066460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:00.066460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:00.066460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:00.066460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:00.066460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:00.066460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:00.066460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:00.066460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:00.066460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:00.066460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 14:29:00.066460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:00.069315 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 275/527] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:28:59 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:00.075482 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13d238-d19a-46ca-9530-ec3821a7e4a5 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:00.185736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13d238-d19a-46ca-9530-ec3821a7e4a5 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:00.222530 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64f9a6-3853-492d-a6d9-7497d6c147aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:00.223507 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64f9a6-3853-492d-a6d9-7497d6c147aa None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:00.223983 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64f9a6-3853-492d-a6d9-7497d6c147aa None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:00.224447 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64f9a6-3853-492d-a6d9-7497d6c147aa None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:00.225265 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64f9a6-3853-492d-a6d9-7497d6c147aa None admin] RBAC: Adding query filter params (name=network) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:00.225760 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64f9a6-3853-492d-a6d9-7497d6c147aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:00.227433 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64f9a6-3853-492d-a6d9-7497d6c147aa None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:00.232397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 253/528] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Oct 20 14:29:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:00.238252 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56247d14-0ad6-418c-b5a5-d8a5548bbfcb None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:00.330320 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:00.342698 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56247d14-0ad6-418c-b5a5-d8a5548bbfcb None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:00.378450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632cf37-03cb-43c9-a77d-ab177635a18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:00.379418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632cf37-03cb-43c9-a77d-ab177635a18a None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:00.379894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632cf37-03cb-43c9-a77d-ab177635a18a None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:00.380362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632cf37-03cb-43c9-a77d-ab177635a18a None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:00.381176 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632cf37-03cb-43c9-a77d-ab177635a18a None admin] RBAC: Adding query filter params (type=network) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:00.381709 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632cf37-03cb-43c9-a77d-ab177635a18a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:00.383294 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632cf37-03cb-43c9-a77d-ab177635a18a None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:00.388260 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 276/529] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Oct 20 14:29:00 2022] GET /identity/v3/services?type=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:00.559778 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472f6a6-42e1-4cf2-8e73-4ba6118c6800 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:00.560430 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472f6a6-42e1-4cf2-8e73-4ba6118c6800 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:00.560923 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472f6a6-42e1-4cf2-8e73-4ba6118c6800 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:00.563167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 254/530] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:00.568699 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf4c58-a8f4-482c-8d4f-cc8709bf412e None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:00.568988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf4c58-a8f4-482c-8d4f-cc8709bf412e None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:00.569263 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf4c58-a8f4-482c-8d4f-cc8709bf412e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:00.587727 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-1abf4c58-a8f4-482c-8d4f-cc8709bf412e None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:00.588907 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-1abf4c58-a8f4-482c-8d4f-cc8709bf412e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:00.661990 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 277/531] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:29:00.954140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472f6a6-42e1-4cf2-8e73-4ba6118c6800 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:01.022601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:01.076376 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472f6a6-42e1-4cf2-8e73-4ba6118c6800 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:01.114742 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f06304-d1cd-4a17-bb50-3e90bdd9c071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:01.115372 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f06304-d1cd-4a17-bb50-3e90bdd9c071 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:01.115653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f06304-d1cd-4a17-bb50-3e90bdd9c071 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:01.115926 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f06304-d1cd-4a17-bb50-3e90bdd9c071 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:01.131571 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f06304-d1cd-4a17-bb50-3e90bdd9c071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:29:01.137225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-30f06304-d1cd-4a17-bb50-3e90bdd9c071 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:29:01.137225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:01.137225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:01.137225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:01.137225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:01.137225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:01.137225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:01.137225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:01.137225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:01.137225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:01.137225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:01.137225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:01.137225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:29:01.137225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:29:01.137225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:29:01.137225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:29:01.138162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:29:01.138162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:29:01.138162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:29:01.138162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:29:01.138162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:01.138162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:01.138162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:01.138162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:01.138162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:01.138162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:01.138162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:01.138162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:01.138162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:01.138162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:01.138162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:01.138162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:01.138978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:01.138978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:01.138978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:01.138978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:01.138978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:29:01.138978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:29:01.138978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:29:01.138978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:29:01.138978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:29:01.138978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:29:01.138978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:29:01.138978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:01.142274 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 255/532] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:29:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:01.148242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf4c58-a8f4-482c-8d4f-cc8709bf412e None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:01.235117 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:01.255742 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf4c58-a8f4-482c-8d4f-cc8709bf412e None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:01.291163 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6df32-98fc-4eea-b964-38fc2980de6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:01.291767 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6df32-98fc-4eea-b964-38fc2980de6e None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:01.292045 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6df32-98fc-4eea-b964-38fc2980de6e None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:01.292373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6df32-98fc-4eea-b964-38fc2980de6e None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:01.293117 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6df32-98fc-4eea-b964-38fc2980de6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:01.293419 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6df32-98fc-4eea-b964-38fc2980de6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:01.294818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6df32-98fc-4eea-b964-38fc2980de6e None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:01.304093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 278/533] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:29:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:01.309622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f06304-d1cd-4a17-bb50-3e90bdd9c071 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:01.414756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f06304-d1cd-4a17-bb50-3e90bdd9c071 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:01.429305 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:01.450448 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffee6f-bc28-493e-9121-130c83413b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:01.451077 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffee6f-bc28-493e-9121-130c83413b46 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:01.451398 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffee6f-bc28-493e-9121-130c83413b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:01.451672 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffee6f-bc28-493e-9121-130c83413b46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:01.463585 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffee6f-bc28-493e-9121-130c83413b46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:01.465119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffee6f-bc28-493e-9121-130c83413b46 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:01.480841 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-06ffee6f-bc28-493e-9121-130c83413b46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:01.480841 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:01.480841 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:01.480841 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:01.480841 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:01.480841 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:01.480841 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:01.480841 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:01.480841 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:01.480841 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:01.480841 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:01.480841 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:01.480841 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:29:01.480841 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:29:01.480841 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:29:01.480841 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:29:01.481799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:01.481799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:01.481799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:01.481799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:01.481799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:01.481799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:01.481799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:01.481799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:01.481799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:01.481799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:01.481799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:01.481799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:01.481799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:01.481799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:01.481799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:01.481799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:01.481799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:29:01.482705 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:29:01.482705 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:01.482705 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:01.482705 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 256/534] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:01.488270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6df32-98fc-4eea-b964-38fc2980de6e None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:01.593263 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6df32-98fc-4eea-b964-38fc2980de6e None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:01.628689 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209a408-d4db-439f-8c06-1d330b245f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:01.629297 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209a408-d4db-439f-8c06-1d330b245f7d None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:01.629574 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209a408-d4db-439f-8c06-1d330b245f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:01.629911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209a408-d4db-439f-8c06-1d330b245f7d None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:01.630547 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209a408-d4db-439f-8c06-1d330b245f7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:01.630848 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209a408-d4db-439f-8c06-1d330b245f7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:01.632231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209a408-d4db-439f-8c06-1d330b245f7d None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:01.644571 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 279/535] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:01.651008 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffee6f-bc28-493e-9121-130c83413b46 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:01.782444 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffee6f-bc28-493e-9121-130c83413b46 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:01.817788 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3499f-cecb-4cc2-ad40-888c09155899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:01.818447 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3499f-cecb-4cc2-ad40-888c09155899 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:01.818723 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3499f-cecb-4cc2-ad40-888c09155899 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:01.818995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3499f-cecb-4cc2-ad40-888c09155899 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:01.827391 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3499f-cecb-4cc2-ad40-888c09155899 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:01.828784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3499f-cecb-4cc2-ad40-888c09155899 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:01.840765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-22a3499f-cecb-4cc2-ad40-888c09155899 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 20 14:29:01.840765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:01.840765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:01.840765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:01.840765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:01.840765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:01.840765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:01.840765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:01.840765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:01.840765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:01.840765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:01.840765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:01.840765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:29:01.840765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:29:01.840765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:29:01.840765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:29:01.841889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:01.841889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:01.841889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:29:01.841889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:01.841889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:29:01.841889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:01.841889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:01.841889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:01.841889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:01.841889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:01.841889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:01.841889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:01.841889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:01.841889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:01.841889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:01.841889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:01.841889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:01.841889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:01.843803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:01.843803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:01.843803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:29:01.843803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:29:01.843803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:29:01.843803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:29:01.843803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:29:01.843803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:29:01.843803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 20 14:29:01.843803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:01.843803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 257/536] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:29:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:01.850957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209a408-d4db-439f-8c06-1d330b245f7d None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:01.858340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:01.890898 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e294d4e-fc72-4ceb-aa43-4883e9e2adcf None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:01.891244 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e294d4e-fc72-4ceb-aa43-4883e9e2adcf None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:01.891438 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e294d4e-fc72-4ceb-aa43-4883e9e2adcf None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:01.892753 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 258/537] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:29:01.902084 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bbca4-bba1-4690-94e5-49d038986e3f None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:01.902360 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bbca4-bba1-4690-94e5-49d038986e3f None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:01.902629 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bbca4-bba1-4690-94e5-49d038986e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:01.950858 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-6a3bbca4-bba1-4690-94e5-49d038986e3f None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:01.952227 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-6a3bbca4-bba1-4690-94e5-49d038986e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:01.966658 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209a408-d4db-439f-8c06-1d330b245f7d None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:02.001827 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:02.004638 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785e37c-cd9b-4b8a-b567-5e52e587fbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:02.005304 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785e37c-cd9b-4b8a-b567-5e52e587fbc8 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:02.005579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785e37c-cd9b-4b8a-b567-5e52e587fbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:02.005874 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785e37c-cd9b-4b8a-b567-5e52e587fbc8 None admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:02.006629 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785e37c-cd9b-4b8a-b567-5e52e587fbc8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:02.006976 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785e37c-cd9b-4b8a-b567-5e52e587fbc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:02.008454 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785e37c-cd9b-4b8a-b567-5e52e587fbc8 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:02.028673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 280/538] 10.222.0.17 () {56 vars in 1135 bytes} [Thu Oct 20 14:29:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:02.035756 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785e37c-cd9b-4b8a-b567-5e52e587fbc8 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:02.100477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 259/539] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 14:29:02.134206 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:02.167348 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785e37c-cd9b-4b8a-b567-5e52e587fbc8 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:02.202732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44d51c-ef88-41ac-826a-0ed079858c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:02.203355 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44d51c-ef88-41ac-826a-0ed079858c03 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:02.203631 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44d51c-ef88-41ac-826a-0ed079858c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:02.203898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44d51c-ef88-41ac-826a-0ed079858c03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:02.214512 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44d51c-ef88-41ac-826a-0ed079858c03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:02.216020 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44d51c-ef88-41ac-826a-0ed079858c03 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:02.230421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-3d44d51c-ef88-41ac-826a-0ed079858c03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:02.230421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:02.230421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:02.230421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:02.230421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:02.230421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:02.230421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:02.230421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:02.230421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:02.230421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:02.230421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:02.230421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:02.230421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:29:02.230421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:29:02.230421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:29:02.230421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:29:02.231357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:02.231357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:02.231357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:02.231357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:02.231357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:02.231357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:02.231357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:02.231357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:02.231357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:02.231357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:02.231357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:02.231357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:02.231357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:02.231357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:02.231357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:02.231357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:02.231357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:29:02.232229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:29:02.232229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:02.232229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:02.232229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 281/540] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:29:02.237780 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bbca4-bba1-4690-94e5-49d038986e3f None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:02.377557 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bbca4-bba1-4690-94e5-49d038986e3f None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:02.398482 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44d51c-ef88-41ac-826a-0ed079858c03 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:02.453399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7472f1-78fb-4b86-b220-aaa93c446c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:02.454063 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7472f1-78fb-4b86-b220-aaa93c446c1c None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:02.454346 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7472f1-78fb-4b86-b220-aaa93c446c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:02.454621 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7472f1-78fb-4b86-b220-aaa93c446c1c None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:02.455294 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7472f1-78fb-4b86-b220-aaa93c446c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:02.455594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7472f1-78fb-4b86-b220-aaa93c446c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:02.457032 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7472f1-78fb-4b86-b220-aaa93c446c1c None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:02.491729 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 260/541] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:02.495371 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7472f1-78fb-4b86-b220-aaa93c446c1c None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:02.535643 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:02.571490 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44d51c-ef88-41ac-826a-0ed079858c03 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:02.598220 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:02.610537 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399865bd-39af-44f3-8e83-9b731854f4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:02.611186 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399865bd-39af-44f3-8e83-9b731854f4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:02.611474 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399865bd-39af-44f3-8e83-9b731854f4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:02.611753 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399865bd-39af-44f3-8e83-9b731854f4a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:02.623432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399865bd-39af-44f3-8e83-9b731854f4a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:29:02.629723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-399865bd-39af-44f3-8e83-9b731854f4a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:29:02.629723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:02.629723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:02.629723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:02.629723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:02.629723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:02.629723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:02.629723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:02.629723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:02.629723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:02.629723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:02.629723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:02.629723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:29:02.629723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:29:02.629723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:29:02.629723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:29:02.630662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:29:02.630662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:29:02.630662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:29:02.630662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:29:02.630662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:02.630662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:02.630662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:02.630662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:02.630662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:02.630662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:02.630662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:02.630662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:02.630662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:02.630662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:02.630662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:02.630662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:02.631479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:02.631479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:02.631479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:02.631479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:02.631479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:29:02.631479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:29:02.631479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:29:02.631479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:29:02.631479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:29:02.631479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:29:02.631479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:29:02.631479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:02.631479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 282/542] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Oct 20 14:29:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:29:02.638256 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399865bd-39af-44f3-8e83-9b731854f4a9 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:02.676374 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7472f1-78fb-4b86-b220-aaa93c446c1c None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:02.711253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c0e43-43de-478c-aae7-4d07b83bc51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:02.711884 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c0e43-43de-478c-aae7-4d07b83bc51f None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:02.712161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c0e43-43de-478c-aae7-4d07b83bc51f None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:02.712432 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c0e43-43de-478c-aae7-4d07b83bc51f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:02.719776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c0e43-43de-478c-aae7-4d07b83bc51f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:02.721207 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c0e43-43de-478c-aae7-4d07b83bc51f None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:02.732775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-615c0e43-43de-478c-aae7-4d07b83bc51f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:29:02.732775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:02.732775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:02.732775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:02.732775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:02.732775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:02.732775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:02.732775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:02.732775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:02.732775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:02.732775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:02.732775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:02.732775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:29:02.732775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:29:02.732775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:29:02.733793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:29:02.733793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:02.733793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:02.733793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:02.733793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:02.733793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:02.733793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:02.733793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:02.733793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:02.733793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:02.733793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:02.733793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:02.733793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:02.733793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:02.733793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:02.733793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:02.733793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:02.734855 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:29:02.734855 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:29:02.734855 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:29:02.734855 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:29:02.734855 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:29:02.734855 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:29:02.734855 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:29:02.734855 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:02.737963 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 261/543] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:29:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:02.739240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727fd34-d587-459b-b0f5-2cef296638ef None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:02.739498 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727fd34-d587-459b-b0f5-2cef296638ef None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:02.739764 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727fd34-d587-459b-b0f5-2cef296638ef None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:02.741010 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 262/544] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:02.746879 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727fd34-d587-459b-b0f5-2cef296638ef None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:02.753377 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399865bd-39af-44f3-8e83-9b731854f4a9 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:02.790960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579fc7b-b6da-4d54-9dbe-35d8681b3520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:02.791677 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579fc7b-b6da-4d54-9dbe-35d8681b3520 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:02.791960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579fc7b-b6da-4d54-9dbe-35d8681b3520 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:02.792233 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579fc7b-b6da-4d54-9dbe-35d8681b3520 None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:02.793337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579fc7b-b6da-4d54-9dbe-35d8681b3520 None admin] RBAC: Adding query filter params (name=service) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:02.793791 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579fc7b-b6da-4d54-9dbe-35d8681b3520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:02.795231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579fc7b-b6da-4d54-9dbe-35d8681b3520 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:02.805333 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 283/545] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Oct 20 14:29:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:02.806639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbcc59-8637-4373-8d70-a581d880de2d None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:02.806928 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbcc59-8637-4373-8d70-a581d880de2d None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:02.807300 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbcc59-8637-4373-8d70-a581d880de2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:02.828449 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-bbdbcc59-8637-4373-8d70-a581d880de2d None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:02.829724 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-bbdbcc59-8637-4373-8d70-a581d880de2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:02.830214 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:02.855136 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727fd34-d587-459b-b0f5-2cef296638ef None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:02.870804 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:02.896717 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068166e-aa1d-4487-b103-beeaeba9fb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:02.897436 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068166e-aa1d-4487-b103-beeaeba9fb2f None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:02.897787 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068166e-aa1d-4487-b103-beeaeba9fb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:02.898148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068166e-aa1d-4487-b103-beeaeba9fb2f None admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:02.898919 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068166e-aa1d-4487-b103-beeaeba9fb2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:02.899334 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068166e-aa1d-4487-b103-beeaeba9fb2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:02.900857 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068166e-aa1d-4487-b103-beeaeba9fb2f None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:02.917964 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 263/546] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:29:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:02.918853 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068166e-aa1d-4487-b103-beeaeba9fb2f None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:02.926002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 284/547] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:29:02.926986 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbcc59-8637-4373-8d70-a581d880de2d None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:03.070467 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbcc59-8637-4373-8d70-a581d880de2d None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:03.071394 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068166e-aa1d-4487-b103-beeaeba9fb2f None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:03.106403 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ec2eb-58b5-405e-883d-e564ebea8563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:03.107150 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ec2eb-58b5-405e-883d-e564ebea8563 None admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:03.107446 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ec2eb-58b5-405e-883d-e564ebea8563 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:03.107721 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ec2eb-58b5-405e-883d-e564ebea8563 None admin] PATH_INFO: `/v3/projects/88613722e7dc4950b5e47a1d92331575/users/8d60d62d14cd4042ab1bff5509e30f5c/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:03.111087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1789e2-c3f8-4988-a65a-b9359bd3911a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:03.111579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ec2eb-58b5-405e-883d-e564ebea8563 None admin] RBAC: Authorizing `identity:create_grant(project_id=88613722e7dc4950b5e47a1d92331575, user_id=8d60d62d14cd4042ab1bff5509e30f5c, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:03.111768 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1789e2-c3f8-4988-a65a-b9359bd3911a None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:03.111984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1789e2-c3f8-4988-a65a-b9359bd3911a None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:03.112252 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1789e2-c3f8-4988-a65a-b9359bd3911a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:03.112694 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ec2eb-58b5-405e-883d-e564ebea8563 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:03.115047 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:03.124257 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1789e2-c3f8-4988-a65a-b9359bd3911a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:03.126057 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1789e2-c3f8-4988-a65a-b9359bd3911a None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:03.128570 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 285/548] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:29:02 2022] PUT /identity/v3/projects/88613722e7dc4950b5e47a1d92331575/users/8d60d62d14cd4042ab1bff5509e30f5c/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:29:03.139990 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4525fb6-c87d-4e17-90fd-e580bea754af None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:03.140887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4525fb6-c87d-4e17-90fd-e580bea754af None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:03.141440 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4525fb6-c87d-4e17-90fd-e580bea754af None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:03.143275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-4c1789e2-c3f8-4988-a65a-b9359bd3911a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:03.143275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:03.143275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:03.143275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:03.143275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:03.143275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:03.143275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:03.143275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:03.143275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:03.143275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:03.143275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:03.143275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:03.143275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:29:03.143275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:29:03.143275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:29:03.143275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:29:03.144236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:03.144236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:03.144236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:03.144236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:03.144236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:03.144236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:03.144236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:03.144236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:03.144236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:03.144236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:03.144236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:03.144236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:03.144236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:03.144236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:03.144236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:03.144236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:03.144236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:29:03.145099 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:29:03.145099 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:03.145099 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:03.146032 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 286/549] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:03 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:03.148069 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af23cbe-b4ba-4dbe-9b7d-3ae3b20da9e4 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:03.148579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af23cbe-b4ba-4dbe-9b7d-3ae3b20da9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:03.149270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af23cbe-b4ba-4dbe-9b7d-3ae3b20da9e4 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:03.149395 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 264/550] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:03.150786 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dc3ca-0fad-4a79-ad81-01d76786bc92 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:03.151076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dc3ca-0fad-4a79-ad81-01d76786bc92 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:03.151351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dc3ca-0fad-4a79-ad81-01d76786bc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:03.152054 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 287/551] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:03.153177 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af23cbe-b4ba-4dbe-9b7d-3ae3b20da9e4 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:03.186614 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-314dc3ca-0fad-4a79-ad81-01d76786bc92 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:03.188666 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-314dc3ca-0fad-4a79-ad81-01d76786bc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:03.196778 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:03.275513 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 265/552] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:29:03.277198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29d6b3-559f-42e5-9665-d851a9c27908 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:03.277701 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29d6b3-559f-42e5-9665-d851a9c27908 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:03.278211 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29d6b3-559f-42e5-9665-d851a9c27908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:03.295557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af23cbe-b4ba-4dbe-9b7d-3ae3b20da9e4 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:03.303018 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-be29d6b3-559f-42e5-9665-d851a9c27908 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:03.304483 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-be29d6b3-559f-42e5-9665-d851a9c27908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:03.339383 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277270b-43c5-48f7-9996-0d016c48735b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:03.341582 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277270b-43c5-48f7-9996-0d016c48735b None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:03.341582 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277270b-43c5-48f7-9996-0d016c48735b None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:03.341582 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277270b-43c5-48f7-9996-0d016c48735b None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:03.342052 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277270b-43c5-48f7-9996-0d016c48735b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:03.342767 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277270b-43c5-48f7-9996-0d016c48735b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:03.344399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277270b-43c5-48f7-9996-0d016c48735b None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:03.361883 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 288/553] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:03.361883 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277270b-43c5-48f7-9996-0d016c48735b None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:03.387073 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 266/554] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 14:29:03.388138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29d6b3-559f-42e5-9665-d851a9c27908 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:03.441248 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:03.495687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29d6b3-559f-42e5-9665-d851a9c27908 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:03.515247 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:03.536009 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a149dd-a120-4d15-8e8b-1ae0be98a5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:03.536651 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a149dd-a120-4d15-8e8b-1ae0be98a5fe None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:03.537026 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a149dd-a120-4d15-8e8b-1ae0be98a5fe None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:03.537302 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a149dd-a120-4d15-8e8b-1ae0be98a5fe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:03.539869 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277270b-43c5-48f7-9996-0d016c48735b None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:03.544999 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a149dd-a120-4d15-8e8b-1ae0be98a5fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:03.547012 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a149dd-a120-4d15-8e8b-1ae0be98a5fe None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:03.559737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-64a149dd-a120-4d15-8e8b-1ae0be98a5fe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 14:29:03.559737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:03.559737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:03.559737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:03.559737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:03.559737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:03.559737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:03.559737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:03.559737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:03.559737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:03.559737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:03.559737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:03.559737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:29:03.559737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:29:03.559737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:29:03.559737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:29:03.560695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:03.560695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:03.560695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:29:03.560695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:03.560695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:29:03.560695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:03.560695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:03.560695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:03.560695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:03.560695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:03.560695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:03.560695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:03.560695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:03.560695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:03.560695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:03.560695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:03.560695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:03.560695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:03.562806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:03.562806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:03.562806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:29:03.562806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:29:03.562806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:29:03.562806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:29:03.562806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:29:03.562806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:29:03.562806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 14:29:03.562806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:03.562806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 267/555] 10.222.0.17 () {56 vars in 1117 bytes} [Thu Oct 20 14:29:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:03.562806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a149dd-a120-4d15-8e8b-1ae0be98a5fe None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:03.593187 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923c4d3-2661-4699-9226-1a466e581003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:03.593807 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923c4d3-2661-4699-9226-1a466e581003 None admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:03.594128 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923c4d3-2661-4699-9226-1a466e581003 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:03.594670 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923c4d3-2661-4699-9226-1a466e581003 None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:03.595329 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923c4d3-2661-4699-9226-1a466e581003 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:03.597700 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923c4d3-2661-4699-9226-1a466e581003 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:03.630628 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 289/556] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Oct 20 14:29:03 2022] POST /identity/v3/services => generated 251 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:29:03.631672 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923c4d3-2661-4699-9226-1a466e581003 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:03.733758 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a149dd-a120-4d15-8e8b-1ae0be98a5fe None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:03.755424 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:03.803655 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88b030-32f7-4a1b-840a-006e53b4aad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:03.804562 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88b030-32f7-4a1b-840a-006e53b4aad7 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:03.804844 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88b030-32f7-4a1b-840a-006e53b4aad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:03.805117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88b030-32f7-4a1b-840a-006e53b4aad7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:03.820942 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88b030-32f7-4a1b-840a-006e53b4aad7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:29:03.826630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-9c88b030-32f7-4a1b-840a-006e53b4aad7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:29:03.826630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:03.826630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:03.826630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:03.826630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:03.826630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:03.826630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:03.826630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:03.826630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:03.826630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:03.826630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:03.826630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:03.826630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:29:03.826630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:29:03.826630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:29:03.826630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:29:03.828140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:29:03.828140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:29:03.828140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:29:03.828140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:29:03.828140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:03.828140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:03.828140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:03.828140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:03.828140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:03.828140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:03.828140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:03.828140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:03.828140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:03.828140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:03.828140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:03.828140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:03.829253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:03.829253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:03.829253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:03.829253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:03.829253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:29:03.829253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:29:03.829253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:29:03.829253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:29:03.829253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:29:03.829253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:29:03.829253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:29:03.829253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:03.829253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 268/557] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:29:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:03.829974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88b030-32f7-4a1b-840a-006e53b4aad7 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:03.843045 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923c4d3-2661-4699-9226-1a466e581003 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:03.888904 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f28e5-0b1e-40dd-bf21-2466d142c325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:03.888904 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f28e5-0b1e-40dd-bf21-2466d142c325 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:03.889717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f28e5-0b1e-40dd-bf21-2466d142c325 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:03.889993 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f28e5-0b1e-40dd-bf21-2466d142c325 None admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:03.890693 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f28e5-0b1e-40dd-bf21-2466d142c325 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:03.890989 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f28e5-0b1e-40dd-bf21-2466d142c325 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:03.892411 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f28e5-0b1e-40dd-bf21-2466d142c325 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:03.912722 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 290/558] 10.222.0.17 () {56 vars in 1149 bytes} [Thu Oct 20 14:29:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:03.913953 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f28e5-0b1e-40dd-bf21-2466d142c325 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:03.917917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:03.953319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88b030-32f7-4a1b-840a-006e53b4aad7 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:03.987398 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f370d49-f17e-4da1-aa58-f3567c9b1119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:03.987911 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f370d49-f17e-4da1-aa58-f3567c9b1119 None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:03.988191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f370d49-f17e-4da1-aa58-f3567c9b1119 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:03.988461 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f370d49-f17e-4da1-aa58-f3567c9b1119 None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:03.989115 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f370d49-f17e-4da1-aa58-f3567c9b1119 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:03.990518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f370d49-f17e-4da1-aa58-f3567c9b1119 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:04.007957 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 269/559] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Oct 20 14:29:03 2022] POST /identity/v3/services => generated 240 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:29:04.009068 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f370d49-f17e-4da1-aa58-f3567c9b1119 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:04.034967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f28e5-0b1e-40dd-bf21-2466d142c325 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:04.046207 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:04.118405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0700e-a12c-4357-8751-94f612a3dc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:04.121100 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0700e-a12c-4357-8751-94f612a3dc51 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:04.121620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0700e-a12c-4357-8751-94f612a3dc51 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:04.122746 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0700e-a12c-4357-8751-94f612a3dc51 None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:04.126142 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0700e-a12c-4357-8751-94f612a3dc51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:04.126954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0700e-a12c-4357-8751-94f612a3dc51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:04.129998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0700e-a12c-4357-8751-94f612a3dc51 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:04.152984 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 291/560] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:29:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:04.157379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0700e-a12c-4357-8751-94f612a3dc51 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:04.218461 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f370d49-f17e-4da1-aa58-f3567c9b1119 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:04.262030 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6f029-da38-49a3-94ce-d58d7876f8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:04.262303 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:04.262724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6f029-da38-49a3-94ce-d58d7876f8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:04.263265 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6f029-da38-49a3-94ce-d58d7876f8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:04.263539 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6f029-da38-49a3-94ce-d58d7876f8c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:04.279085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6f029-da38-49a3-94ce-d58d7876f8c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:04.281083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6f029-da38-49a3-94ce-d58d7876f8c4 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:04.300835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-16a6f029-da38-49a3-94ce-d58d7876f8c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:04.300835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:04.300835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:04.300835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:04.300835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:04.300835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:04.300835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:04.300835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:04.300835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:04.300835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:04.300835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:04.300835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:04.300835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:29:04.300835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:29:04.300835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:29:04.300835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:29:04.301797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:04.301797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:04.301797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:04.301797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:04.301797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:04.301797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:04.301797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:04.301797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:04.301797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:04.301797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:04.301797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:04.301797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:04.301797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:04.301797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:04.301797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:04.301797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:04.301797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:29:04.302860 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:29:04.302860 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:04.302860 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:04.302860 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 270/561] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:04.308307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6f029-da38-49a3-94ce-d58d7876f8c4 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:04.315014 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0700e-a12c-4357-8751-94f612a3dc51 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:04.363875 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc421683-97cd-4f07-ae52-b3378fd394aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:04.365149 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc421683-97cd-4f07-ae52-b3378fd394aa None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:04.365634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc421683-97cd-4f07-ae52-b3378fd394aa None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:04.366441 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc421683-97cd-4f07-ae52-b3378fd394aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:04.386057 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc421683-97cd-4f07-ae52-b3378fd394aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:04.388804 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc421683-97cd-4f07-ae52-b3378fd394aa None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:04.409959 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:04.410942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-cc421683-97cd-4f07-ae52-b3378fd394aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:04.410942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:04.410942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:04.410942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:04.410942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:04.410942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:04.410942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:04.410942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:04.410942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:04.410942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:04.410942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:04.410942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:04.410942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:29:04.410942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:29:04.410942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:29:04.410942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:29:04.411823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:04.411823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:04.411823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:04.411823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:04.411823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:04.411823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:04.411823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:04.411823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:04.411823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:04.411823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:04.411823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:04.411823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:04.411823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:04.411823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:04.411823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:04.411823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:04.411823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:29:04.412767 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:29:04.412767 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:04.412767 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:04.419075 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 292/562] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:04.421508 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc421683-97cd-4f07-ae52-b3378fd394aa None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:04.466986 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6f029-da38-49a3-94ce-d58d7876f8c4 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:04.517922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a5cbc-f9a9-40fe-be4a-049cd88c7c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:04.518931 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a5cbc-f9a9-40fe-be4a-049cd88c7c5f None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:04.519411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a5cbc-f9a9-40fe-be4a-049cd88c7c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:04.519901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a5cbc-f9a9-40fe-be4a-049cd88c7c5f None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:04.520739 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a5cbc-f9a9-40fe-be4a-049cd88c7c5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:04.521235 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a5cbc-f9a9-40fe-be4a-049cd88c7c5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:04.522819 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a5cbc-f9a9-40fe-be4a-049cd88c7c5f None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:04.546077 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 271/563] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:04.561233 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a5cbc-f9a9-40fe-be4a-049cd88c7c5f None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:04.566431 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc421683-97cd-4f07-ae52-b3378fd394aa None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:04.581640 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:04.614576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b3996-ba3a-4812-adb3-13d6f7ef0b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:04.615204 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b3996-ba3a-4812-adb3-13d6f7ef0b92 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:04.615488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b3996-ba3a-4812-adb3-13d6f7ef0b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:04.615758 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b3996-ba3a-4812-adb3-13d6f7ef0b92 None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:04.616410 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b3996-ba3a-4812-adb3-13d6f7ef0b92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:04.616720 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b3996-ba3a-4812-adb3-13d6f7ef0b92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:04.618126 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b3996-ba3a-4812-adb3-13d6f7ef0b92 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:04.635231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 293/564] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:04.641835 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b3996-ba3a-4812-adb3-13d6f7ef0b92 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:04.763950 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a5cbc-f9a9-40fe-be4a-049cd88c7c5f None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:04.769325 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b3996-ba3a-4812-adb3-13d6f7ef0b92 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:04.816923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df6075-2717-4d37-93a7-c2a1fe55f462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:04.817558 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df6075-2717-4d37-93a7-c2a1fe55f462 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:04.820177 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df6075-2717-4d37-93a7-c2a1fe55f462 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:04.820460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df6075-2717-4d37-93a7-c2a1fe55f462 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:04.835106 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df6075-2717-4d37-93a7-c2a1fe55f462 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:04.836575 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df6075-2717-4d37-93a7-c2a1fe55f462 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:04.840190 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7b62a-99a1-4628-aca6-060480ea7f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:04.840827 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7b62a-99a1-4628-aca6-060480ea7f4c None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:04.841109 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7b62a-99a1-4628-aca6-060480ea7f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:04.841383 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7b62a-99a1-4628-aca6-060480ea7f4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:04.846169 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:04.855729 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7b62a-99a1-4628-aca6-060480ea7f4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:04.859976 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7b62a-99a1-4628-aca6-060480ea7f4c None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:04.864063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-49df6075-2717-4d37-93a7-c2a1fe55f462 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 14:29:04.864063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:04.864063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:04.864063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:04.864063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:04.864063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:04.864063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:04.864063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:04.864063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:04.864063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:04.864063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:04.864063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:04.864063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:29:04.864063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:29:04.864063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:29:04.864063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:29:04.864967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:04.864967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:04.864967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:29:04.864967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:04.864967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:29:04.864967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:04.864967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:04.864967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:04.864967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:04.864967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:04.864967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:04.864967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:04.864967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:04.864967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:04.864967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:04.864967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:04.864967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:04.864967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:04.865902 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:04.865902 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:04.865902 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:29:04.865902 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:29:04.865902 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:29:04.865902 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:29:04.865902 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:29:04.865902 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:29:04.865902 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 14:29:04.865902 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:04.865902 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 294/565] 10.222.0.17 () {56 vars in 1093 bytes} [Thu Oct 20 14:29:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:04.880494 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df6075-2717-4d37-93a7-c2a1fe55f462 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:04.883429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-ccd7b62a-99a1-4628-aca6-060480ea7f4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:29:04.883429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:04.883429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:04.883429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:04.883429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:04.883429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:04.883429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:04.883429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:04.883429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:04.883429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:04.883429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:04.883429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:04.883429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:29:04.883429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:29:04.883429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:29:04.884445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:29:04.884445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:04.884445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:04.884445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:04.884445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:04.884445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:04.884445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:04.884445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:04.884445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:04.884445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:04.884445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:04.884445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:04.884445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:04.884445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:04.884445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:04.884445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:04.884445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:04.885359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:29:04.885359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:29:04.885359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:29:04.885359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:29:04.885359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:29:04.885359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:29:04.885359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:29:04.885359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:04.885359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 272/566] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:29:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:29:04.892127 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7b62a-99a1-4628-aca6-060480ea7f4c None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:04.951450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:05.073935 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df6075-2717-4d37-93a7-c2a1fe55f462 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:05.077946 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7b62a-99a1-4628-aca6-060480ea7f4c None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:05.141262 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf19bdd-9e5e-459d-977d-81915c366aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:05.141887 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf19bdd-9e5e-459d-977d-81915c366aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:05.142752 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf19bdd-9e5e-459d-977d-81915c366aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:05.143037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf19bdd-9e5e-459d-977d-81915c366aa2 None admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:05.143735 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf19bdd-9e5e-459d-977d-81915c366aa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:05.144040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf19bdd-9e5e-459d-977d-81915c366aa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:05.145468 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf19bdd-9e5e-459d-977d-81915c366aa2 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:05.149572 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9ae6d-2f7d-4f20-bb1f-08325a02c79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:05.150235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9ae6d-2f7d-4f20-bb1f-08325a02c79c None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:05.150511 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9ae6d-2f7d-4f20-bb1f-08325a02c79c None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:05.150779 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9ae6d-2f7d-4f20-bb1f-08325a02c79c None admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:05.151499 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9ae6d-2f7d-4f20-bb1f-08325a02c79c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:05.151797 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9ae6d-2f7d-4f20-bb1f-08325a02c79c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:05.153244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9ae6d-2f7d-4f20-bb1f-08325a02c79c None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:05.176542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 273/567] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:29:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:05.180492 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 295/568] 10.222.0.17 () {56 vars in 1133 bytes} [Thu Oct 20 14:29:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:05.186017 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf19bdd-9e5e-459d-977d-81915c366aa2 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:05.187960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9ae6d-2f7d-4f20-bb1f-08325a02c79c None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:05.296627 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:05.367790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:05.372032 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf19bdd-9e5e-459d-977d-81915c366aa2 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:05.386778 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9ae6d-2f7d-4f20-bb1f-08325a02c79c None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:05.440562 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd914f-4582-4418-917e-c6b529eafe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:05.441463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd914f-4582-4418-917e-c6b529eafe1e None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:05.442262 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd914f-4582-4418-917e-c6b529eafe1e None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:05.443158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd914f-4582-4418-917e-c6b529eafe1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:05.447283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a45cae-841c-41b2-9a7b-b60a00901189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:05.448069 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a45cae-841c-41b2-9a7b-b60a00901189 None admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:05.448353 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a45cae-841c-41b2-9a7b-b60a00901189 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:05.448624 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a45cae-841c-41b2-9a7b-b60a00901189 None admin] PATH_INFO: `/v3/projects/88613722e7dc4950b5e47a1d92331575/users/a1bdbce1b3d047cfa5ddf72f902ecd5d/roles/af10f9c70a5d4fcb999f273845290676` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:05.478711 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a45cae-841c-41b2-9a7b-b60a00901189 None admin] RBAC: Authorizing `identity:create_grant(project_id=88613722e7dc4950b5e47a1d92331575, user_id=a1bdbce1b3d047cfa5ddf72f902ecd5d, role_id=af10f9c70a5d4fcb999f273845290676)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:05.481090 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a45cae-841c-41b2-9a7b-b60a00901189 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:05.507871 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 296/569] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:29:05 2022] PUT /identity/v3/projects/88613722e7dc4950b5e47a1d92331575/users/a1bdbce1b3d047cfa5ddf72f902ecd5d/roles/af10f9c70a5d4fcb999f273845290676 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:29:05.562166 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd914f-4582-4418-917e-c6b529eafe1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:05.564074 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd914f-4582-4418-917e-c6b529eafe1e None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:05.653106 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:05.713102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 274/570] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:29:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 14:29:05.719209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a45cae-841c-41b2-9a7b-b60a00901189 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:05.762673 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38bd28-ad35-4909-978e-3584f723b9ac None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:05.763239 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38bd28-ad35-4909-978e-3584f723b9ac None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:05.763719 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38bd28-ad35-4909-978e-3584f723b9ac None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:05.766025 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 275/571] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:29:05.771617 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20cbef-7617-4e69-8e7a-18c1012cd85e None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:05.772175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20cbef-7617-4e69-8e7a-18c1012cd85e None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:05.772653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20cbef-7617-4e69-8e7a-18c1012cd85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:05.797412 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-3e20cbef-7617-4e69-8e7a-18c1012cd85e None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:05.799008 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-3e20cbef-7617-4e69-8e7a-18c1012cd85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:05.838866 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a45cae-841c-41b2-9a7b-b60a00901189 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:05.879807 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f105f9-70f3-4ddb-92cb-29fda8142ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:05.881348 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f105f9-70f3-4ddb-92cb-29fda8142ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:05.881892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f105f9-70f3-4ddb-92cb-29fda8142ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:05.882445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f105f9-70f3-4ddb-92cb-29fda8142ff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:05.895541 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f105f9-70f3-4ddb-92cb-29fda8142ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:05.897287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f105f9-70f3-4ddb-92cb-29fda8142ff2 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:05.899810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:05.917717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-e5f105f9-70f3-4ddb-92cb-29fda8142ff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:05.917717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:05.917717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:05.917717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:05.917717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:05.917717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:05.917717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:05.917717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:05.917717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:05.917717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:05.917717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:05.917717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:05.917717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:29:05.917717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:29:05.917717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:29:05.917717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:29:05.918776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:05.918776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:05.918776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:05.918776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:05.918776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:05.918776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:05.918776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:05.918776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:05.918776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:05.918776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:05.918776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:05.918776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:05.918776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:05.918776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:05.918776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:05.918776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:05.918776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:29:05.919666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:29:05.919666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:05.919666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:05.922897 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 297/572] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:05.927902 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f105f9-70f3-4ddb-92cb-29fda8142ff2 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:05.950195 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 276/573] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 14:29:06.059981 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2743dc3-3be6-4393-87c1-2b57b8690640 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:06.060638 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2743dc3-3be6-4393-87c1-2b57b8690640 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:06.061353 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2743dc3-3be6-4393-87c1-2b57b8690640 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:06.063079 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 277/574] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:29:06.064818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f105f9-70f3-4ddb-92cb-29fda8142ff2 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:06.076901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04564c-fdd6-4e6d-82dc-a2edd994f9a7 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:06.077377 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04564c-fdd6-4e6d-82dc-a2edd994f9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:06.077505 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04564c-fdd6-4e6d-82dc-a2edd994f9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:06.115036 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e58cf0-e285-4e8b-9ca0-1a4197ce90a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:06.116007 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e58cf0-e285-4e8b-9ca0-1a4197ce90a0 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:06.116487 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e58cf0-e285-4e8b-9ca0-1a4197ce90a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:06.116954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e58cf0-e285-4e8b-9ca0-1a4197ce90a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:06.117894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e58cf0-e285-4e8b-9ca0-1a4197ce90a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:06.118442 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e58cf0-e285-4e8b-9ca0-1a4197ce90a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:06.120024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e58cf0-e285-4e8b-9ca0-1a4197ce90a0 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:06.121144 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-da04564c-fdd6-4e6d-82dc-a2edd994f9a7 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:06.122564 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-da04564c-fdd6-4e6d-82dc-a2edd994f9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:06.147842 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 298/575] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:06.153300 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e58cf0-e285-4e8b-9ca0-1a4197ce90a0 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:06.260259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:06.260688 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 278/576] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Oct 20 14:29:06.327806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e58cf0-e285-4e8b-9ca0-1a4197ce90a0 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:06.376413 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e191e-d77d-4ee1-87bd-0a04ef9154b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:06.377035 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e191e-d77d-4ee1-87bd-0a04ef9154b4 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:06.377311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e191e-d77d-4ee1-87bd-0a04ef9154b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:06.377629 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e191e-d77d-4ee1-87bd-0a04ef9154b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:06.388010 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e191e-d77d-4ee1-87bd-0a04ef9154b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:06.390504 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e191e-d77d-4ee1-87bd-0a04ef9154b4 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:06.412705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-148e191e-d77d-4ee1-87bd-0a04ef9154b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:29:06.412705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:06.412705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:06.412705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:06.412705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:06.412705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:06.412705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:06.412705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:06.412705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:06.412705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:06.412705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:06.412705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:06.412705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:29:06.412705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:29:06.412705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:29:06.413660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:29:06.413660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:06.413660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:06.413660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:06.413660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:06.413660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:06.413660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:06.413660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:06.413660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:06.413660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:06.413660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:06.413660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:06.413660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:06.413660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:06.413660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:06.413660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:06.413660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:06.414569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:29:06.414569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:29:06.414569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:29:06.414569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:29:06.414569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:29:06.414569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:29:06.414569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:29:06.414569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:06.414569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 299/577] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:29:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:29:06.419705 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04564c-fdd6-4e6d-82dc-a2edd994f9a7 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:06.442682 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:06.445322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e191e-d77d-4ee1-87bd-0a04ef9154b4 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:06.580278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04564c-fdd6-4e6d-82dc-a2edd994f9a7 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:06.585458 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e191e-d77d-4ee1-87bd-0a04ef9154b4 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:06.602899 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:06.624699 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b15b17-9f37-4033-a7f2-b60c35ca858b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:06.625487 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b15b17-9f37-4033-a7f2-b60c35ca858b None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:06.625778 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b15b17-9f37-4033-a7f2-b60c35ca858b None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:06.626086 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b15b17-9f37-4033-a7f2-b60c35ca858b None admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:06.626862 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b15b17-9f37-4033-a7f2-b60c35ca858b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:06.627171 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b15b17-9f37-4033-a7f2-b60c35ca858b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:06.628913 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b15b17-9f37-4033-a7f2-b60c35ca858b None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:06.629783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538f238-ec35-4ef1-bac9-83a09befcbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:06.631089 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538f238-ec35-4ef1-bac9-83a09befcbf2 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:06.631613 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538f238-ec35-4ef1-bac9-83a09befcbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:06.632674 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538f238-ec35-4ef1-bac9-83a09befcbf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:06.644367 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 279/578] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:29:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:06.645346 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b15b17-9f37-4033-a7f2-b60c35ca858b None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:06.647456 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538f238-ec35-4ef1-bac9-83a09befcbf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:29:06.657140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-e538f238-ec35-4ef1-bac9-83a09befcbf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:29:06.657140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:06.657140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:06.657140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:06.657140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:06.657140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:06.657140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:06.657140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:06.657140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:06.657140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:06.657140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:06.657140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:06.657140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:29:06.657140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:29:06.657140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:29:06.657140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:29:06.658132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:29:06.658132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:29:06.658132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:29:06.658132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:29:06.658132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:06.658132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:06.658132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:06.658132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:06.658132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:06.658132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:06.658132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:06.658132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:06.658132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:06.658132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:06.658132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:06.658132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:06.659024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:06.659024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:06.659024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:06.659024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:06.659024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:29:06.659024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:29:06.659024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:29:06.659024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:29:06.659024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:29:06.659024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:29:06.659024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:29:06.659024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:06.659024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 300/579] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:29:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:06.659731 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538f238-ec35-4ef1-bac9-83a09befcbf2 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:06.762294 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:06.772624 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538f238-ec35-4ef1-bac9-83a09befcbf2 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:06.778413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b15b17-9f37-4033-a7f2-b60c35ca858b None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:06.809438 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d4217-eed8-41ee-9109-18678ca8c43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:06.810076 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d4217-eed8-41ee-9109-18678ca8c43c None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:06.810357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d4217-eed8-41ee-9109-18678ca8c43c None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:06.810630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d4217-eed8-41ee-9109-18678ca8c43c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:06.811699 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d4217-eed8-41ee-9109-18678ca8c43c None admin] RBAC: Adding query filter params (role.id=fe3ee5741c6143adb5459b5de54450c8, scope.project.id=88613722e7dc4950b5e47a1d92331575, user.id=172b859c0d774c8f8a98ce23bdc237d5) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:06.812010 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d4217-eed8-41ee-9109-18678ca8c43c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:06.813457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d4217-eed8-41ee-9109-18678ca8c43c None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:06.819505 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 301/580] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:29:06 2022] GET /identity/v3/role_assignments?user.id=172b859c0d774c8f8a98ce23bdc237d5&scope.project.id=88613722e7dc4950b5e47a1d92331575&role.id=fe3ee5741c6143adb5459b5de54450c8 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:06.820130 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d4217-eed8-41ee-9109-18678ca8c43c None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:06.820540 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fe3ef-4fc8-4174-8c63-5042694de221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:06.821250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fe3ef-4fc8-4174-8c63-5042694de221 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:06.821531 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fe3ef-4fc8-4174-8c63-5042694de221 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:06.821806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fe3ef-4fc8-4174-8c63-5042694de221 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:06.822426 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fe3ef-4fc8-4174-8c63-5042694de221 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:06.824043 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fe3ef-4fc8-4174-8c63-5042694de221 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:06.839168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-558fe3ef-4fc8-4174-8c63-5042694de221 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 14:29:06.839168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:06.839168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:06.839168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:06.839168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:06.839168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:06.839168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:06.839168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:06.839168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 14:29:06.839168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:06.839168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:06.839168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:06.839168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:06.839168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:06.839168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:06.839168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:06.839168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:06.840292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:06.840292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:06.840292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:06.840292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:06.840292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:06.840292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:06.840292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:06.840292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:06.840292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:06.840292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:06.840292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:06.840292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:06.840292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:06.840292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:06.840292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:06.840292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:06.841191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:06.841191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:06.841191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:06.841191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:06.841191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:06.841191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:06.841191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:06.841191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:06.841191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:06.841191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:06.841191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:06.841191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:06.841191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 14:29:06.841191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:06.841191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 280/581] 10.222.0.17 () {56 vars in 1129 bytes} [Thu Oct 20 14:29:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:06.842640 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582633a-3df8-406e-8578-e4319fcf13d4 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:06.847561 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582633a-3df8-406e-8578-e4319fcf13d4 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:06.847561 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582633a-3df8-406e-8578-e4319fcf13d4 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:06.847561 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 281/582] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:06.849075 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582633a-3df8-406e-8578-e4319fcf13d4 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:06.870483 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:06.937201 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d4217-eed8-41ee-9109-18678ca8c43c None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:06.980775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582633a-3df8-406e-8578-e4319fcf13d4 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:06.983536 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ec5e6-b614-4c8f-a292-ed6ea66d6f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:06.985380 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ec5e6-b614-4c8f-a292-ed6ea66d6f6b None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:06.985771 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ec5e6-b614-4c8f-a292-ed6ea66d6f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:06.986169 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ec5e6-b614-4c8f-a292-ed6ea66d6f6b None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:06.986958 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ec5e6-b614-4c8f-a292-ed6ea66d6f6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:06.987369 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ec5e6-b614-4c8f-a292-ed6ea66d6f6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:06.988890 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ec5e6-b614-4c8f-a292-ed6ea66d6f6b None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:07.008052 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 302/583] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:29:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:07.009556 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6650ee7-7066-41dd-bff8-d4b7f49da8dd None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:07.009987 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6650ee7-7066-41dd-bff8-d4b7f49da8dd None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:07.010390 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6650ee7-7066-41dd-bff8-d4b7f49da8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:07.031453 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992db0df-a0f6-43e1-8652-505cc032a063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:07.031979 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992db0df-a0f6-43e1-8652-505cc032a063 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:07.032256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992db0df-a0f6-43e1-8652-505cc032a063 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:07.032525 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992db0df-a0f6-43e1-8652-505cc032a063 None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:07.033153 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992db0df-a0f6-43e1-8652-505cc032a063 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:07.033451 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992db0df-a0f6-43e1-8652-505cc032a063 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:07.034931 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992db0df-a0f6-43e1-8652-505cc032a063 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:07.036051 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-e6650ee7-7066-41dd-bff8-d4b7f49da8dd None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:07.037392 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e6650ee7-7066-41dd-bff8-d4b7f49da8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:07.039882 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 282/584] 10.222.0.17 () {56 vars in 1124 bytes} [Thu Oct 20 14:29:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:07.040795 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992db0df-a0f6-43e1-8652-505cc032a063 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:07.046270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:07.119416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 303/585] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:07.120470 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6650ee7-7066-41dd-bff8-d4b7f49da8dd None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:07.153213 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:07.186253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992db0df-a0f6-43e1-8652-505cc032a063 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:07.236373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6650ee7-7066-41dd-bff8-d4b7f49da8dd None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:07.239630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79db44-2260-47e6-9551-1426c088800c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:07.240272 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79db44-2260-47e6-9551-1426c088800c None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:07.240551 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79db44-2260-47e6-9551-1426c088800c None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:07.240874 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79db44-2260-47e6-9551-1426c088800c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:07.259098 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79db44-2260-47e6-9551-1426c088800c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:07.260549 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79db44-2260-47e6-9551-1426c088800c None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:07.290974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-ea79db44-2260-47e6-9551-1426c088800c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:07.290974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:07.290974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:07.290974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:07.290974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:07.290974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:07.290974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:07.290974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:07.290974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:07.290974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:07.290974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:07.290974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:07.290974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:29:07.290974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:29:07.290974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:29:07.290974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:29:07.291988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:07.291988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:07.291988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:07.291988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:07.291988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:07.291988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:07.291988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:07.291988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:07.291988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:07.291988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:07.291988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:07.291988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:07.291988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:07.291988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:07.291988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:07.291988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:07.291988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:29:07.292877 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:29:07.292877 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:07.292877 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:07.293517 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 283/586] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:07.299269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79db44-2260-47e6-9551-1426c088800c None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:07.305055 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a4433-5d8b-4a94-bb71-be39df560ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:07.305667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a4433-5d8b-4a94-bb71-be39df560ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:07.305970 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a4433-5d8b-4a94-bb71-be39df560ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:07.306244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a4433-5d8b-4a94-bb71-be39df560ef9 None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:07.306881 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a4433-5d8b-4a94-bb71-be39df560ef9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:07.307179 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a4433-5d8b-4a94-bb71-be39df560ef9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:07.314197 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a4433-5d8b-4a94-bb71-be39df560ef9 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:07.321296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 304/587] 10.222.0.17 () {56 vars in 1124 bytes} [Thu Oct 20 14:29:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:07.327063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a4433-5d8b-4a94-bb71-be39df560ef9 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:07.401556 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:07.448708 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:07.457389 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a4433-5d8b-4a94-bb71-be39df560ef9 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:07.469081 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79db44-2260-47e6-9551-1426c088800c None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:07.502821 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38ecff-bac6-4213-9d46-62589db8f521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:07.503775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38ecff-bac6-4213-9d46-62589db8f521 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:07.504312 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38ecff-bac6-4213-9d46-62589db8f521 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:07.504864 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38ecff-bac6-4213-9d46-62589db8f521 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:07.505563 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38ecff-bac6-4213-9d46-62589db8f521 None admin] RBAC: Adding query filter params (interface=public, service_id=a4096606b4314ff982dec71cdd993629, region_id=RegionOne) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:07.506075 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38ecff-bac6-4213-9d46-62589db8f521 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:07.507837 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38ecff-bac6-4213-9d46-62589db8f521 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:07.513273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371041e-ab46-492f-9cde-564acf317198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:07.514917 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371041e-ab46-492f-9cde-564acf317198 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:07.515393 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371041e-ab46-492f-9cde-564acf317198 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:07.515844 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371041e-ab46-492f-9cde-564acf317198 None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:07.516396 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 305/588] 10.222.0.17 () {56 vars in 1251 bytes} [Thu Oct 20 14:29:07 2022] GET /identity/v3/endpoints?service_id=a4096606b4314ff982dec71cdd993629&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:07.516825 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371041e-ab46-492f-9cde-564acf317198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:07.517343 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371041e-ab46-492f-9cde-564acf317198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:07.517720 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38ecff-bac6-4213-9d46-62589db8f521 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:07.518974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371041e-ab46-492f-9cde-564acf317198 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:07.533815 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 284/589] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:07.535468 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371041e-ab46-492f-9cde-564acf317198 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:07.628225 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38ecff-bac6-4213-9d46-62589db8f521 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:07.651921 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371041e-ab46-492f-9cde-564acf317198 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:07.663065 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b8561-1a84-4f71-abdb-70d3febaf51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:07.663994 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b8561-1a84-4f71-abdb-70d3febaf51d None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:07.664114 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b8561-1a84-4f71-abdb-70d3febaf51d None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:07.664344 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b8561-1a84-4f71-abdb-70d3febaf51d None admin] PATH_INFO: `/v3/services/network` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:07.664926 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b8561-1a84-4f71-abdb-70d3febaf51d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:07.666404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b8561-1a84-4f71-abdb-70d3febaf51d None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:07.671479 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:07.677323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-d21b8561-1a84-4f71-abdb-70d3febaf51d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 14:29:07.677323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:07.677323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:07.677323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:07.677323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:07.677323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:07.677323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:07.677323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:07.677323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 14:29:07.677323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:07.677323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:07.677323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:07.677323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:07.677323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:07.677323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:07.677323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:07.677323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:07.678414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:07.678414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:07.678414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:07.678414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:07.678414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:07.678414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:07.678414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:07.678414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:07.678414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:07.678414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:07.678414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:07.678414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:07.678414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:07.678414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:07.678414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:07.678414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:07.680351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:07.680351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:07.680351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:07.680351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:07.680351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:07.680351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:07.680351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:07.680351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:07.680351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:07.680351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:07.680351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:07.680351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:07.680351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 14:29:07.680351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:07.680351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 306/590] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:29:07 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:07.681625 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b8561-1a84-4f71-abdb-70d3febaf51d None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:07.699150 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166c168-7ffe-4207-9bd5-d4b5859eca6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:07.699856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166c168-7ffe-4207-9bd5-d4b5859eca6b None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:07.700202 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166c168-7ffe-4207-9bd5-d4b5859eca6b None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:07.700541 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166c168-7ffe-4207-9bd5-d4b5859eca6b None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:07.701218 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166c168-7ffe-4207-9bd5-d4b5859eca6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:07.703383 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166c168-7ffe-4207-9bd5-d4b5859eca6b None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:07.709179 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 285/591] 10.222.0.17 () {56 vars in 1087 bytes} [Thu Oct 20 14:29:07 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:07.710138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166c168-7ffe-4207-9bd5-d4b5859eca6b None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:07.720772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:07.821077 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166c168-7ffe-4207-9bd5-d4b5859eca6b None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:07.858138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea6c37-2bb7-4f14-a8f2-7b2d4474646a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:07.858865 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea6c37-2bb7-4f14-a8f2-7b2d4474646a None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:07.859211 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea6c37-2bb7-4f14-a8f2-7b2d4474646a None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:07.859553 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea6c37-2bb7-4f14-a8f2-7b2d4474646a None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:07.860282 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea6c37-2bb7-4f14-a8f2-7b2d4474646a None admin] RBAC: Adding query filter params (name=network) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:07.860650 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea6c37-2bb7-4f14-a8f2-7b2d4474646a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:07.862137 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea6c37-2bb7-4f14-a8f2-7b2d4474646a None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:07.867377 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 286/592] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Oct 20 14:29:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:07.879095 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea6c37-2bb7-4f14-a8f2-7b2d4474646a None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:07.887396 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b8561-1a84-4f71-abdb-70d3febaf51d None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:07.934590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce74551-e0af-43fd-a2a1-74f74e139ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:07.936942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce74551-e0af-43fd-a2a1-74f74e139ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:07.937225 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce74551-e0af-43fd-a2a1-74f74e139ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:07.937502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce74551-e0af-43fd-a2a1-74f74e139ea7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:07.946700 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce74551-e0af-43fd-a2a1-74f74e139ea7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:07.948348 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce74551-e0af-43fd-a2a1-74f74e139ea7 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:07.963957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-1ce74551-e0af-43fd-a2a1-74f74e139ea7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 20 14:29:07.963957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:07.963957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:07.963957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:07.963957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:07.963957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:07.963957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:07.963957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:07.963957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:07.963957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:07.963957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:07.963957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:07.963957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:29:07.963957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:29:07.963957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:29:07.963957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:29:07.964962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:07.964962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:07.964962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:29:07.964962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:07.964962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:29:07.964962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:07.964962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:07.964962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:07.964962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:07.964962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:07.964962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:07.964962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:07.964962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:07.964962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:07.964962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:07.964962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:07.964962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:07.964962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:07.965945 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:07.965945 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:07.965945 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:29:07.965945 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:29:07.965945 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:29:07.965945 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:29:07.965945 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:29:07.965945 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:29:07.965945 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 20 14:29:07.965945 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:07.965945 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 307/593] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:29:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:07.971644 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce74551-e0af-43fd-a2a1-74f74e139ea7 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:07.993101 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:08.067613 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea6c37-2bb7-4f14-a8f2-7b2d4474646a None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:08.099262 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:08.118676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053f6a9-0982-4e73-a4e8-5f88b91f013f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:08.119687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053f6a9-0982-4e73-a4e8-5f88b91f013f None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:08.120167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053f6a9-0982-4e73-a4e8-5f88b91f013f None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:08.120282 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce74551-e0af-43fd-a2a1-74f74e139ea7 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:08.120762 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053f6a9-0982-4e73-a4e8-5f88b91f013f None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:08.121726 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053f6a9-0982-4e73-a4e8-5f88b91f013f None admin] RBAC: Adding query filter params (type=network) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:08.122263 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053f6a9-0982-4e73-a4e8-5f88b91f013f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:08.124026 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053f6a9-0982-4e73-a4e8-5f88b91f013f None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:08.133627 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 287/594] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Oct 20 14:29:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:08.141459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053f6a9-0982-4e73-a4e8-5f88b91f013f None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:08.185540 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbd8b4-b836-4277-9640-0c654f3c168f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:08.186024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbd8b4-b836-4277-9640-0c654f3c168f None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:08.186233 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbd8b4-b836-4277-9640-0c654f3c168f None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:08.186507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbd8b4-b836-4277-9640-0c654f3c168f None admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:08.187253 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dbd8b4-b836-4277-9640-0c654f3c168f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:08.187782 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dbd8b4-b836-4277-9640-0c654f3c168f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:08.189225 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dbd8b4-b836-4277-9640-0c654f3c168f None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:08.218882 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 308/595] 10.222.0.17 () {56 vars in 1135 bytes} [Thu Oct 20 14:29:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:08.220597 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42527a1f-c09a-4d1e-b697-0075c932ceeb None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:08.221129 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42527a1f-c09a-4d1e-b697-0075c932ceeb None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:08.221617 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42527a1f-c09a-4d1e-b697-0075c932ceeb None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:08.223625 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 309/596] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:08.224541 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42527a1f-c09a-4d1e-b697-0075c932ceeb None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:08.289931 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053f6a9-0982-4e73-a4e8-5f88b91f013f None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:08.300592 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:08.328713 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8bf7f-68f9-420d-b7b1-9686736af5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:08.329331 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8bf7f-68f9-420d-b7b1-9686736af5a5 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:08.329613 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8bf7f-68f9-420d-b7b1-9686736af5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:08.329912 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8bf7f-68f9-420d-b7b1-9686736af5a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:08.330737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8bf7f-68f9-420d-b7b1-9686736af5a5 None admin] RBAC: Adding query filter params (interface=public, service_id=acc3994cb39247ada6cf15d8e5478b73, region_id=RegionOne) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:08.330916 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8bf7f-68f9-420d-b7b1-9686736af5a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:08.332348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8bf7f-68f9-420d-b7b1-9686736af5a5 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:08.342001 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 288/597] 10.222.0.17 () {56 vars in 1251 bytes} [Thu Oct 20 14:29:08 2022] GET /identity/v3/endpoints?service_id=acc3994cb39247ada6cf15d8e5478b73&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:08.343574 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9c009-52fc-4628-a682-c85464a89dfd None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:08.344079 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9c009-52fc-4628-a682-c85464a89dfd None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:08.344560 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9c009-52fc-4628-a682-c85464a89dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:08.352784 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42527a1f-c09a-4d1e-b697-0075c932ceeb None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:08.368930 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-37e9c009-52fc-4628-a682-c85464a89dfd None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:08.370836 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-37e9c009-52fc-4628-a682-c85464a89dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:08.391494 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e91604-13c6-48f7-bb04-f7d7e35f26dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:08.392288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e91604-13c6-48f7-bb04-f7d7e35f26dc None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:08.392483 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e91604-13c6-48f7-bb04-f7d7e35f26dc None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:08.392729 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e91604-13c6-48f7-bb04-f7d7e35f26dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:08.405402 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:08.448380 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 289/598] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:08.449572 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9c009-52fc-4628-a682-c85464a89dfd None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:08.494597 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e91604-13c6-48f7-bb04-f7d7e35f26dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:08.496090 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e91604-13c6-48f7-bb04-f7d7e35f26dc None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:08.559000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9c009-52fc-4628-a682-c85464a89dfd None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:08.562923 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:08.598170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f5922-902f-414d-a438-8e209e07fa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:08.599195 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f5922-902f-414d-a438-8e209e07fa00 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:08.599692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f5922-902f-414d-a438-8e209e07fa00 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:08.600335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f5922-902f-414d-a438-8e209e07fa00 None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:08.601149 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f5922-902f-414d-a438-8e209e07fa00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:08.602792 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f5922-902f-414d-a438-8e209e07fa00 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:08.608760 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 290/599] 10.222.0.17 () {56 vars in 1087 bytes} [Thu Oct 20 14:29:08 2022] GET /identity/v3/services => generated 772 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:08.655887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 310/600] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:29:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 14:29:08.667017 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f5922-902f-414d-a438-8e209e07fa00 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:08.802999 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f5922-902f-414d-a438-8e209e07fa00 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:08.845393 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26e64d-c3fe-479a-b427-61646686fd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:08.846253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26e64d-c3fe-479a-b427-61646686fd06 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:08.846530 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26e64d-c3fe-479a-b427-61646686fd06 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:08.846797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26e64d-c3fe-479a-b427-61646686fd06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:08.857527 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26e64d-c3fe-479a-b427-61646686fd06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:08.859033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26e64d-c3fe-479a-b427-61646686fd06 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:08.874535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-ff26e64d-c3fe-479a-b427-61646686fd06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:08.874535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:08.874535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:08.874535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:08.874535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:08.874535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:08.874535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:08.874535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:08.874535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:08.874535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:08.874535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:08.874535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:08.874535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:29:08.874535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:29:08.874535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:29:08.874535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:29:08.875523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:08.875523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:08.875523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:08.875523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:08.875523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:08.875523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:08.875523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:08.875523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:08.875523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:08.875523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:08.875523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:08.875523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:08.875523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:08.875523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:08.875523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:08.875523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:08.875523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:29:08.876407 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:29:08.876407 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:08.876407 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:08.876407 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 291/601] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:08.882998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e91604-13c6-48f7-bb04-f7d7e35f26dc None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:08.890587 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26e64d-c3fe-479a-b427-61646686fd06 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:08.920734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:08.957752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:09.027657 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e91604-13c6-48f7-bb04-f7d7e35f26dc None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:09.067761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560fa32-071e-40bb-a9e4-328485ff91a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:09.068811 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560fa32-071e-40bb-a9e4-328485ff91a2 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:09.069303 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560fa32-071e-40bb-a9e4-328485ff91a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:09.069881 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560fa32-071e-40bb-a9e4-328485ff91a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:09.070736 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560fa32-071e-40bb-a9e4-328485ff91a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:09.071254 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560fa32-071e-40bb-a9e4-328485ff91a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:09.072896 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560fa32-071e-40bb-a9e4-328485ff91a2 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:09.086309 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 311/602] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:09.091405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560fa32-071e-40bb-a9e4-328485ff91a2 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:09.102911 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26e64d-c3fe-479a-b427-61646686fd06 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:09.191095 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587df89-5612-4c59-818c-dce46da6e316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:09.192059 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587df89-5612-4c59-818c-dce46da6e316 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:09.193752 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587df89-5612-4c59-818c-dce46da6e316 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:09.194297 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587df89-5612-4c59-818c-dce46da6e316 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:09.222874 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587df89-5612-4c59-818c-dce46da6e316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:29:09.229083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-d587df89-5612-4c59-818c-dce46da6e316 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:29:09.229083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:09.229083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:09.229083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:09.229083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:09.229083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:09.229083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:09.229083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:09.229083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:09.229083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:09.229083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:09.229083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:09.229083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:29:09.229083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:29:09.229083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:29:09.229083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:29:09.230065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:29:09.230065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:29:09.230065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:29:09.230065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:29:09.230065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:09.230065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:09.230065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:09.230065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:09.230065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:09.230065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:09.230065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:09.230065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:09.230065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:09.230065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:09.230065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:09.230065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:09.230894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:09.230894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:09.230894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:09.230894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:09.230894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:29:09.230894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:29:09.230894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:29:09.230894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:29:09.230894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:29:09.230894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:29:09.230894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:29:09.230894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:09.238293 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 292/603] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Oct 20 14:29:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:09.246338 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587df89-5612-4c59-818c-dce46da6e316 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:09.281876 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:09.286128 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560fa32-071e-40bb-a9e4-328485ff91a2 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:09.336232 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6917d-d0cb-474a-9794-da5704c310cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:09.337255 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6917d-d0cb-474a-9794-da5704c310cc None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:09.339165 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6917d-d0cb-474a-9794-da5704c310cc None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:09.339462 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6917d-d0cb-474a-9794-da5704c310cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:09.355894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6917d-d0cb-474a-9794-da5704c310cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:09.357795 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6917d-d0cb-474a-9794-da5704c310cc None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:09.377359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-d0d6917d-d0cb-474a-9794-da5704c310cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:29:09.377359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:09.377359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:09.377359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:09.377359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:09.377359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:09.377359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:09.377359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:09.377359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:09.377359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:09.377359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:09.377359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:09.377359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:29:09.377359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:29:09.377359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:29:09.378358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:29:09.378358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:09.378358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:09.378358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:09.378358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:09.378358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:09.378358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:09.378358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:09.378358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:09.378358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:09.378358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:09.378358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:09.378358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:09.378358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:09.378358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:09.378358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:09.378358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:09.379227 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:29:09.379227 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:29:09.379227 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:29:09.379227 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:29:09.379227 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:29:09.379227 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:29:09.379227 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:29:09.379227 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:09.379671 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 312/604] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:29:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:09.384741 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6917d-d0cb-474a-9794-da5704c310cc None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:09.394231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:09.421404 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587df89-5612-4c59-818c-dce46da6e316 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:09.478701 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792368bf-789e-4b2d-8a30-a8ae7d0b1dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:09.479689 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792368bf-789e-4b2d-8a30-a8ae7d0b1dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:09.480179 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792368bf-789e-4b2d-8a30-a8ae7d0b1dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:09.480939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792368bf-789e-4b2d-8a30-a8ae7d0b1dd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:09.482461 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792368bf-789e-4b2d-8a30-a8ae7d0b1dd4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:09.483005 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792368bf-789e-4b2d-8a30-a8ae7d0b1dd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:09.484650 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792368bf-789e-4b2d-8a30-a8ae7d0b1dd4 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:09.494902 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 293/605] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Oct 20 14:29:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:09.501714 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeb907-1380-40ee-8fc3-4e2ce9f89a94 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:09.502269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeb907-1380-40ee-8fc3-4e2ce9f89a94 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:09.502762 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeb907-1380-40ee-8fc3-4e2ce9f89a94 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:09.504473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 294/606] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:09.505382 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeb907-1380-40ee-8fc3-4e2ce9f89a94 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:09.558095 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6917d-d0cb-474a-9794-da5704c310cc None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:09.599428 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e18d35-bdae-44d9-98be-58bd4c6dfc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:09.600177 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e18d35-bdae-44d9-98be-58bd4c6dfc46 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:09.600776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e18d35-bdae-44d9-98be-58bd4c6dfc46 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:09.601370 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e18d35-bdae-44d9-98be-58bd4c6dfc46 None admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:09.602336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e18d35-bdae-44d9-98be-58bd4c6dfc46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:09.602660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e18d35-bdae-44d9-98be-58bd4c6dfc46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:09.604110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e18d35-bdae-44d9-98be-58bd4c6dfc46 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:09.626830 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 313/607] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:29:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:09.628226 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2872b90-2788-4bb6-b4d8-3f85ebdce6a2 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:09.628511 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2872b90-2788-4bb6-b4d8-3f85ebdce6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:09.628786 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2872b90-2788-4bb6-b4d8-3f85ebdce6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:09.651559 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-a2872b90-2788-4bb6-b4d8-3f85ebdce6a2 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:09.652755 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a2872b90-2788-4bb6-b4d8-3f85ebdce6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:09.671921 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:09.693417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeb907-1380-40ee-8fc3-4e2ce9f89a94 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:09.751648 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddec307-0770-4822-ba86-22b53c420434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:09.752745 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddec307-0770-4822-ba86-22b53c420434 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:09.753288 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddec307-0770-4822-ba86-22b53c420434 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:09.753780 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddec307-0770-4822-ba86-22b53c420434 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:09.762810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 314/608] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:09.764524 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2872b90-2788-4bb6-b4d8-3f85ebdce6a2 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:09.779637 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:09.783351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddec307-0770-4822-ba86-22b53c420434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:09.785065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddec307-0770-4822-ba86-22b53c420434 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:09.819141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-3ddec307-0770-4822-ba86-22b53c420434 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:09.819141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:09.819141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:09.819141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:09.819141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:09.819141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:09.819141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:09.819141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:09.819141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:09.819141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:09.819141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:09.819141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:09.819141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:29:09.819141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:29:09.819141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:29:09.819141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:29:09.820134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:09.820134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:09.820134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:09.820134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:09.820134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:09.820134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:09.820134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:09.820134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:09.820134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:09.820134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:09.820134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:09.820134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:09.820134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:09.820134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:09.820134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:09.820134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:09.820134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:29:09.820998 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:29:09.820998 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:09.820998 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:09.825514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 295/609] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:09.842330 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddec307-0770-4822-ba86-22b53c420434 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:09.983009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2872b90-2788-4bb6-b4d8-3f85ebdce6a2 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:10.043685 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddec307-0770-4822-ba86-22b53c420434 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:10.054105 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26515b7f-8201-4c77-88ea-fa7c6d2a1328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:10.054551 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26515b7f-8201-4c77-88ea-fa7c6d2a1328 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:10.054827 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26515b7f-8201-4c77-88ea-fa7c6d2a1328 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:10.055100 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26515b7f-8201-4c77-88ea-fa7c6d2a1328 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:10.055824 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26515b7f-8201-4c77-88ea-fa7c6d2a1328 None admin] RBAC: Adding query filter params (role.id=fe3ee5741c6143adb5459b5de54450c8, scope.project.id=88613722e7dc4950b5e47a1d92331575, user.id=8d60d62d14cd4042ab1bff5509e30f5c) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:10.056442 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26515b7f-8201-4c77-88ea-fa7c6d2a1328 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:10.058008 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26515b7f-8201-4c77-88ea-fa7c6d2a1328 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:10.077652 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 315/610] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:29:09 2022] GET /identity/v3/role_assignments?user.id=8d60d62d14cd4042ab1bff5509e30f5c&scope.project.id=88613722e7dc4950b5e47a1d92331575&role.id=fe3ee5741c6143adb5459b5de54450c8 => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:10.113303 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ed154-6707-4e24-b8c3-ce9e6da52a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:10.114401 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ed154-6707-4e24-b8c3-ce9e6da52a64 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:10.114902 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ed154-6707-4e24-b8c3-ce9e6da52a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:10.115393 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ed154-6707-4e24-b8c3-ce9e6da52a64 None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:10.116266 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ed154-6707-4e24-b8c3-ce9e6da52a64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:10.116773 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ed154-6707-4e24-b8c3-ce9e6da52a64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:10.118443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ed154-6707-4e24-b8c3-ce9e6da52a64 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:10.142017 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 296/611] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:10.148121 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26515b7f-8201-4c77-88ea-fa7c6d2a1328 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:10.173615 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:10.242992 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ed154-6707-4e24-b8c3-ce9e6da52a64 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:10.355189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:10.357377 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26515b7f-8201-4c77-88ea-fa7c6d2a1328 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:10.412484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba83237-3096-4aa0-878c-9d0eb678c2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:10.413146 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba83237-3096-4aa0-878c-9d0eb678c2fb None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:10.413427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba83237-3096-4aa0-878c-9d0eb678c2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:10.413693 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba83237-3096-4aa0-878c-9d0eb678c2fb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:10.423265 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba83237-3096-4aa0-878c-9d0eb678c2fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:10.424946 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba83237-3096-4aa0-878c-9d0eb678c2fb None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:10.428236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ed154-6707-4e24-b8c3-ce9e6da52a64 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:10.437985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-dba83237-3096-4aa0-878c-9d0eb678c2fb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 14:29:10.437985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:10.437985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:10.437985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:10.437985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:10.437985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:10.437985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:10.437985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:10.437985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:10.437985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:10.437985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:10.437985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:10.437985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:29:10.437985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:29:10.437985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:29:10.437985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:29:10.438937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:10.438937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:10.438937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:29:10.438937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:10.438937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:29:10.438937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:10.438937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:10.438937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:10.438937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:10.438937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:10.438937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:10.438937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:10.438937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:10.438937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:10.438937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:10.438937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:10.438937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:10.438937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:10.439854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:10.439854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:10.439854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:29:10.439854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:29:10.439854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:29:10.439854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:29:10.439854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:29:10.439854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:29:10.439854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 14:29:10.439854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:10.439854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 316/612] 10.222.0.17 () {56 vars in 1117 bytes} [Thu Oct 20 14:29:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:10.440955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e699458-35be-4b2d-979f-7dcdc29046a3 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:10.441056 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e699458-35be-4b2d-979f-7dcdc29046a3 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:10.442938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e699458-35be-4b2d-979f-7dcdc29046a3 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:10.442938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 317/613] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:10.447955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e699458-35be-4b2d-979f-7dcdc29046a3 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:10.473696 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06b856-66aa-44e1-bcb3-0e1cf407c81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:10.474610 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06b856-66aa-44e1-bcb3-0e1cf407c81c None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:10.475070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06b856-66aa-44e1-bcb3-0e1cf407c81c None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:10.475704 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06b856-66aa-44e1-bcb3-0e1cf407c81c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:10.476966 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06b856-66aa-44e1-bcb3-0e1cf407c81c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:10.478901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06b856-66aa-44e1-bcb3-0e1cf407c81c None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:10.490019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-2d06b856-66aa-44e1-bcb3-0e1cf407c81c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 14:29:10.490019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:10.490019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:10.490019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:10.490019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:10.490019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:10.490019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:10.490019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:10.490019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 14:29:10.490019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:10.490019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:10.490019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:10.490019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:10.490019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:10.490019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:10.490019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:10.491192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:10.491192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:10.491192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:10.491192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:10.491192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:10.491192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:10.491192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:10.491192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:10.491192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:10.491192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:10.491192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:10.491192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:10.491192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:10.491192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:10.491192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:10.491192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:10.491192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:10.492158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:10.492158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:10.492158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:10.492158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:10.492158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:10.492158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:10.492158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:10.492158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:10.492158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:10.492158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:10.492158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:10.492158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:10.492158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 14:29:10.492158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:10.494608 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 297/614] 10.222.0.17 () {56 vars in 1132 bytes} [Thu Oct 20 14:29:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:10.496278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bedaa-14d2-4297-9d4e-5edcf0914e28 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:10.496735 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bedaa-14d2-4297-9d4e-5edcf0914e28 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:10.497156 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bedaa-14d2-4297-9d4e-5edcf0914e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:10.519289 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-394bedaa-14d2-4297-9d4e-5edcf0914e28 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:10.520768 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-394bedaa-14d2-4297-9d4e-5edcf0914e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:10.536727 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:10.564913 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e699458-35be-4b2d-979f-7dcdc29046a3 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:10.606213 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f640f8c-fb70-4e66-82b6-cf761551a07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:10.607085 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f640f8c-fb70-4e66-82b6-cf761551a07a None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:10.608075 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f640f8c-fb70-4e66-82b6-cf761551a07a None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:10.608612 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f640f8c-fb70-4e66-82b6-cf761551a07a None admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:10.609547 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f640f8c-fb70-4e66-82b6-cf761551a07a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:10.613888 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f640f8c-fb70-4e66-82b6-cf761551a07a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:10.614048 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 298/615] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:10.614048 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bedaa-14d2-4297-9d4e-5edcf0914e28 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:10.615402 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f640f8c-fb70-4e66-82b6-cf761551a07a None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:10.654616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 318/616] 10.222.0.17 () {56 vars in 1149 bytes} [Thu Oct 20 14:29:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:10.658779 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f640f8c-fb70-4e66-82b6-cf761551a07a None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:10.694538 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:10.763167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bedaa-14d2-4297-9d4e-5edcf0914e28 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:10.800284 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d04bbb-cd6b-4252-951b-312e2a4c8b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:10.800905 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d04bbb-cd6b-4252-951b-312e2a4c8b51 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:10.801197 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d04bbb-cd6b-4252-951b-312e2a4c8b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:10.801476 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d04bbb-cd6b-4252-951b-312e2a4c8b51 None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:10.802746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d04bbb-cd6b-4252-951b-312e2a4c8b51 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:10.803058 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d04bbb-cd6b-4252-951b-312e2a4c8b51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:10.804872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d04bbb-cd6b-4252-951b-312e2a4c8b51 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:10.811387 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 299/617] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Oct 20 14:29:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:10.817644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d04bbb-cd6b-4252-951b-312e2a4c8b51 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:10.884119 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f640f8c-fb70-4e66-82b6-cf761551a07a None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:10.936140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d04bbb-cd6b-4252-951b-312e2a4c8b51 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:10.947985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:10.957021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578b266-4a27-45b2-8808-fef023715693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:10.957353 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:10.957639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578b266-4a27-45b2-8808-fef023715693 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:10.957943 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578b266-4a27-45b2-8808-fef023715693 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:10.958222 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578b266-4a27-45b2-8808-fef023715693 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:11.003567 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4b936-4f5e-481e-a68c-834d16043954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:11.004603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4b936-4f5e-481e-a68c-834d16043954 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:11.004888 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4b936-4f5e-481e-a68c-834d16043954 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:11.005185 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4b936-4f5e-481e-a68c-834d16043954 None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:11.005823 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4b936-4f5e-481e-a68c-834d16043954 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:11.006333 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4b936-4f5e-481e-a68c-834d16043954 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:11.007775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4b936-4f5e-481e-a68c-834d16043954 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:11.014130 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 300/618] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Oct 20 14:29:10 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:11.015207 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4b936-4f5e-481e-a68c-834d16043954 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:11.061453 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578b266-4a27-45b2-8808-fef023715693 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:11.063662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578b266-4a27-45b2-8808-fef023715693 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:11.145338 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4b936-4f5e-481e-a68c-834d16043954 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:11.199683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718013c-5701-4909-87d7-19d72fcd65ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:11.201492 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718013c-5701-4909-87d7-19d72fcd65ce None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:11.202059 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718013c-5701-4909-87d7-19d72fcd65ce None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:11.202610 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718013c-5701-4909-87d7-19d72fcd65ce None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:11.209877 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 319/619] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:29:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 14:29:11.209877 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca1106-b4d4-497e-b66a-5129c3edc5d9 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:11.209877 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca1106-b4d4-497e-b66a-5129c3edc5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:11.209877 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca1106-b4d4-497e-b66a-5129c3edc5d9 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:11.209877 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 320/620] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:11.209877 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca1106-b4d4-497e-b66a-5129c3edc5d9 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:11.210683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718013c-5701-4909-87d7-19d72fcd65ce None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:11.212638 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718013c-5701-4909-87d7-19d72fcd65ce None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:11.228180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-e718013c-5701-4909-87d7-19d72fcd65ce None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 14:29:11.228180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:11.228180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:11.228180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:11.228180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:11.228180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:11.228180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:11.228180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:11.228180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 14:29:11.228180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:11.228180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:11.228180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:11.228180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:11.228180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:11.228180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:11.228180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:11.228180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:11.229467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:11.229467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:11.229467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:11.229467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:11.229467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:11.229467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:11.229467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:11.229467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:11.229467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:11.229467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:11.229467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:11.229467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:11.229467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:11.229467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:11.229467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:11.229467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:11.230537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:11.230537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:11.230537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:11.230537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:11.230537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:11.230537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:11.230537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:11.230537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:11.230537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:11.230537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:11.230537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:11.230537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:11.230537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 14:29:11.230537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:11.234032 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 301/621] 10.222.0.17 () {56 vars in 1129 bytes} [Thu Oct 20 14:29:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:11.235748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57d6b0-bea7-48a6-82be-b5a9c71026b8 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:11.236177 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57d6b0-bea7-48a6-82be-b5a9c71026b8 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:11.236612 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57d6b0-bea7-48a6-82be-b5a9c71026b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:11.251445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:11.260566 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-9e57d6b0-bea7-48a6-82be-b5a9c71026b8 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:11.262061 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-9e57d6b0-bea7-48a6-82be-b5a9c71026b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:11.298962 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:11.349891 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 302/622] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:11.349891 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57d6b0-bea7-48a6-82be-b5a9c71026b8 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:11.359038 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca1106-b4d4-497e-b66a-5129c3edc5d9 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:11.421480 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00b792-afdb-48f2-b159-2e9eef249f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:11.423493 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00b792-afdb-48f2-b159-2e9eef249f5b None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:11.423940 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00b792-afdb-48f2-b159-2e9eef249f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:11.424356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00b792-afdb-48f2-b159-2e9eef249f5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:11.444514 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00b792-afdb-48f2-b159-2e9eef249f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:11.447708 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00b792-afdb-48f2-b159-2e9eef249f5b None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:11.473336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-bf00b792-afdb-48f2-b159-2e9eef249f5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:11.473336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:11.473336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:11.473336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:11.473336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:11.473336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:11.473336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:11.473336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:11.473336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:11.473336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:11.473336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:11.473336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:11.473336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:29:11.473336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:29:11.473336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:29:11.473336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:29:11.474554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:11.474554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:11.474554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:11.474554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:11.474554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:11.474554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:11.474554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:11.474554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:11.474554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:11.474554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:11.474554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:11.474554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:11.474554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:11.474554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:11.474554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:11.474554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:11.474554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:29:11.475619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:29:11.475619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:11.475619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:11.479611 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 321/623] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:11.485348 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00b792-afdb-48f2-b159-2e9eef249f5b None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:11.533341 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57d6b0-bea7-48a6-82be-b5a9c71026b8 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:11.596451 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f1bbd-990f-4e1b-bf71-3677c7a12bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:11.597361 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f1bbd-990f-4e1b-bf71-3677c7a12bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:11.597877 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f1bbd-990f-4e1b-bf71-3677c7a12bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:11.598300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f1bbd-990f-4e1b-bf71-3677c7a12bc3 None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:11.599084 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f1bbd-990f-4e1b-bf71-3677c7a12bc3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:11.599523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f1bbd-990f-4e1b-bf71-3677c7a12bc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:11.601034 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f1bbd-990f-4e1b-bf71-3677c7a12bc3 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:11.609893 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 303/624] 10.222.0.17 () {56 vars in 1124 bytes} [Thu Oct 20 14:29:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:11.615402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f1bbd-990f-4e1b-bf71-3677c7a12bc3 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:11.646209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:11.651600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:11.675609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00b792-afdb-48f2-b159-2e9eef249f5b None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:11.725013 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0954fe-9d69-44c4-9afb-4158de3a0dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:11.725784 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0954fe-9d69-44c4-9afb-4158de3a0dec None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:11.726193 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0954fe-9d69-44c4-9afb-4158de3a0dec None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:11.727187 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0954fe-9d69-44c4-9afb-4158de3a0dec None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:11.727971 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0954fe-9d69-44c4-9afb-4158de3a0dec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:11.728382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0954fe-9d69-44c4-9afb-4158de3a0dec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:11.730411 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0954fe-9d69-44c4-9afb-4158de3a0dec None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:11.746979 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 322/625] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:11.748741 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0954fe-9d69-44c4-9afb-4158de3a0dec None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:11.756757 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f1bbd-990f-4e1b-bf71-3677c7a12bc3 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:11.799578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e8f4f-9a25-4252-b846-d3487eeddb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:11.800288 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e8f4f-9a25-4252-b846-d3487eeddb2e None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:11.800569 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e8f4f-9a25-4252-b846-d3487eeddb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:11.800838 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e8f4f-9a25-4252-b846-d3487eeddb2e None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:11.801464 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e8f4f-9a25-4252-b846-d3487eeddb2e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:11.801758 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e8f4f-9a25-4252-b846-d3487eeddb2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:11.803351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e8f4f-9a25-4252-b846-d3487eeddb2e None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:11.809079 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 304/626] 10.222.0.17 () {56 vars in 1124 bytes} [Thu Oct 20 14:29:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:11.810249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e8f4f-9a25-4252-b846-d3487eeddb2e None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:11.875019 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0954fe-9d69-44c4-9afb-4158de3a0dec None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:11.914143 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eef1eb-03cb-45bc-8f69-1097494bf888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:11.915043 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eef1eb-03cb-45bc-8f69-1097494bf888 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:11.915326 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eef1eb-03cb-45bc-8f69-1097494bf888 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:11.915601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eef1eb-03cb-45bc-8f69-1097494bf888 None admin] PATH_INFO: `/v3/services/network` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:11.916186 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eef1eb-03cb-45bc-8f69-1097494bf888 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:11.917744 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eef1eb-03cb-45bc-8f69-1097494bf888 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:11.930191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-09eef1eb-03cb-45bc-8f69-1097494bf888 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 14:29:11.930191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:11.930191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:11.930191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:11.930191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:11.930191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:11.930191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:11.930191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:11.930191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 14:29:11.930191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:11.930191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:11.930191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:11.930191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:11.930191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:11.930191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:11.930191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:11.930191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:11.931185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:11.931185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:11.931185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:11.931185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:11.931185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:11.931185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:11.931185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:11.931185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:11.931185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:11.931185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:11.931185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:11.931185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:11.931185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:11.931185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:11.931185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:11.931185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:11.932009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:11.932009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:11.932009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:11.932009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:11.932009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:11.932009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:11.932009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:11.932009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:11.932009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:11.932009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:11.932009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:11.932009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:11.932009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 14:29:11.932009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:11.932009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 323/627] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:29:11 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:11.932797 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eef1eb-03cb-45bc-8f69-1097494bf888 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:11.938803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:11.947477 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:11.948362 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e8f4f-9a25-4252-b846-d3487eeddb2e None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:11.997460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301be2e-94dc-449d-8093-13893ba77697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:11.998327 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301be2e-94dc-449d-8093-13893ba77697 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:11.998646 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301be2e-94dc-449d-8093-13893ba77697 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:11.998897 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301be2e-94dc-449d-8093-13893ba77697 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:12.008979 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301be2e-94dc-449d-8093-13893ba77697 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:12.010720 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301be2e-94dc-449d-8093-13893ba77697 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:12.026601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-3301be2e-94dc-449d-8093-13893ba77697 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:29:12.026601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:12.026601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:12.026601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:12.026601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:12.026601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:12.026601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:12.026601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:12.026601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:12.026601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:12.026601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:12.026601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:12.026601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:29:12.026601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:29:12.026601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:29:12.027603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:29:12.027603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:12.027603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:12.027603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:12.027603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:12.027603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:12.027603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:12.027603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:12.027603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:12.027603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:12.027603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:12.027603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:12.027603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:12.027603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:12.027603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:12.027603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:12.027603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:12.028477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:29:12.028477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:29:12.028477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:29:12.028477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:29:12.028477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:29:12.028477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:29:12.028477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:29:12.028477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:12.028477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 305/628] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:29:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:12.028951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301be2e-94dc-449d-8093-13893ba77697 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:12.062528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eef1eb-03cb-45bc-8f69-1097494bf888 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:12.109710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e891f3-07a2-4d59-870b-c36fe9615d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:12.111001 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e891f3-07a2-4d59-870b-c36fe9615d80 None admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:12.111492 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e891f3-07a2-4d59-870b-c36fe9615d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:12.112149 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e891f3-07a2-4d59-870b-c36fe9615d80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:12.113817 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e891f3-07a2-4d59-870b-c36fe9615d80 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:12.115435 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e891f3-07a2-4d59-870b-c36fe9615d80 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:12.146826 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 324/629] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:29:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:29:12.148229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e891f3-07a2-4d59-870b-c36fe9615d80 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:12.150560 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301be2e-94dc-449d-8093-13893ba77697 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:12.199210 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fb5db-fec8-4445-a544-4e2d78dcbd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:12.200082 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fb5db-fec8-4445-a544-4e2d78dcbd5e None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:12.200580 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fb5db-fec8-4445-a544-4e2d78dcbd5e None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:12.201588 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fb5db-fec8-4445-a544-4e2d78dcbd5e None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:12.202807 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fb5db-fec8-4445-a544-4e2d78dcbd5e None admin] RBAC: Adding query filter params (name=network) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:12.203292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fb5db-fec8-4445-a544-4e2d78dcbd5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:12.205873 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fb5db-fec8-4445-a544-4e2d78dcbd5e None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:12.211715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 306/630] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Oct 20 14:29:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:12.220126 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fb5db-fec8-4445-a544-4e2d78dcbd5e None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:12.234416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:12.283997 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:12.294928 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e891f3-07a2-4d59-870b-c36fe9615d80 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:12.337700 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb9d4f-161e-4464-91eb-f1a4afdeb038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:12.339287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb9d4f-161e-4464-91eb-f1a4afdeb038 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:12.339568 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb9d4f-161e-4464-91eb-f1a4afdeb038 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:12.339841 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb9d4f-161e-4464-91eb-f1a4afdeb038 None admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:12.342088 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb9d4f-161e-4464-91eb-f1a4afdeb038 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:12.342088 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb9d4f-161e-4464-91eb-f1a4afdeb038 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:12.342902 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb9d4f-161e-4464-91eb-f1a4afdeb038 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:12.357733 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 325/631] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:29:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:12.362797 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb9d4f-161e-4464-91eb-f1a4afdeb038 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:12.460997 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fb5db-fec8-4445-a544-4e2d78dcbd5e None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:12.508588 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb9d4f-161e-4464-91eb-f1a4afdeb038 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:12.509561 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa80c91-8c77-4a10-9f3a-59562207710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:12.510575 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa80c91-8c77-4a10-9f3a-59562207710a None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:12.511110 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa80c91-8c77-4a10-9f3a-59562207710a None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:12.511611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa80c91-8c77-4a10-9f3a-59562207710a None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:12.512456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa80c91-8c77-4a10-9f3a-59562207710a None admin] RBAC: Adding query filter params (type=network) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:12.512960 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa80c91-8c77-4a10-9f3a-59562207710a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:12.516058 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa80c91-8c77-4a10-9f3a-59562207710a None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:12.522490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 307/632] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Oct 20 14:29:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:12.527565 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa80c91-8c77-4a10-9f3a-59562207710a None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:12.539278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:12.550288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbc818-44a8-4615-813c-377b6943f8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:12.550902 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbc818-44a8-4615-813c-377b6943f8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:12.551188 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbc818-44a8-4615-813c-377b6943f8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:12.551466 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbc818-44a8-4615-813c-377b6943f8f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:12.552199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbc818-44a8-4615-813c-377b6943f8f8 None admin] RBAC: Adding query filter params (role.id=af10f9c70a5d4fcb999f273845290676, scope.project.id=88613722e7dc4950b5e47a1d92331575, user.id=a1bdbce1b3d047cfa5ddf72f902ecd5d) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:12.552511 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbc818-44a8-4615-813c-377b6943f8f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:12.554509 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbc818-44a8-4615-813c-377b6943f8f8 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:12.561621 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 326/633] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:29:12 2022] GET /identity/v3/role_assignments?user.id=a1bdbce1b3d047cfa5ddf72f902ecd5d&scope.project.id=88613722e7dc4950b5e47a1d92331575&role.id=af10f9c70a5d4fcb999f273845290676 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:12.581266 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a10f37-e3dd-4d57-acec-a2965a042304 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:12.581593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a10f37-e3dd-4d57-acec-a2965a042304 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:12.581817 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a10f37-e3dd-4d57-acec-a2965a042304 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:12.583358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 327/634] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:29:12.590216 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd060e-d4f2-418f-9d0f-4ea871313802 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:12.590543 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd060e-d4f2-418f-9d0f-4ea871313802 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:12.590779 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd060e-d4f2-418f-9d0f-4ea871313802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:12.616800 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-7dfd060e-d4f2-418f-9d0f-4ea871313802 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:12.618636 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-7dfd060e-d4f2-418f-9d0f-4ea871313802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:12.657816 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:12.694288 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa80c91-8c77-4a10-9f3a-59562207710a None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:12.733593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 328/635] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 14:29:12.762860 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17380531-1bc3-48a8-92b5-10d7e40b1f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:12.764054 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17380531-1bc3-48a8-92b5-10d7e40b1f7a None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:12.764384 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17380531-1bc3-48a8-92b5-10d7e40b1f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:12.764719 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17380531-1bc3-48a8-92b5-10d7e40b1f7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:12.765567 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17380531-1bc3-48a8-92b5-10d7e40b1f7a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:12.767092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17380531-1bc3-48a8-92b5-10d7e40b1f7a None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:12.790845 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 308/636] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:29:12 2022] POST /identity/v3/endpoints => generated 337 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:29:13.033992 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd060e-d4f2-418f-9d0f-4ea871313802 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:13.143387 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd060e-d4f2-418f-9d0f-4ea871313802 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:13.161936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:13.198718 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9d38b-1cfb-4f9f-b612-f3dc14b22c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:13.199363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9d38b-1cfb-4f9f-b612-f3dc14b22c9c None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:13.199642 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9d38b-1cfb-4f9f-b612-f3dc14b22c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:13.199913 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9d38b-1cfb-4f9f-b612-f3dc14b22c9c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:13.200493 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9d38b-1cfb-4f9f-b612-f3dc14b22c9c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:13.201990 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9d38b-1cfb-4f9f-b612-f3dc14b22c9c None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:13.211086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-0af9d38b-1cfb-4f9f-b612-f3dc14b22c9c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 14:29:13.211086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:13.211086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:13.211086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:13.211086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:13.211086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:13.211086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:13.211086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:13.211086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 14:29:13.211086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:13.211086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:13.211086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:13.211086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:13.211086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:13.211086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:13.211086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:13.211086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:13.212063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:13.212063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:13.212063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:13.212063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:13.212063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:13.212063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:13.212063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:13.212063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:13.212063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:13.212063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:13.212063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:13.212063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:13.212063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:13.212063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:13.212063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:13.212063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:13.212894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:13.212894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:13.212894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:13.212894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:13.212894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:13.212894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:13.212894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:13.212894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:13.212894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:13.212894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:13.212894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:13.212894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:13.212894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 14:29:13.212894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:13.212894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 329/637] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Oct 20 14:29:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:13.219180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17380531-1bc3-48a8-92b5-10d7e40b1f7a None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:13.323067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17380531-1bc3-48a8-92b5-10d7e40b1f7a None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:13.358199 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9afd9b-2fba-46c4-b120-6932a88a5c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:13.358810 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9afd9b-2fba-46c4-b120-6932a88a5c0d None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:13.359087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9afd9b-2fba-46c4-b120-6932a88a5c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:13.359462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9afd9b-2fba-46c4-b120-6932a88a5c0d None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:13.360099 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9afd9b-2fba-46c4-b120-6932a88a5c0d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:13.360397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9afd9b-2fba-46c4-b120-6932a88a5c0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:13.361771 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9afd9b-2fba-46c4-b120-6932a88a5c0d None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:13.363619 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:13.366963 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 309/638] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Oct 20 14:29:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:13.372818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9d38b-1cfb-4f9f-b612-f3dc14b22c9c None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:13.490216 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9d38b-1cfb-4f9f-b612-f3dc14b22c9c None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:13.510585 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa502e7-f398-4818-b684-9c241039186d None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:13.510961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa502e7-f398-4818-b684-9c241039186d None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:13.511380 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa502e7-f398-4818-b684-9c241039186d None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:13.514618 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 310/639] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:13.518731 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608310c-695a-4a88-aaf4-a59c93054456 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:13.519085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608310c-695a-4a88-aaf4-a59c93054456 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:13.519434 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608310c-695a-4a88-aaf4-a59c93054456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:13.525802 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66194b55-b688-4908-94e5-b6cff4cde663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:13.526440 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66194b55-b688-4908-94e5-b6cff4cde663 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:13.526724 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66194b55-b688-4908-94e5-b6cff4cde663 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:13.526998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66194b55-b688-4908-94e5-b6cff4cde663 None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:13.527630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66194b55-b688-4908-94e5-b6cff4cde663 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:13.527931 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66194b55-b688-4908-94e5-b6cff4cde663 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:13.529584 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66194b55-b688-4908-94e5-b6cff4cde663 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:13.537898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 330/640] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Oct 20 14:29:13 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:13.543954 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-f608310c-695a-4a88-aaf4-a59c93054456 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:13.546383 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-f608310c-695a-4a88-aaf4-a59c93054456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:13.625227 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 311/641] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 14:29:13.907278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66194b55-b688-4908-94e5-b6cff4cde663 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:13.952674 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:14.010899 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66194b55-b688-4908-94e5-b6cff4cde663 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:14.046806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf9f7e-e391-46a8-a597-c6dfdad613be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:14.047751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf9f7e-e391-46a8-a597-c6dfdad613be None admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:14.048233 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf9f7e-e391-46a8-a597-c6dfdad613be None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:14.048733 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf9f7e-e391-46a8-a597-c6dfdad613be None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:14.049682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf9f7e-e391-46a8-a597-c6dfdad613be None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:14.051294 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf9f7e-e391-46a8-a597-c6dfdad613be None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:14.070738 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 331/642] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Oct 20 14:29:13 2022] POST /identity/v3/services => generated 269 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:29:14.774979 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f90b1-3c1f-403a-8500-b93d04d88f05 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:14.775512 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f90b1-3c1f-403a-8500-b93d04d88f05 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:14.775512 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f90b1-3c1f-403a-8500-b93d04d88f05 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:14.777076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 312/643] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:14.782698 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481815d6-a7f0-490e-a435-74eb8316ccbe None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:14.782987 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481815d6-a7f0-490e-a435-74eb8316ccbe None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:14.783267 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481815d6-a7f0-490e-a435-74eb8316ccbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:14.801713 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-481815d6-a7f0-490e-a435-74eb8316ccbe None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:14.802947 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-481815d6-a7f0-490e-a435-74eb8316ccbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:14.879241 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 332/644] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:14 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 14:29:15.044034 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7bb13-8279-4ca6-afd9-25fc86c7288a None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:15.044227 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7bb13-8279-4ca6-afd9-25fc86c7288a None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:15.045008 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7bb13-8279-4ca6-afd9-25fc86c7288a None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:15.046784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 313/645] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:15.051853 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7d932-69a5-4d84-820f-474355ade382 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:15.052297 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7d932-69a5-4d84-820f-474355ade382 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:15.052389 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7d932-69a5-4d84-820f-474355ade382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:15.071324 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-acd7d932-69a5-4d84-820f-474355ade382 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:15.072489 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-acd7d932-69a5-4d84-820f-474355ade382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:15.095063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:15.142371 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 333/646] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:15 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:15.147553 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7bb13-8279-4ca6-afd9-25fc86c7288a None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:15.260853 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7bb13-8279-4ca6-afd9-25fc86c7288a None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:15.290521 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:15.298551 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2cd6d-168e-4e28-8f4c-4156226fc7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:15.299119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2cd6d-168e-4e28-8f4c-4156226fc7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:15.299406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2cd6d-168e-4e28-8f4c-4156226fc7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:15.299724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2cd6d-168e-4e28-8f4c-4156226fc7f0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:15.300323 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2cd6d-168e-4e28-8f4c-4156226fc7f0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:15.301746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2cd6d-168e-4e28-8f4c-4156226fc7f0 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:15.312209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-7cb2cd6d-168e-4e28-8f4c-4156226fc7f0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 14:29:15.312209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:15.312209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:15.312209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:15.312209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:15.312209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:15.312209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:15.312209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:15.312209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 14:29:15.312209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:15.312209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:15.312209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:15.312209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:15.312209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:15.312209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:15.312209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:15.312209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:15.313206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:15.313206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:15.313206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:15.313206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:15.313206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:15.313206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:15.313206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:15.313206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:15.313206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:15.313206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:15.313206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:15.313206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:15.313206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:15.313206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:15.313206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:15.313206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:15.314064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:15.314064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:15.314064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:15.314064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:15.314064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:15.314064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:15.314064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:15.314064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:15.314064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:15.314064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:15.314064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:15.314064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:15.314064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 14:29:15.314064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:15.318238 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 314/647] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Oct 20 14:29:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:15.319570 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7d932-69a5-4d84-820f-474355ade382 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:15.425183 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7d932-69a5-4d84-820f-474355ade382 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:15.425375 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2cd6d-168e-4e28-8f4c-4156226fc7f0 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:15.470591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6c5d3-a001-4b2b-8d38-368f52dd0e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:15.471209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6c5d3-a001-4b2b-8d38-368f52dd0e0e None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:15.471485 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6c5d3-a001-4b2b-8d38-368f52dd0e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:15.471756 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6c5d3-a001-4b2b-8d38-368f52dd0e0e None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:15.472926 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6c5d3-a001-4b2b-8d38-368f52dd0e0e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:15.473282 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6c5d3-a001-4b2b-8d38-368f52dd0e0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:15.475165 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6c5d3-a001-4b2b-8d38-368f52dd0e0e None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:15.481992 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 334/648] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Oct 20 14:29:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:15.487491 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6c5d3-a001-4b2b-8d38-368f52dd0e0e None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:15.513169 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:15.541040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2cd6d-168e-4e28-8f4c-4156226fc7f0 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:15.576968 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efd5f4-c153-4723-b30f-247b1bdf9c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:15.577695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efd5f4-c153-4723-b30f-247b1bdf9c27 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:15.578000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efd5f4-c153-4723-b30f-247b1bdf9c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:15.578271 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efd5f4-c153-4723-b30f-247b1bdf9c27 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:15.588923 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6efd5f4-c153-4723-b30f-247b1bdf9c27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:29:15.594452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-a6efd5f4-c153-4723-b30f-247b1bdf9c27 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 14:29:15.594452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:15.594452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:15.594452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:15.594452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:15.594452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:15.594452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:15.594452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:15.594452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:15.594452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:15.594452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:15.594452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:15.594452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:29:15.594452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:29:15.594452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:29:15.594452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:29:15.595581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:29:15.595581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:29:15.595581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:29:15.595581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:29:15.595581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:15.595581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:15.595581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:15.595581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:15.595581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:15.595581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:15.595581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:15.595581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:15.595581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:15.595581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:15.595581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:15.595581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:15.596429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:15.596429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:15.596429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:15.596429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:15.596429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:29:15.596429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:29:15.596429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:29:15.596429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:29:15.596429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:29:15.596429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:29:15.596429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 14:29:15.596429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:15.596429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 315/649] 10.222.0.17 () {56 vars in 1120 bytes} [Thu Oct 20 14:29:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:15.598975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6c5d3-a001-4b2b-8d38-368f52dd0e0e None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:15.601340 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efd5f4-c153-4723-b30f-247b1bdf9c27 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:15.635330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fcbd5-0c37-42b7-b77a-62da7ed66fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:15.636254 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fcbd5-0c37-42b7-b77a-62da7ed66fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:15.636728 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fcbd5-0c37-42b7-b77a-62da7ed66fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:15.637190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fcbd5-0c37-42b7-b77a-62da7ed66fe9 None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:15.638019 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613fcbd5-0c37-42b7-b77a-62da7ed66fe9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:15.638634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613fcbd5-0c37-42b7-b77a-62da7ed66fe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:15.640190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613fcbd5-0c37-42b7-b77a-62da7ed66fe9 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:15.649936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 335/650] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Oct 20 14:29:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:15.663328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:15.720114 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efd5f4-c153-4723-b30f-247b1bdf9c27 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:15.760579 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0382d8-14d9-491a-99d6-9cefd96f2245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:15.761222 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0382d8-14d9-491a-99d6-9cefd96f2245 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:15.761503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0382d8-14d9-491a-99d6-9cefd96f2245 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:15.761776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0382d8-14d9-491a-99d6-9cefd96f2245 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:15.762516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0382d8-14d9-491a-99d6-9cefd96f2245 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:15.762818 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0382d8-14d9-491a-99d6-9cefd96f2245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:15.765264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0382d8-14d9-491a-99d6-9cefd96f2245 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:15.775746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 316/651] 10.222.0.17 () {56 vars in 1115 bytes} [Thu Oct 20 14:29:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:15.782341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fcbd5-0c37-42b7-b77a-62da7ed66fe9 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:15.872775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f879c6-d4d1-44ca-8377-145e90f01819 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:15.873086 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f879c6-d4d1-44ca-8377-145e90f01819 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:15.873531 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f879c6-d4d1-44ca-8377-145e90f01819 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:15.875300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 317/652] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:15.880812 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7217749-70a4-4ced-8454-8816b2d2b442 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:15.881156 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7217749-70a4-4ced-8454-8816b2d2b442 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:15.881430 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7217749-70a4-4ced-8454-8816b2d2b442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:15.886499 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:15.902516 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fcbd5-0c37-42b7-b77a-62da7ed66fe9 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:15.904707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-a7217749-70a4-4ced-8454-8816b2d2b442 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:15.906152 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a7217749-70a4-4ced-8454-8816b2d2b442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:15.946975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda69d04-b7ef-4fa1-adf7-bc66d1ca9d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:15.947693 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda69d04-b7ef-4fa1-adf7-bc66d1ca9d1a None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:15.948064 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda69d04-b7ef-4fa1-adf7-bc66d1ca9d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:15.948338 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda69d04-b7ef-4fa1-adf7-bc66d1ca9d1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:15.962737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda69d04-b7ef-4fa1-adf7-bc66d1ca9d1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:15.964487 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda69d04-b7ef-4fa1-adf7-bc66d1ca9d1a None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:15.984580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-bda69d04-b7ef-4fa1-adf7-bc66d1ca9d1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:15.984580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:15.984580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:15.984580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:15.984580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:15.984580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:15.984580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:15.984580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:15.984580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:15.984580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:15.984580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:15.984580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:15.984580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:29:15.984580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:29:15.984580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:29:15.984580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:29:15.985773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:15.985773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:15.985773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:15.985773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:15.985773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:15.985773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:15.985773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:15.985773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:15.985773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:15.985773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:15.985773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:15.985773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:15.985773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:15.985773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:15.985773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:15.985773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:15.985773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:29:15.986682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:29:15.986682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:15.986682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:15.986682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 336/653] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:15.991739 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda69d04-b7ef-4fa1-adf7-bc66d1ca9d1a None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:15.993186 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 318/654] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:15 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:16.095965 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda69d04-b7ef-4fa1-adf7-bc66d1ca9d1a None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:16.130566 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16368580-8c57-4afc-b389-2aafee053a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:16.131094 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16368580-8c57-4afc-b389-2aafee053a7b None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:16.131372 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16368580-8c57-4afc-b389-2aafee053a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:16.131646 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16368580-8c57-4afc-b389-2aafee053a7b None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:16.132294 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16368580-8c57-4afc-b389-2aafee053a7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:16.132595 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16368580-8c57-4afc-b389-2aafee053a7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:16.134001 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16368580-8c57-4afc-b389-2aafee053a7b None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:16.141979 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:16.147604 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 337/655] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:16.155436 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7217749-70a4-4ced-8454-8816b2d2b442 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:16.214935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:16.269139 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16368580-8c57-4afc-b389-2aafee053a7b None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:16.270866 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7217749-70a4-4ced-8454-8816b2d2b442 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:16.308240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4e7b5-6a71-42b4-95db-fd15b9bd0507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:16.308868 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4e7b5-6a71-42b4-95db-fd15b9bd0507 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:16.309149 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4e7b5-6a71-42b4-95db-fd15b9bd0507 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:16.309415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4e7b5-6a71-42b4-95db-fd15b9bd0507 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:16.318224 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4e7b5-6a71-42b4-95db-fd15b9bd0507 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:16.319681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4e7b5-6a71-42b4-95db-fd15b9bd0507 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:16.332751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-17c4e7b5-6a71-42b4-95db-fd15b9bd0507 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 14:29:16.332751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:16.332751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:16.332751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:16.332751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:16.332751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:16.332751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:16.332751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:16.332751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:16.332751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:16.332751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:16.332751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:16.332751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:29:16.332751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:29:16.332751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:29:16.332751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:29:16.333737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:16.333737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:16.333737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:29:16.333737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:16.333737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:29:16.333737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:16.333737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:16.333737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:16.333737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:16.333737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:16.333737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:16.333737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:16.333737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:16.333737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:16.333737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:16.333737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:16.333737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:16.333737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:16.334683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:16.334683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:16.334683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:29:16.334683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:29:16.334683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:29:16.334683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:29:16.334683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:29:16.334683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:29:16.334683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 14:29:16.334683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:16.334683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 319/656] 10.222.0.17 () {56 vars in 1117 bytes} [Thu Oct 20 14:29:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:16.335277 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31299c-a7ce-45b2-bf7b-120ab97717a3 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:16.335277 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31299c-a7ce-45b2-bf7b-120ab97717a3 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:16.336199 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31299c-a7ce-45b2-bf7b-120ab97717a3 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:16.336856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 320/657] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:16.341433 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31299c-a7ce-45b2-bf7b-120ab97717a3 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:16.383661 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16368580-8c57-4afc-b389-2aafee053a7b None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:16.419473 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4fe0e-82bf-48c3-aa31-55d2fcf9569a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:16.420075 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4fe0e-82bf-48c3-aa31-55d2fcf9569a None admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:16.420352 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4fe0e-82bf-48c3-aa31-55d2fcf9569a None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:16.420619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4fe0e-82bf-48c3-aa31-55d2fcf9569a None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:16.421275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4fe0e-82bf-48c3-aa31-55d2fcf9569a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:16.422674 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4fe0e-82bf-48c3-aa31-55d2fcf9569a None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:16.437880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 338/658] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Oct 20 14:29:16 2022] POST /identity/v3/services => generated 241 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:29:16.439000 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9c5ed-36f5-4c2a-b2c8-8f8bd1917803 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:16.439279 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9c5ed-36f5-4c2a-b2c8-8f8bd1917803 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:16.439603 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9c5ed-36f5-4c2a-b2c8-8f8bd1917803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:16.459976 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-e1a9c5ed-36f5-4c2a-b2c8-8f8bd1917803 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:16.461236 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e1a9c5ed-36f5-4c2a-b2c8-8f8bd1917803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:16.470191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31299c-a7ce-45b2-bf7b-120ab97717a3 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:16.472558 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:16.517593 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c832d6-8ed8-4094-a5f8-dd1972493745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:16.518657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c832d6-8ed8-4094-a5f8-dd1972493745 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:16.519424 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c832d6-8ed8-4094-a5f8-dd1972493745 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:16.520460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c832d6-8ed8-4094-a5f8-dd1972493745 None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:16.521786 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c832d6-8ed8-4094-a5f8-dd1972493745 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:16.522353 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c832d6-8ed8-4094-a5f8-dd1972493745 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:16.524267 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c832d6-8ed8-4094-a5f8-dd1972493745 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:16.527203 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:16.551993 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 321/660] 10.222.0.17 () {56 vars in 1149 bytes} [Thu Oct 20 14:29:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:16.557889 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 339/660] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:16 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:16.563157 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c832d6-8ed8-4094-a5f8-dd1972493745 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:16.674189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c832d6-8ed8-4094-a5f8-dd1972493745 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:16.710044 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997da5d-a70f-47b2-bc69-2d62633f71ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:16.710674 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997da5d-a70f-47b2-bc69-2d62633f71ec None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:16.710959 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997da5d-a70f-47b2-bc69-2d62633f71ec None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:16.711234 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997da5d-a70f-47b2-bc69-2d62633f71ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:16.722531 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997da5d-a70f-47b2-bc69-2d62633f71ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:16.724036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997da5d-a70f-47b2-bc69-2d62633f71ec None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:16.739240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-3997da5d-a70f-47b2-bc69-2d62633f71ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:16.739240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:16.739240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:16.739240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:16.739240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:16.739240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:16.739240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:16.739240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:16.739240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:16.739240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:16.739240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:16.739240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:16.739240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:29:16.739240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:29:16.739240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:29:16.739240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:29:16.740208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:16.740208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:16.740208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:16.740208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:16.740208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:16.740208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:16.740208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:16.740208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:16.740208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:16.740208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:16.740208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:16.740208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:16.740208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:16.740208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:16.740208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:16.740208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:16.740208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:29:16.741100 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:29:16.741100 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:16.741100 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:16.741100 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 322/661] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:16.746386 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9c5ed-36f5-4c2a-b2c8-8f8bd1917803 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:16.821436 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997da5d-a70f-47b2-bc69-2d62633f71ec None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:16.842107 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:16.862869 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9c5ed-36f5-4c2a-b2c8-8f8bd1917803 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:16.909437 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c276b-1cf8-4c83-b826-432de39b96e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:16.910098 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c276b-1cf8-4c83-b826-432de39b96e9 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:16.910381 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c276b-1cf8-4c83-b826-432de39b96e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:16.910690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c276b-1cf8-4c83-b826-432de39b96e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:16.911667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c276b-1cf8-4c83-b826-432de39b96e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:16.912027 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c276b-1cf8-4c83-b826-432de39b96e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:16.913425 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c276b-1cf8-4c83-b826-432de39b96e9 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:16.928992 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 340/662] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:16.934117 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c276b-1cf8-4c83-b826-432de39b96e9 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:16.957617 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997da5d-a70f-47b2-bc69-2d62633f71ec None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:16.993993 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58a728-17a1-4894-92d6-3055e172f820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:16.994682 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58a728-17a1-4894-92d6-3055e172f820 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:16.995242 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58a728-17a1-4894-92d6-3055e172f820 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:16.995242 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58a728-17a1-4894-92d6-3055e172f820 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:16.995857 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58a728-17a1-4894-92d6-3055e172f820 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:16.997760 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58a728-17a1-4894-92d6-3055e172f820 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:16.999861 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:17.007165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-1b58a728-17a1-4894-92d6-3055e172f820 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 14:29:17.007165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:17.007165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:17.007165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:17.007165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:17.007165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:17.007165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:17.007165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:17.007165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 14:29:17.007165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:17.007165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:17.007165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:17.007165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:17.007165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:17.007165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:17.007165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:17.008283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:17.008283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:17.008283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:17.008283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:17.008283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:17.008283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:17.008283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:17.008283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:17.008283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:17.008283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:17.008283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:17.008283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:17.008283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:17.008283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:17.008283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:17.008283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:17.008283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:17.009345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:17.009345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:17.009345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:17.009345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:17.009345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:17.009345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:17.009345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:17.009345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:17.009345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:17.009345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:17.009345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:17.009345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:17.009345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 14:29:17.009345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:17.010952 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 323/663] 10.222.0.17 () {56 vars in 1132 bytes} [Thu Oct 20 14:29:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:29:17.018894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58a728-17a1-4894-92d6-3055e172f820 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:17.048032 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c276b-1cf8-4c83-b826-432de39b96e9 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:17.084741 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27962076-85f0-486c-b721-e1c8be411af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:17.085699 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27962076-85f0-486c-b721-e1c8be411af1 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:17.086150 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27962076-85f0-486c-b721-e1c8be411af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:17.086567 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27962076-85f0-486c-b721-e1c8be411af1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:17.094060 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27962076-85f0-486c-b721-e1c8be411af1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:17.096004 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27962076-85f0-486c-b721-e1c8be411af1 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:17.107411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:17.115340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-27962076-85f0-486c-b721-e1c8be411af1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:29:17.115340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:17.115340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:17.115340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:17.115340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:17.115340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:17.115340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:17.115340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:17.115340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:17.115340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:17.115340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:17.115340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:17.115340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:29:17.115340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:29:17.115340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:29:17.116418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:29:17.116418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:17.116418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:17.116418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:17.116418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:17.116418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:17.116418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:17.116418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:17.116418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:17.116418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:17.116418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:17.116418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:17.116418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:17.116418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:17.116418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:17.116418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:17.116418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:17.117594 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:29:17.117594 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:29:17.117594 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:29:17.117594 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:29:17.117594 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:29:17.117594 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:29:17.117594 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:29:17.117594 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:17.120211 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 341/664] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:29:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:29:17.126433 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27962076-85f0-486c-b721-e1c8be411af1 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:17.140214 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58a728-17a1-4894-92d6-3055e172f820 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:17.197252 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59825d9e-5c25-43fd-b405-eb8913e72b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:17.198286 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59825d9e-5c25-43fd-b405-eb8913e72b9e None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:17.198737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59825d9e-5c25-43fd-b405-eb8913e72b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:17.199153 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59825d9e-5c25-43fd-b405-eb8913e72b9e None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:17.200395 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59825d9e-5c25-43fd-b405-eb8913e72b9e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:17.201767 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59825d9e-5c25-43fd-b405-eb8913e72b9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:17.203494 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59825d9e-5c25-43fd-b405-eb8913e72b9e None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:17.210058 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 324/665] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Oct 20 14:29:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:17.215077 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59825d9e-5c25-43fd-b405-eb8913e72b9e None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:17.236574 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27962076-85f0-486c-b721-e1c8be411af1 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:17.246188 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:17.273410 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db371e-74b0-4ea6-842a-cba7b4ff6f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:17.274215 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db371e-74b0-4ea6-842a-cba7b4ff6f65 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:17.274605 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db371e-74b0-4ea6-842a-cba7b4ff6f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:17.274977 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db371e-74b0-4ea6-842a-cba7b4ff6f65 None admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:17.275769 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db371e-74b0-4ea6-842a-cba7b4ff6f65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:17.276179 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db371e-74b0-4ea6-842a-cba7b4ff6f65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:17.277765 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db371e-74b0-4ea6-842a-cba7b4ff6f65 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:17.296671 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 342/666] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:29:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:17.297717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db371e-74b0-4ea6-842a-cba7b4ff6f65 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:17.357705 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59825d9e-5c25-43fd-b405-eb8913e72b9e None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:17.403007 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0e2d7-500c-45a8-a6ca-d78b0570538d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:17.403814 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0e2d7-500c-45a8-a6ca-d78b0570538d None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:17.404349 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0e2d7-500c-45a8-a6ca-d78b0570538d None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:17.404720 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0e2d7-500c-45a8-a6ca-d78b0570538d None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:17.405481 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0e2d7-500c-45a8-a6ca-d78b0570538d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:17.405922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0e2d7-500c-45a8-a6ca-d78b0570538d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:17.406149 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db371e-74b0-4ea6-842a-cba7b4ff6f65 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:17.407466 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0e2d7-500c-45a8-a6ca-d78b0570538d None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:17.414321 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 325/667] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Oct 20 14:29:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:17.422582 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0e2d7-500c-45a8-a6ca-d78b0570538d None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:17.424117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:17.446854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e0872-80da-41da-aedc-a8fe7e8ae19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:17.447937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e0872-80da-41da-aedc-a8fe7e8ae19f None admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:17.448465 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e0872-80da-41da-aedc-a8fe7e8ae19f None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:17.448944 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e0872-80da-41da-aedc-a8fe7e8ae19f None admin] PATH_INFO: `/v3/projects/88613722e7dc4950b5e47a1d92331575/users/a1bdbce1b3d047cfa5ddf72f902ecd5d/roles/7fb83e6f9dc74b8ab285f4540dea633d` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:17.453391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e0872-80da-41da-aedc-a8fe7e8ae19f None admin] RBAC: Authorizing `identity:create_grant(project_id=88613722e7dc4950b5e47a1d92331575, user_id=a1bdbce1b3d047cfa5ddf72f902ecd5d, role_id=7fb83e6f9dc74b8ab285f4540dea633d)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:17.456174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e0872-80da-41da-aedc-a8fe7e8ae19f None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:17.482258 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 343/668] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:29:17 2022] PUT /identity/v3/projects/88613722e7dc4950b5e47a1d92331575/users/a1bdbce1b3d047cfa5ddf72f902ecd5d/roles/7fb83e6f9dc74b8ab285f4540dea633d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:29:17.537116 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0e2d7-500c-45a8-a6ca-d78b0570538d None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:17.576673 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b12a41-446d-4379-b6a1-096bbd980b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:17.577300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b12a41-446d-4379-b6a1-096bbd980b9b None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:17.577583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b12a41-446d-4379-b6a1-096bbd980b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:17.577872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b12a41-446d-4379-b6a1-096bbd980b9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:17.578610 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b12a41-446d-4379-b6a1-096bbd980b9b None admin] RBAC: Adding query filter params (interface=public, service_id=98a010054d3c48e2b590bc75861237a0, region_id=RegionOne) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:17.578924 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b12a41-446d-4379-b6a1-096bbd980b9b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:17.580319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b12a41-446d-4379-b6a1-096bbd980b9b None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:17.586518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 326/669] 10.222.0.17 () {56 vars in 1251 bytes} [Thu Oct 20 14:29:17 2022] GET /identity/v3/endpoints?service_id=98a010054d3c48e2b590bc75861237a0&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:17.593416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e0872-80da-41da-aedc-a8fe7e8ae19f None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:17.623745 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:17.704971 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e0872-80da-41da-aedc-a8fe7e8ae19f None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:17.740760 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15583ce0-2580-4fce-811b-d8afd83e3234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:17.741383 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15583ce0-2580-4fce-811b-d8afd83e3234 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:17.741666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15583ce0-2580-4fce-811b-d8afd83e3234 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:17.741966 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15583ce0-2580-4fce-811b-d8afd83e3234 None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:17.742575 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15583ce0-2580-4fce-811b-d8afd83e3234 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:17.743956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15583ce0-2580-4fce-811b-d8afd83e3234 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:17.750645 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 344/670] 10.222.0.17 () {56 vars in 1087 bytes} [Thu Oct 20 14:29:17 2022] GET /identity/v3/services => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:29:17.951405 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328a29e-7017-4dda-8376-1e3630c06c0d None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:17.951916 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328a29e-7017-4dda-8376-1e3630c06c0d None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:17.951916 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328a29e-7017-4dda-8376-1e3630c06c0d None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:17.953531 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 327/671] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:17.958934 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d2c21-4981-4261-b8b2-ad1f2d364bc0 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:17.959163 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d2c21-4981-4261-b8b2-ad1f2d364bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:17.959438 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d2c21-4981-4261-b8b2-ad1f2d364bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:17.979326 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-6b8d2c21-4981-4261-b8b2-ad1f2d364bc0 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:17.980511 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-6b8d2c21-4981-4261-b8b2-ad1f2d364bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:18.050907 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 345/672] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:17 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:18.324257 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328a29e-7017-4dda-8376-1e3630c06c0d None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:18.394772 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:18.430471 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328a29e-7017-4dda-8376-1e3630c06c0d None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:18.469626 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e297a-0cd7-4fe5-97e5-4ca981914f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:18.470270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e297a-0cd7-4fe5-97e5-4ca981914f5e None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:18.470551 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e297a-0cd7-4fe5-97e5-4ca981914f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:18.470824 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e297a-0cd7-4fe5-97e5-4ca981914f5e None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:18.471493 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e297a-0cd7-4fe5-97e5-4ca981914f5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:18.472857 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e297a-0cd7-4fe5-97e5-4ca981914f5e None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:18.490543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 328/673] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Oct 20 14:29:18 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:29:18.790732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae145f57-c90f-4d5e-b690-86a390407474 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:18.791217 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae145f57-c90f-4d5e-b690-86a390407474 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:18.791217 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae145f57-c90f-4d5e-b690-86a390407474 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:18.792782 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 346/674] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:18.798178 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75066c7-fa44-4476-9b13-4e10863a874c None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:18.798472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75066c7-fa44-4476-9b13-4e10863a874c None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:18.798750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75066c7-fa44-4476-9b13-4e10863a874c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:18.817736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-a75066c7-fa44-4476-9b13-4e10863a874c None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:18.819044 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a75066c7-fa44-4476-9b13-4e10863a874c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:18.896233 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 329/675] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:19.169720 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae145f57-c90f-4d5e-b690-86a390407474 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:19.200037 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:19.284006 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae145f57-c90f-4d5e-b690-86a390407474 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:19.319851 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2cace-94c1-4a0a-94da-df19d6d59f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:19.320839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2cace-94c1-4a0a-94da-df19d6d59f99 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:19.321297 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2cace-94c1-4a0a-94da-df19d6d59f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:19.321747 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2cace-94c1-4a0a-94da-df19d6d59f99 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:19.322552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2cace-94c1-4a0a-94da-df19d6d59f99 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:19.324137 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2cace-94c1-4a0a-94da-df19d6d59f99 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:19.333914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-94f2cace-94c1-4a0a-94da-df19d6d59f99 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 14:29:19.333914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:19.333914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:19.333914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:19.333914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:19.333914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:19.333914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:19.333914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:19.333914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 14:29:19.333914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:19.333914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:19.333914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:19.333914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:19.333914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:19.333914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:19.333914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:19.333914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:19.334909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:19.334909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:19.334909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:19.334909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:19.334909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:19.334909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:19.334909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:19.334909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:19.334909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:19.334909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:19.334909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:19.334909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:19.334909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:19.334909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:19.334909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:19.334909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:19.335752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:19.335752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:19.335752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:19.335752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:19.335752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:19.335752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:19.335752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:19.335752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:19.335752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:19.335752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:19.335752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:19.335752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:19.335752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 14:29:19.335752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:19.338182 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 347/676] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Oct 20 14:29:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:19.346911 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75066c7-fa44-4476-9b13-4e10863a874c None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:19.403255 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:19.455147 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75066c7-fa44-4476-9b13-4e10863a874c None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:19.490799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7ce59-cc4a-4154-ab95-69116ef40865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:19.491408 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7ce59-cc4a-4154-ab95-69116ef40865 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:19.491689 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7ce59-cc4a-4154-ab95-69116ef40865 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:19.491961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7ce59-cc4a-4154-ab95-69116ef40865 None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:19.492594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7ce59-cc4a-4154-ab95-69116ef40865 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:19.492898 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7ce59-cc4a-4154-ab95-69116ef40865 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:19.494375 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7ce59-cc4a-4154-ab95-69116ef40865 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:19.499443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 330/677] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Oct 20 14:29:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:19.507230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2cace-94c1-4a0a-94da-df19d6d59f99 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:19.597105 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:19.614033 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2cace-94c1-4a0a-94da-df19d6d59f99 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:19.652244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97abcd4-f592-4a4d-b3a2-e19a7bf9f72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:19.652873 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97abcd4-f592-4a4d-b3a2-e19a7bf9f72d None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:19.653149 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97abcd4-f592-4a4d-b3a2-e19a7bf9f72d None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:19.653460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97abcd4-f592-4a4d-b3a2-e19a7bf9f72d None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:19.654825 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97abcd4-f592-4a4d-b3a2-e19a7bf9f72d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:19.655132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97abcd4-f592-4a4d-b3a2-e19a7bf9f72d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:19.656557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97abcd4-f592-4a4d-b3a2-e19a7bf9f72d None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:19.662807 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 348/678] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Oct 20 14:29:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:19.668800 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7ce59-cc4a-4154-ab95-69116ef40865 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:19.746632 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebea0fb-4df2-4cf2-8aec-ba38c310c3ec None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:19.746932 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebea0fb-4df2-4cf2-8aec-ba38c310c3ec None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:19.747098 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebea0fb-4df2-4cf2-8aec-ba38c310c3ec None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:19.752986 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 349/679] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:19.754513 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40ad1a-8a37-4e10-b5bc-4fad5eceadc7 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:19.754795 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40ad1a-8a37-4e10-b5bc-4fad5eceadc7 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:19.755069 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40ad1a-8a37-4e10-b5bc-4fad5eceadc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:19.773712 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-2e40ad1a-8a37-4e10-b5bc-4fad5eceadc7 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:19.775195 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2e40ad1a-8a37-4e10-b5bc-4fad5eceadc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:19.776722 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7ce59-cc4a-4154-ab95-69116ef40865 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:19.798903 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:19.817546 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78d537-aa40-4c62-bd60-66a40dc86c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:19.821873 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78d537-aa40-4c62-bd60-66a40dc86c67 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:19.821873 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78d537-aa40-4c62-bd60-66a40dc86c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:19.821873 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78d537-aa40-4c62-bd60-66a40dc86c67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:19.821873 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78d537-aa40-4c62-bd60-66a40dc86c67 None admin] RBAC: Adding query filter params (interface=public, service_id=e9505e5402784d67b884ffb80b8bb6b9, region_id=RegionOne) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:19.821873 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78d537-aa40-4c62-bd60-66a40dc86c67 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:19.821873 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78d537-aa40-4c62-bd60-66a40dc86c67 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:19.831253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 331/680] 10.222.0.17 () {56 vars in 1251 bytes} [Thu Oct 20 14:29:19 2022] GET /identity/v3/endpoints?service_id=e9505e5402784d67b884ffb80b8bb6b9&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:19.836700 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78d537-aa40-4c62-bd60-66a40dc86c67 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:19.859340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 350/681] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 14:29:19.944542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78d537-aa40-4c62-bd60-66a40dc86c67 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:19.980141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59d765-bcc2-4e35-9efd-39519c494c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:19.981127 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59d765-bcc2-4e35-9efd-39519c494c50 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:19.981678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59d765-bcc2-4e35-9efd-39519c494c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:19.982162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59d765-bcc2-4e35-9efd-39519c494c50 None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:19.982946 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59d765-bcc2-4e35-9efd-39519c494c50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:19.984475 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59d765-bcc2-4e35-9efd-39519c494c50 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:19.990979 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 332/682] 10.222.0.17 () {56 vars in 1087 bytes} [Thu Oct 20 14:29:19 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:29:20.131818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40ad1a-8a37-4e10-b5bc-4fad5eceadc7 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:20.157369 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2690f36-cade-4ca2-a1c5-9d3023f6d88f None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:20.158051 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2690f36-cade-4ca2-a1c5-9d3023f6d88f None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:20.158552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2690f36-cade-4ca2-a1c5-9d3023f6d88f None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:20.160238 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 333/683] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:29:20.166634 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef5a33-5b62-42e6-b5cd-2bf7d25491e3 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:20.166996 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef5a33-5b62-42e6-b5cd-2bf7d25491e3 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:20.167348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef5a33-5b62-42e6-b5cd-2bf7d25491e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:20.191341 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-34ef5a33-5b62-42e6-b5cd-2bf7d25491e3 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:20.192574 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-34ef5a33-5b62-42e6-b5cd-2bf7d25491e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:20.230714 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:20.245214 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:20.252562 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40ad1a-8a37-4e10-b5bc-4fad5eceadc7 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:20.274613 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 334/684] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:20.297143 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92fcf3-0766-49ce-ab6b-70c6526d5fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:20.297820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92fcf3-0766-49ce-ab6b-70c6526d5fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:20.298122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92fcf3-0766-49ce-ab6b-70c6526d5fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:20.298393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92fcf3-0766-49ce-ab6b-70c6526d5fb6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:20.309494 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92fcf3-0766-49ce-ab6b-70c6526d5fb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:29:20.314591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-6d92fcf3-0766-49ce-ab6b-70c6526d5fb6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 14:29:20.314591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:20.314591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:20.314591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:20.314591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:20.314591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:20.314591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:20.314591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:20.314591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:20.314591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:20.314591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:20.314591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:20.314591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:29:20.314591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:29:20.314591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:29:20.314591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:29:20.315502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:29:20.315502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:29:20.315502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:29:20.315502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:29:20.315502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:20.315502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:20.315502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:20.315502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:20.315502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:20.315502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:20.315502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:20.315502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:20.315502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:20.315502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:20.315502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:20.315502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:20.316332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:20.316332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:20.316332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:20.316332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:20.316332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:29:20.316332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:29:20.316332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:29:20.316332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:29:20.316332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:29:20.316332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:29:20.316332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 14:29:20.316332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:20.320642 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 351/685] 10.222.0.17 () {56 vars in 1120 bytes} [Thu Oct 20 14:29:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:20.322038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef5a33-5b62-42e6-b5cd-2bf7d25491e3 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:20.424388 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef5a33-5b62-42e6-b5cd-2bf7d25491e3 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:20.458742 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32b339-e66c-46ce-89b6-70667ee05606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:20.459350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32b339-e66c-46ce-89b6-70667ee05606 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:20.459625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32b339-e66c-46ce-89b6-70667ee05606 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:20.459893 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32b339-e66c-46ce-89b6-70667ee05606 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:20.460553 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32b339-e66c-46ce-89b6-70667ee05606 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:20.460851 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32b339-e66c-46ce-89b6-70667ee05606 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:20.462332 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32b339-e66c-46ce-89b6-70667ee05606 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:20.477986 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 335/686] 10.222.0.17 () {56 vars in 1115 bytes} [Thu Oct 20 14:29:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:20.480299 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92fcf3-0766-49ce-ab6b-70c6526d5fb6 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:20.553968 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32b339-e66c-46ce-89b6-70667ee05606 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:20.588438 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92fcf3-0766-49ce-ab6b-70c6526d5fb6 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:20.607463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:20.628864 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919f9a8-7878-413f-b6c7-95941448553c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:20.629994 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919f9a8-7878-413f-b6c7-95941448553c None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:20.630482 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919f9a8-7878-413f-b6c7-95941448553c None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:20.631035 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919f9a8-7878-413f-b6c7-95941448553c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:20.641127 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:20.643331 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919f9a8-7878-413f-b6c7-95941448553c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:20.645364 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919f9a8-7878-413f-b6c7-95941448553c None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:20.663609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-9919f9a8-7878-413f-b6c7-95941448553c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:20.663609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:20.663609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:20.663609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:20.663609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:20.663609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:20.663609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:20.663609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:20.663609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:20.663609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:20.663609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:20.663609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:20.663609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:29:20.663609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:29:20.663609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:29:20.663609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:29:20.664620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:20.664620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:20.664620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:20.664620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:20.664620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:20.664620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:20.664620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:20.664620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:20.664620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:20.664620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:20.664620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:20.664620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:20.664620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:20.664620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:20.664620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:20.664620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:20.664620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:29:20.665521 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:29:20.665521 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:20.665521 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:20.667704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 352/687] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:20.676301 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919f9a8-7878-413f-b6c7-95941448553c None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:20.690809 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32b339-e66c-46ce-89b6-70667ee05606 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:20.728599 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81e8aa-96d0-46d6-88ff-ff7c4e48c713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:20.729239 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81e8aa-96d0-46d6-88ff-ff7c4e48c713 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:20.729521 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81e8aa-96d0-46d6-88ff-ff7c4e48c713 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:20.729794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81e8aa-96d0-46d6-88ff-ff7c4e48c713 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:20.730657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81e8aa-96d0-46d6-88ff-ff7c4e48c713 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:20.732408 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81e8aa-96d0-46d6-88ff-ff7c4e48c713 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:20.741776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-3d81e8aa-96d0-46d6-88ff-ff7c4e48c713 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 14:29:20.741776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:20.741776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:20.741776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:20.741776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:20.741776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:20.741776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:20.741776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:20.741776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 14:29:20.741776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:20.741776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:20.741776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:20.741776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:20.741776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:20.741776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:20.741776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:20.742756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:20.742756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:20.742756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:20.742756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:20.742756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:20.742756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:20.742756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:20.742756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:20.742756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:20.742756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:20.742756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:20.742756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:20.742756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:20.742756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:20.742756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:20.742756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:20.742756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:20.744029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:20.744029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:20.744029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:20.744029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:20.744029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:20.744029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:20.744029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:20.744029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:20.744029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:20.744029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:20.744029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:20.744029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:20.744029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 14:29:20.744029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:20.744029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 336/688] 10.222.0.17 () {56 vars in 1132 bytes} [Thu Oct 20 14:29:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:29:20.749187 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81e8aa-96d0-46d6-88ff-ff7c4e48c713 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:20.814425 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919f9a8-7878-413f-b6c7-95941448553c None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:20.853369 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0d8e1-3026-4ab0-8492-c502812df353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:20.854007 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0d8e1-3026-4ab0-8492-c502812df353 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:20.854286 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0d8e1-3026-4ab0-8492-c502812df353 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:20.854580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0d8e1-3026-4ab0-8492-c502812df353 None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:20.855176 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0d8e1-3026-4ab0-8492-c502812df353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:20.855602 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0d8e1-3026-4ab0-8492-c502812df353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:20.857438 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0d8e1-3026-4ab0-8492-c502812df353 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:20.869397 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 353/689] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:20.872870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81e8aa-96d0-46d6-88ff-ff7c4e48c713 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:20.874685 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:20.876989 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfdbd7-9859-4454-8ecf-51d87ff8d0ce None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:20.877360 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfdbd7-9859-4454-8ecf-51d87ff8d0ce None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:20.877706 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfdbd7-9859-4454-8ecf-51d87ff8d0ce None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:20.883311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 354/690] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:20 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:20.883311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfdbd7-9859-4454-8ecf-51d87ff8d0ce None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:20.908584 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511fd54-848d-4295-9b8c-f217bc5381a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:20.909348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511fd54-848d-4295-9b8c-f217bc5381a2 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:20.909630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511fd54-848d-4295-9b8c-f217bc5381a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:20.909928 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511fd54-848d-4295-9b8c-f217bc5381a2 None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:20.910566 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511fd54-848d-4295-9b8c-f217bc5381a2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:20.910865 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511fd54-848d-4295-9b8c-f217bc5381a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:20.912256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511fd54-848d-4295-9b8c-f217bc5381a2 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:20.923359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 337/691] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Oct 20 14:29:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:20.923359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eba84-8eb2-45b2-8c66-c5929796df9e None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:20.923359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eba84-8eb2-45b2-8c66-c5929796df9e None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:20.923359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eba84-8eb2-45b2-8c66-c5929796df9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:20.940881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-0e2eba84-8eb2-45b2-8c66-c5929796df9e None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:20.942004 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-0e2eba84-8eb2-45b2-8c66-c5929796df9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:20.948217 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:21.001991 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfdbd7-9859-4454-8ecf-51d87ff8d0ce None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:21.016795 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 338/692] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:21.017751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2eba84-8eb2-45b2-8c66-c5929796df9e None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:21.040121 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579dcc6-a810-46df-869b-04367564a6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:21.040758 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579dcc6-a810-46df-869b-04367564a6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:21.041093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579dcc6-a810-46df-869b-04367564a6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:21.041372 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579dcc6-a810-46df-869b-04367564a6c9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:21.049384 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579dcc6-a810-46df-869b-04367564a6c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:21.050945 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579dcc6-a810-46df-869b-04367564a6c9 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:21.064159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-a579dcc6-a810-46df-869b-04367564a6c9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 14:29:21.064159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:21.064159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:21.064159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:21.064159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:21.064159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:21.064159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:21.064159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:21.064159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:21.064159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:21.064159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:21.064159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:21.064159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:29:21.064159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:29:21.064159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:29:21.064159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:29:21.065133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:21.065133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:21.065133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:29:21.065133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:21.065133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:29:21.065133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:21.065133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:21.065133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:21.065133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:21.065133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:21.065133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:21.065133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:21.065133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:21.065133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:21.065133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:21.065133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:21.065133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:21.065133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:21.066704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:21.066704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:21.066704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:29:21.066704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:29:21.066704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:29:21.066704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:29:21.066704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:29:21.066704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:29:21.066704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 14:29:21.066704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:21.066704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 355/693] 10.222.0.17 () {56 vars in 1117 bytes} [Thu Oct 20 14:29:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:21.070817 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579dcc6-a810-46df-869b-04367564a6c9 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:21.144795 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:21.153126 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2eba84-8eb2-45b2-8c66-c5929796df9e None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:21.188460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579dcc6-a810-46df-869b-04367564a6c9 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:21.195519 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f7c53-4fdf-491f-95f0-6976d5022f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:21.196072 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f7c53-4fdf-491f-95f0-6976d5022f53 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:21.196356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f7c53-4fdf-491f-95f0-6976d5022f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:21.196634 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f7c53-4fdf-491f-95f0-6976d5022f53 None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:21.197801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f7c53-4fdf-491f-95f0-6976d5022f53 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:21.198153 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f7c53-4fdf-491f-95f0-6976d5022f53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:21.199987 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f7c53-4fdf-491f-95f0-6976d5022f53 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:21.206024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:21.212277 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 339/694] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Oct 20 14:29:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:21.213308 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f7c53-4fdf-491f-95f0-6976d5022f53 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:21.232455 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15c72-7cbd-4924-a0bf-9394ebcf5558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:21.233294 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15c72-7cbd-4924-a0bf-9394ebcf5558 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:21.233408 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15c72-7cbd-4924-a0bf-9394ebcf5558 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:21.233654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15c72-7cbd-4924-a0bf-9394ebcf5558 None admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:21.234429 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad15c72-7cbd-4924-a0bf-9394ebcf5558 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:21.234858 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad15c72-7cbd-4924-a0bf-9394ebcf5558 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:21.236226 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad15c72-7cbd-4924-a0bf-9394ebcf5558 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:21.260125 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 356/695] 10.222.0.17 () {56 vars in 1149 bytes} [Thu Oct 20 14:29:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:21.261147 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15c72-7cbd-4924-a0bf-9394ebcf5558 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:21.331535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f7c53-4fdf-491f-95f0-6976d5022f53 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:21.369309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f7c6a-5512-4ed1-83a7-97519dc7909e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:21.369941 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f7c6a-5512-4ed1-83a7-97519dc7909e None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:21.370226 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f7c6a-5512-4ed1-83a7-97519dc7909e None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:21.370497 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f7c6a-5512-4ed1-83a7-97519dc7909e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:21.371163 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f7c6a-5512-4ed1-83a7-97519dc7909e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:21.372657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f7c6a-5512-4ed1-83a7-97519dc7909e None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:21.385475 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15c72-7cbd-4924-a0bf-9394ebcf5558 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:21.401879 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 340/696] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:29:21 2022] POST /identity/v3/endpoints => generated 347 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:29:21.401879 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f7c6a-5512-4ed1-83a7-97519dc7909e None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:21.421475 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:21.443919 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d30789-abe8-400c-82a4-3d9c38d82c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:21.444528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d30789-abe8-400c-82a4-3d9c38d82c71 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:21.444803 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d30789-abe8-400c-82a4-3d9c38d82c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:21.445071 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d30789-abe8-400c-82a4-3d9c38d82c71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:21.485553 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:21.523742 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f7c6a-5512-4ed1-83a7-97519dc7909e None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:21.531294 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d30789-abe8-400c-82a4-3d9c38d82c71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:21.533212 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d30789-abe8-400c-82a4-3d9c38d82c71 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:21.561389 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3a269-484e-456b-beda-7ba25cb4aa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:21.562068 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3a269-484e-456b-beda-7ba25cb4aa64 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:21.562351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3a269-484e-456b-beda-7ba25cb4aa64 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:21.562618 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3a269-484e-456b-beda-7ba25cb4aa64 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:21.563202 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3a269-484e-456b-beda-7ba25cb4aa64 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:21.564565 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3a269-484e-456b-beda-7ba25cb4aa64 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:21.574119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-96e3a269-484e-456b-beda-7ba25cb4aa64 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 14:29:21.574119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:21.574119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:21.574119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:21.574119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:21.574119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:21.574119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:21.574119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:21.574119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 14:29:21.574119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:21.574119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:21.574119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:21.574119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:21.574119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:21.574119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:21.574119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:21.574119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:21.575472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:21.575472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:21.575472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:21.575472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:21.575472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:21.575472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:21.575472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:21.575472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:21.575472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:21.575472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:21.575472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:21.575472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:21.575472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:21.575472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:21.575472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:21.575472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:21.576443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:21.576443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:21.576443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:21.576443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:21.576443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:21.576443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:21.576443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:21.576443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:21.576443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:21.576443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:21.576443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:21.576443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:21.576443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 14:29:21.576443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:21.576443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 341/697] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Oct 20 14:29:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:21.581600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3a269-484e-456b-beda-7ba25cb4aa64 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:21.672314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 357/698] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:29:21 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 20 14:29:21.679963 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:21.680436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d30789-abe8-400c-82a4-3d9c38d82c71 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:21.712810 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3a269-484e-456b-beda-7ba25cb4aa64 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:21.752884 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:21.757531 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32916e-a871-48f6-bf94-dd4f95515a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:21.758256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32916e-a871-48f6-bf94-dd4f95515a42 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:21.758533 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32916e-a871-48f6-bf94-dd4f95515a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:21.758799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32916e-a871-48f6-bf94-dd4f95515a42 None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:21.759625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32916e-a871-48f6-bf94-dd4f95515a42 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:21.760022 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32916e-a871-48f6-bf94-dd4f95515a42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:21.761385 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32916e-a871-48f6-bf94-dd4f95515a42 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:21.767378 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 342/699] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Oct 20 14:29:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:21.773309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32916e-a871-48f6-bf94-dd4f95515a42 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:21.792146 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d30789-abe8-400c-82a4-3d9c38d82c71 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:21.829334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8bcef-70ca-4080-9af7-6b7d6e4c250e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:21.830076 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8bcef-70ca-4080-9af7-6b7d6e4c250e None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:21.830431 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8bcef-70ca-4080-9af7-6b7d6e4c250e None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:21.830713 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8bcef-70ca-4080-9af7-6b7d6e4c250e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:21.843039 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8bcef-70ca-4080-9af7-6b7d6e4c250e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:21.844579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8bcef-70ca-4080-9af7-6b7d6e4c250e None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:21.860936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-6dd8bcef-70ca-4080-9af7-6b7d6e4c250e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:21.860936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:21.860936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:21.860936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:21.860936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:21.860936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:21.860936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:21.860936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:21.860936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:21.860936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:21.860936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:21.860936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:21.860936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:29:21.860936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:29:21.860936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:29:21.860936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:29:21.861954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:21.861954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:21.861954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:21.861954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:21.861954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:21.861954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:21.861954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:21.861954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:21.861954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:21.861954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:21.861954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:21.861954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:21.861954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:21.861954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:21.861954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:21.861954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:21.861954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:29:21.863426 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:29:21.863426 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:21.863426 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:21.863426 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 358/700] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:29:21.868058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8bcef-70ca-4080-9af7-6b7d6e4c250e None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:21.895548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32916e-a871-48f6-bf94-dd4f95515a42 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:21.936839 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da02bfd-f799-4275-979a-202d13afe85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:21.937556 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da02bfd-f799-4275-979a-202d13afe85a None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:21.937876 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da02bfd-f799-4275-979a-202d13afe85a None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:21.938150 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da02bfd-f799-4275-979a-202d13afe85a None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:21.938792 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da02bfd-f799-4275-979a-202d13afe85a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:21.939096 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da02bfd-f799-4275-979a-202d13afe85a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:21.941000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da02bfd-f799-4275-979a-202d13afe85a None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:21.951948 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 343/701] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Oct 20 14:29:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:21.953361 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da02bfd-f799-4275-979a-202d13afe85a None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:21.970271 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:22.009545 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8bcef-70ca-4080-9af7-6b7d6e4c250e None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:22.036139 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:22.062479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a727b8-f1fb-406b-af61-122a9e13b470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:22.062855 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a727b8-f1fb-406b-af61-122a9e13b470 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:22.063101 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a727b8-f1fb-406b-af61-122a9e13b470 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:22.063375 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a727b8-f1fb-406b-af61-122a9e13b470 None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:22.064018 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a727b8-f1fb-406b-af61-122a9e13b470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:22.064322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a727b8-f1fb-406b-af61-122a9e13b470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:22.065708 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a727b8-f1fb-406b-af61-122a9e13b470 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:22.082638 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 359/702] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:22.083737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a727b8-f1fb-406b-af61-122a9e13b470 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:22.091530 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da02bfd-f799-4275-979a-202d13afe85a None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:22.146613 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4aa034-857e-4ddb-b551-10d126ce2193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:22.147837 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4aa034-857e-4ddb-b551-10d126ce2193 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:22.148700 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4aa034-857e-4ddb-b551-10d126ce2193 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:22.149172 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4aa034-857e-4ddb-b551-10d126ce2193 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:22.150139 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4aa034-857e-4ddb-b551-10d126ce2193 None admin] RBAC: Adding query filter params (interface=public, service_id=c36c94517aab43ea85fadc4dd60d6bb3, region_id=RegionOne) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:22.150641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4aa034-857e-4ddb-b551-10d126ce2193 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:22.152726 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4aa034-857e-4ddb-b551-10d126ce2193 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:22.164943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 344/703] 10.222.0.17 () {56 vars in 1251 bytes} [Thu Oct 20 14:29:21 2022] GET /identity/v3/endpoints?service_id=c36c94517aab43ea85fadc4dd60d6bb3&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:22.167400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4aa034-857e-4ddb-b551-10d126ce2193 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:22.215112 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a727b8-f1fb-406b-af61-122a9e13b470 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:22.257502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78c23f-9a90-4272-af49-3b211356513b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:22.258170 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78c23f-9a90-4272-af49-3b211356513b None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:22.258451 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78c23f-9a90-4272-af49-3b211356513b None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:22.258717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78c23f-9a90-4272-af49-3b211356513b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:22.266078 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78c23f-9a90-4272-af49-3b211356513b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:22.267485 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78c23f-9a90-4272-af49-3b211356513b None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:22.272959 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:22.281272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-2b78c23f-9a90-4272-af49-3b211356513b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:29:22.281272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:22.281272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:22.281272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:22.281272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:22.281272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:22.281272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:22.281272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:22.281272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:22.281272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:22.281272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:22.281272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:22.281272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:29:22.281272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:29:22.281272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:29:22.282382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:29:22.282382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:22.282382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:22.282382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:22.282382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:22.282382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:22.282382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:22.282382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:22.282382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:22.282382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:22.282382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:22.282382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:22.282382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:22.282382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:22.282382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:22.282382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:22.282382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:22.283458 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:29:22.283458 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:29:22.283458 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:29:22.283458 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:29:22.283458 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:29:22.283458 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:29:22.283458 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:29:22.283458 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:22.283458 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 360/704] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:29:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:22.283979 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b2907-0071-465d-aa79-cd7d5f546a62 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:22.284539 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b2907-0071-465d-aa79-cd7d5f546a62 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:22.284539 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b2907-0071-465d-aa79-cd7d5f546a62 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:22.285888 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 361/705] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:22.290457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b2907-0071-465d-aa79-cd7d5f546a62 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:22.318215 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4aa034-857e-4ddb-b551-10d126ce2193 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:22.339453 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:22.367308 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037f8bf-f051-442c-88cf-e3c7bab33222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:22.367926 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037f8bf-f051-442c-88cf-e3c7bab33222 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:22.368207 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037f8bf-f051-442c-88cf-e3c7bab33222 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:22.368482 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037f8bf-f051-442c-88cf-e3c7bab33222 None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:22.369515 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037f8bf-f051-442c-88cf-e3c7bab33222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:22.371075 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037f8bf-f051-442c-88cf-e3c7bab33222 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:22.378340 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 345/706] 10.222.0.17 () {56 vars in 1087 bytes} [Thu Oct 20 14:29:22 2022] GET /identity/v3/services => generated 1497 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:29:22.379307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a6003-6916-4aeb-af14-7749213c03d2 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:22.379591 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a6003-6916-4aeb-af14-7749213c03d2 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:22.379855 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a6003-6916-4aeb-af14-7749213c03d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:22.406378 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-672a6003-6916-4aeb-af14-7749213c03d2 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:22.410175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-672a6003-6916-4aeb-af14-7749213c03d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:22.440336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b2907-0071-465d-aa79-cd7d5f546a62 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:22.504597 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af948a-7291-4578-8be3-1027737d2518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:22.506505 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af948a-7291-4578-8be3-1027737d2518 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:22.507052 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af948a-7291-4578-8be3-1027737d2518 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:22.507534 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af948a-7291-4578-8be3-1027737d2518 None admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:22.508743 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af948a-7291-4578-8be3-1027737d2518 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:22.509523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af948a-7291-4578-8be3-1027737d2518 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:22.512582 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af948a-7291-4578-8be3-1027737d2518 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:22.526716 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 346/707] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:22.532756 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 362/708] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:29:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:22.539063 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a6003-6916-4aeb-af14-7749213c03d2 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:22.620301 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:22.666838 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a6003-6916-4aeb-af14-7749213c03d2 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:22.709323 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c533ba8-3406-4919-be46-007ea53eab47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:22.709971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c533ba8-3406-4919-be46-007ea53eab47 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:22.710259 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c533ba8-3406-4919-be46-007ea53eab47 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:22.710534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c533ba8-3406-4919-be46-007ea53eab47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:22.711331 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c533ba8-3406-4919-be46-007ea53eab47 None admin] RBAC: Adding query filter params (role.id=7fb83e6f9dc74b8ab285f4540dea633d, scope.project.id=88613722e7dc4950b5e47a1d92331575, user.id=a1bdbce1b3d047cfa5ddf72f902ecd5d) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:22.711637 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c533ba8-3406-4919-be46-007ea53eab47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:22.714038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c533ba8-3406-4919-be46-007ea53eab47 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:22.723552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 347/709] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:29:22 2022] GET /identity/v3/role_assignments?user.id=a1bdbce1b3d047cfa5ddf72f902ecd5d&scope.project.id=88613722e7dc4950b5e47a1d92331575&role.id=7fb83e6f9dc74b8ab285f4540dea633d => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:22.840574 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af948a-7291-4578-8be3-1027737d2518 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:22.958624 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:22.963104 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af948a-7291-4578-8be3-1027737d2518 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:22.999564 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7cdc2-cff3-46cf-b7f2-8beab8d92205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:23.000199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7cdc2-cff3-46cf-b7f2-8beab8d92205 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:23.000478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7cdc2-cff3-46cf-b7f2-8beab8d92205 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:23.000751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7cdc2-cff3-46cf-b7f2-8beab8d92205 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:23.001332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7cdc2-cff3-46cf-b7f2-8beab8d92205 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:23.002732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7cdc2-cff3-46cf-b7f2-8beab8d92205 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:23.011579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-2ae7cdc2-cff3-46cf-b7f2-8beab8d92205 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 14:29:23.011579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:23.011579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:23.011579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:23.011579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:23.011579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:23.011579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:23.011579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:23.011579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 14:29:23.011579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:23.011579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:23.011579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:23.011579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:23.011579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:23.011579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:23.011579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:23.011579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:23.015484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:23.015484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:23.015484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:23.015484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:23.015484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:23.015484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:23.015484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:23.015484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:23.015484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:23.015484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:23.015484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:23.015484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:23.015484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:23.015484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:23.015484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:23.015484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:23.017656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:23.017656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:23.017656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:23.017656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:23.017656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:23.017656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:23.017656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:23.017656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:23.017656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:23.017656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:23.017656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:23.017656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:23.017656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 14:29:23.017656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:23.017656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 363/710] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Oct 20 14:29:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:23.021566 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c533ba8-3406-4919-be46-007ea53eab47 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:23.129218 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c533ba8-3406-4919-be46-007ea53eab47 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:23.158892 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:23.165767 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b5b79-9318-45a5-b22c-cb5c299423b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:23.166420 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b5b79-9318-45a5-b22c-cb5c299423b1 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:23.166696 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b5b79-9318-45a5-b22c-cb5c299423b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:23.166966 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b5b79-9318-45a5-b22c-cb5c299423b1 None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:23.167602 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b5b79-9318-45a5-b22c-cb5c299423b1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:23.167902 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b5b79-9318-45a5-b22c-cb5c299423b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:23.169917 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b5b79-9318-45a5-b22c-cb5c299423b1 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:23.175545 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 348/711] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Oct 20 14:29:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:23.181460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7cdc2-cff3-46cf-b7f2-8beab8d92205 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:23.291623 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7cdc2-cff3-46cf-b7f2-8beab8d92205 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:23.329461 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b7b59-7097-4dff-b27e-a7a773e772bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:23.330128 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b7b59-7097-4dff-b27e-a7a773e772bb None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:23.330413 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b7b59-7097-4dff-b27e-a7a773e772bb None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:23.330688 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b7b59-7097-4dff-b27e-a7a773e772bb None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:23.331399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b7b59-7097-4dff-b27e-a7a773e772bb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:23.331707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b7b59-7097-4dff-b27e-a7a773e772bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:23.333156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b7b59-7097-4dff-b27e-a7a773e772bb None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:23.338917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 364/712] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Oct 20 14:29:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:23.344824 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b5b79-9318-45a5-b22c-cb5c299423b1 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:23.449564 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b5b79-9318-45a5-b22c-cb5c299423b1 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:23.485107 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1a4a9-0258-4093-861e-e8228f05b654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:23.485744 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1a4a9-0258-4093-861e-e8228f05b654 None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:23.486056 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1a4a9-0258-4093-861e-e8228f05b654 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:23.486328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1a4a9-0258-4093-861e-e8228f05b654 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:23.487024 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1a4a9-0258-4093-861e-e8228f05b654 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:23.488445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1a4a9-0258-4093-861e-e8228f05b654 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:23.513539 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 349/713] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:29:23 2022] POST /identity/v3/endpoints => generated 349 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:29:23.789221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c4281-e29c-4cca-b84e-c2b4698330af None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:23.789566 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c4281-e29c-4cca-b84e-c2b4698330af None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:23.789745 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c4281-e29c-4cca-b84e-c2b4698330af None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:23.791205 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 365/714] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:23.797196 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5c5f3-2397-4162-a649-43f6094b60a9 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:23.797731 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5c5f3-2397-4162-a649-43f6094b60a9 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:23.797731 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5c5f3-2397-4162-a649-43f6094b60a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:23.817115 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-2bf5c5f3-2397-4162-a649-43f6094b60a9 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:23.818336 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-2bf5c5f3-2397-4162-a649-43f6094b60a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:23.869347 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:23.902711 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 350/715] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:24.176882 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c4281-e29c-4cca-b84e-c2b4698330af None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:24.203913 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:24.282914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c4281-e29c-4cca-b84e-c2b4698330af None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:24.318992 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d6d62-3508-4c04-a6f8-1d7b79bf4aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:24.319625 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d6d62-3508-4c04-a6f8-1d7b79bf4aaa None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:24.319906 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d6d62-3508-4c04-a6f8-1d7b79bf4aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:24.320181 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d6d62-3508-4c04-a6f8-1d7b79bf4aaa None admin] PATH_INFO: `/v3/services/compute` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:24.320759 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d6d62-3508-4c04-a6f8-1d7b79bf4aaa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:24.322166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d6d62-3508-4c04-a6f8-1d7b79bf4aaa None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:24.331199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-c49d6d62-3508-4c04-a6f8-1d7b79bf4aaa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 14:29:24.331199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:24.331199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:24.331199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:24.331199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:24.331199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:24.331199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:24.331199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:24.331199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 14:29:24.331199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:24.331199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:24.331199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:24.331199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:24.331199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:24.331199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:24.331199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:24.331199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:24.332180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:24.332180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:24.332180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:24.332180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:24.332180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:24.332180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:24.332180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:24.332180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:24.332180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:24.332180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:24.332180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:24.332180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:24.332180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:24.332180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:24.332180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:24.332180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:24.333015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:24.333015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:24.333015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:24.333015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:24.333015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:24.333015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:24.333015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:24.333015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:24.333015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:24.333015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:24.333015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:24.333015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:24.333015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 14:29:24.333015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:24.333015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 366/716] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:29:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:24.338323 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5c5f3-2397-4162-a649-43f6094b60a9 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:24.440522 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5c5f3-2397-4162-a649-43f6094b60a9 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:24.477988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b832fe-3593-4aba-9619-e86d0daeb817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:24.478618 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b832fe-3593-4aba-9619-e86d0daeb817 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:24.478895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b832fe-3593-4aba-9619-e86d0daeb817 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:24.479166 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b832fe-3593-4aba-9619-e86d0daeb817 None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:24.479807 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b832fe-3593-4aba-9619-e86d0daeb817 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:24.480108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b832fe-3593-4aba-9619-e86d0daeb817 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:24.482201 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b832fe-3593-4aba-9619-e86d0daeb817 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:24.487816 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 351/717] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Oct 20 14:29:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:24.493406 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d6d62-3508-4c04-a6f8-1d7b79bf4aaa None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:24.587651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:24.598489 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d6d62-3508-4c04-a6f8-1d7b79bf4aaa None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:24.631698 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b975b-4db1-45b4-9a05-8172bdd0975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:24.632645 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b975b-4db1-45b4-9a05-8172bdd0975a None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:24.633180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b975b-4db1-45b4-9a05-8172bdd0975a None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:24.633645 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b975b-4db1-45b4-9a05-8172bdd0975a None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:24.634550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b975b-4db1-45b4-9a05-8172bdd0975a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:24.635045 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b975b-4db1-45b4-9a05-8172bdd0975a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:24.636681 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b975b-4db1-45b4-9a05-8172bdd0975a None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:24.645708 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 367/718] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Oct 20 14:29:24 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:24.848167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ce2f0-0889-4c64-88ab-cccc29a2f4c5 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:24.848691 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ce2f0-0889-4c64-88ab-cccc29a2f4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:24.848691 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ce2f0-0889-4c64-88ab-cccc29a2f4c5 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:24.850325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 352/719] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:24.855810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7bcac-5ed6-4c71-b40e-e76a8e5b34b1 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:24.856609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7bcac-5ed6-4c71-b40e-e76a8e5b34b1 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:24.856906 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7bcac-5ed6-4c71-b40e-e76a8e5b34b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:24.875194 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-e2e7bcac-5ed6-4c71-b40e-e76a8e5b34b1 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:24.876388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e2e7bcac-5ed6-4c71-b40e-e76a8e5b34b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:24.947579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 368/720] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:25.114508 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a81f0-c92a-4730-a892-161a77311993 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:25.114694 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a81f0-c92a-4730-a892-161a77311993 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:25.114969 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a81f0-c92a-4730-a892-161a77311993 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:25.116603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 353/721] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:25.121878 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dba58-f638-4c0d-9d1f-1e6674e51a8c None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:25.122183 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dba58-f638-4c0d-9d1f-1e6674e51a8c None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:25.122442 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dba58-f638-4c0d-9d1f-1e6674e51a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:25.141159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-962dba58-f638-4c0d-9d1f-1e6674e51a8c None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:25.142380 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-962dba58-f638-4c0d-9d1f-1e6674e51a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:25.214661 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 369/722] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:25.238012 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a81f0-c92a-4730-a892-161a77311993 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:25.283694 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:25.344337 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a81f0-c92a-4730-a892-161a77311993 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:25.379525 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af7aac-6a84-475d-a4ac-999ecab5621a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:25.380070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af7aac-6a84-475d-a4ac-999ecab5621a None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:25.380352 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af7aac-6a84-475d-a4ac-999ecab5621a None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:25.380623 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af7aac-6a84-475d-a4ac-999ecab5621a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:25.381203 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af7aac-6a84-475d-a4ac-999ecab5621a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:25.382588 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af7aac-6a84-475d-a4ac-999ecab5621a None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:25.392216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-41af7aac-6a84-475d-a4ac-999ecab5621a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 14:29:25.392216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:25.392216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:25.392216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:25.392216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:25.392216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:25.392216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:25.392216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:25.392216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 14:29:25.392216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:25.392216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:25.392216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:25.392216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:25.392216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:25.392216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:25.392216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:25.392216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:25.393198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:25.393198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:25.393198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:25.393198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:25.393198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:25.393198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:25.393198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:25.393198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:25.393198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:25.393198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:25.393198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:25.393198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:25.393198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:25.393198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:25.393198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:25.393198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:25.394606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:25.394606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:25.394606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:25.394606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:25.394606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:25.394606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:25.394606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:25.394606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:25.394606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:25.394606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:25.394606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:25.394606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:25.394606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 14:29:25.394606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:25.394606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 354/723] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Oct 20 14:29:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:25.399243 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dba58-f638-4c0d-9d1f-1e6674e51a8c None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:25.416379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:25.510344 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dba58-f638-4c0d-9d1f-1e6674e51a8c None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:25.514652 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af7aac-6a84-475d-a4ac-999ecab5621a None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:25.548839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84acd92-e2f3-4f12-9b8b-f9f54bc2b113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:25.549566 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84acd92-e2f3-4f12-9b8b-f9f54bc2b113 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:25.549883 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84acd92-e2f3-4f12-9b8b-f9f54bc2b113 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:25.550144 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84acd92-e2f3-4f12-9b8b-f9f54bc2b113 None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:25.550878 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84acd92-e2f3-4f12-9b8b-f9f54bc2b113 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:25.551190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84acd92-e2f3-4f12-9b8b-f9f54bc2b113 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:25.552570 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84acd92-e2f3-4f12-9b8b-f9f54bc2b113 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:25.558543 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 370/724] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Oct 20 14:29:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:25.564888 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84acd92-e2f3-4f12-9b8b-f9f54bc2b113 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:25.655351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af7aac-6a84-475d-a4ac-999ecab5621a None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:25.656749 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:25.659639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:25.682636 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84acd92-e2f3-4f12-9b8b-f9f54bc2b113 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:25.709041 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d95862-6afe-4425-bafb-be34323f0764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:25.710441 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d95862-6afe-4425-bafb-be34323f0764 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:25.711134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d95862-6afe-4425-bafb-be34323f0764 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:25.711567 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d95862-6afe-4425-bafb-be34323f0764 None admin] PATH_INFO: `/v3/services/image` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:25.712335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d95862-6afe-4425-bafb-be34323f0764 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:25.714852 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d95862-6afe-4425-bafb-be34323f0764 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:25.723887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a378fcf-a926-408b-ae79-1dab78ce3832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:25.724774 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a378fcf-a926-408b-ae79-1dab78ce3832 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:25.725231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a378fcf-a926-408b-ae79-1dab78ce3832 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:25.725655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a378fcf-a926-408b-ae79-1dab78ce3832 None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:25.726504 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a378fcf-a926-408b-ae79-1dab78ce3832 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:25.726748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-58d95862-6afe-4425-bafb-be34323f0764 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 14:29:25.726748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:25.726748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:25.726748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:25.726748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:25.726748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:25.726748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:25.726748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:25.726748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 14:29:25.726748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:25.726748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:25.726748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:25.726748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:25.726748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:25.726748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:25.726748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:25.726748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:25.727707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:25.727707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:25.727707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:25.727707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:25.727707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:25.727707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:25.727707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:25.727707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:25.727707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:25.727707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:25.727707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:25.727707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:25.727707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:25.727707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:25.727707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:25.727707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:25.728520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:25.728520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:25.728520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:25.728520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:25.728520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:25.728520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:25.728520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:25.728520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:25.728520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:25.728520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:25.728520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:25.728520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:25.728520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 14:29:25.728520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:25.729319 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a378fcf-a926-408b-ae79-1dab78ce3832 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:25.729319 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a378fcf-a926-408b-ae79-1dab78ce3832 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:25.731843 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 355/725] 10.222.0.17 () {56 vars in 1105 bytes} [Thu Oct 20 14:29:25 2022] GET /identity/v3/services/image => generated 86 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:25.739139 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 371/726] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Oct 20 14:29:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:25.742797 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a378fcf-a926-408b-ae79-1dab78ce3832 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:25.742906 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d95862-6afe-4425-bafb-be34323f0764 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:25.855292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d95862-6afe-4425-bafb-be34323f0764 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:25.858810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a378fcf-a926-408b-ae79-1dab78ce3832 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:25.892234 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33d7bd-7fc5-4134-b814-402a0599ce26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:25.892834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac1e14-b513-4088-b377-6ad5108794af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:25.893281 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33d7bd-7fc5-4134-b814-402a0599ce26 None admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:25.893434 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac1e14-b513-4088-b377-6ad5108794af None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:25.893717 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac1e14-b513-4088-b377-6ad5108794af None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:25.893874 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33d7bd-7fc5-4134-b814-402a0599ce26 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:25.894058 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac1e14-b513-4088-b377-6ad5108794af None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:25.894174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33d7bd-7fc5-4134-b814-402a0599ce26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:25.894632 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac1e14-b513-4088-b377-6ad5108794af None admin] RBAC: Adding query filter params (name=image) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:25.894804 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33d7bd-7fc5-4134-b814-402a0599ce26 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:25.894958 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac1e14-b513-4088-b377-6ad5108794af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:25.896185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33d7bd-7fc5-4134-b814-402a0599ce26 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:25.896291 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac1e14-b513-4088-b377-6ad5108794af None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:25.906848 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 356/727] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:25.906848 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7151cad-ed49-4f0e-a0e4-1b68776d8c5d None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:25.906848 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7151cad-ed49-4f0e-a0e4-1b68776d8c5d None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:25.906848 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7151cad-ed49-4f0e-a0e4-1b68776d8c5d None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:25.906848 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 357/728] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:25.909964 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7151cad-ed49-4f0e-a0e4-1b68776d8c5d None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:25.916994 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:25.934924 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 372/729] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:29:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:29:25.936820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e5f7b-419f-497d-a986-1b11bac527aa None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:25.937468 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e5f7b-419f-497d-a986-1b11bac527aa None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:25.937882 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e5f7b-419f-497d-a986-1b11bac527aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:25.958487 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:25.960658 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-751e5f7b-419f-497d-a986-1b11bac527aa None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:25.962435 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-751e5f7b-419f-497d-a986-1b11bac527aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:26.057883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7151cad-ed49-4f0e-a0e4-1b68776d8c5d None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:26.058116 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 373/730] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:26.095359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ecdd3-ca32-4dd5-b41f-fe75c4e2bb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:26.095988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ecdd3-ca32-4dd5-b41f-fe75c4e2bb41 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:26.096273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ecdd3-ca32-4dd5-b41f-fe75c4e2bb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:26.096549 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ecdd3-ca32-4dd5-b41f-fe75c4e2bb41 None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:26.097202 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ecdd3-ca32-4dd5-b41f-fe75c4e2bb41 None admin] RBAC: Adding query filter params (type=image) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:26.097508 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ecdd3-ca32-4dd5-b41f-fe75c4e2bb41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:26.098935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ecdd3-ca32-4dd5-b41f-fe75c4e2bb41 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:26.104562 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 358/731] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:25 2022] GET /identity/v3/services?type=image => generated 122 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:26.334828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e5f7b-419f-497d-a986-1b11bac527aa None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:26.442657 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e5f7b-419f-497d-a986-1b11bac527aa None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:26.469731 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:26.481631 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c368e-e29f-4776-98bb-3895600fe5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:26.482743 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c368e-e29f-4776-98bb-3895600fe5fc None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:26.483244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c368e-e29f-4776-98bb-3895600fe5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:26.483795 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c368e-e29f-4776-98bb-3895600fe5fc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:26.484601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c368e-e29f-4776-98bb-3895600fe5fc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:26.486270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c368e-e29f-4776-98bb-3895600fe5fc None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:26.495982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-8f9c368e-e29f-4776-98bb-3895600fe5fc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 14:29:26.495982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:26.495982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:26.495982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:26.495982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:26.495982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:26.495982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:26.495982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:26.495982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 14:29:26.495982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:26.495982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:26.495982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:26.495982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:26.495982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:26.495982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:26.495982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:26.495982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:26.497528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:26.497528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:26.497528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:26.497528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:26.497528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:26.497528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:26.497528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:26.497528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:26.497528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:26.497528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:26.497528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:26.497528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:26.497528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:26.497528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:26.497528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:26.497528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:26.498388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:26.498388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:26.498388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:26.498388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:26.498388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:26.498388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:26.498388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:26.498388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:26.498388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:26.498388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:26.498388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:26.498388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:26.498388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 14:29:26.498388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:26.501224 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 374/732] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Oct 20 14:29:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:26.507362 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ecdd3-ca32-4dd5-b41f-fe75c4e2bb41 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:26.608578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:26.619245 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ecdd3-ca32-4dd5-b41f-fe75c4e2bb41 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:26.656086 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a401c7-be75-496a-ab36-737270d79a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:26.657072 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a401c7-be75-496a-ab36-737270d79a4f None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:26.657569 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a401c7-be75-496a-ab36-737270d79a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:26.658140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a401c7-be75-496a-ab36-737270d79a4f None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:26.659009 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a401c7-be75-496a-ab36-737270d79a4f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:26.659525 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a401c7-be75-496a-ab36-737270d79a4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:26.661089 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a401c7-be75-496a-ab36-737270d79a4f None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:26.666665 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 359/733] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Oct 20 14:29:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:26.672689 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c368e-e29f-4776-98bb-3895600fe5fc None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:26.789897 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c368e-e29f-4776-98bb-3895600fe5fc None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:26.827014 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d24e2f-70f3-4b69-a17a-47e2f5f53cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:26.828220 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d24e2f-70f3-4b69-a17a-47e2f5f53cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:26.828705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d24e2f-70f3-4b69-a17a-47e2f5f53cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:26.829336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d24e2f-70f3-4b69-a17a-47e2f5f53cb8 None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:26.830197 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d24e2f-70f3-4b69-a17a-47e2f5f53cb8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:26.830820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d24e2f-70f3-4b69-a17a-47e2f5f53cb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:26.832457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d24e2f-70f3-4b69-a17a-47e2f5f53cb8 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:26.838868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 375/734] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Oct 20 14:29:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:26.846236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a401c7-be75-496a-ab36-737270d79a4f None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:26.864660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc546316-1ca6-4bac-8fbe-8d58869adea5 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:26.865056 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc546316-1ca6-4bac-8fbe-8d58869adea5 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:26.865237 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc546316-1ca6-4bac-8fbe-8d58869adea5 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:26.867973 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 376/735] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:29:26.872773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3269ee-ea23-4596-971b-677a3333eaa3 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:26.873112 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3269ee-ea23-4596-971b-677a3333eaa3 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:26.873315 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3269ee-ea23-4596-971b-677a3333eaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:26.892741 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-fc3269ee-ea23-4596-971b-677a3333eaa3 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:26.893943 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-fc3269ee-ea23-4596-971b-677a3333eaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:26.948109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:26.977625 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 377/736] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 14:29:26.986630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a401c7-be75-496a-ab36-737270d79a4f None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:27.021507 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3e4c0-8187-40ac-9525-ed74f1323aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:27.022518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3e4c0-8187-40ac-9525-ed74f1323aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:27.023083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3e4c0-8187-40ac-9525-ed74f1323aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:27.023559 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3e4c0-8187-40ac-9525-ed74f1323aa0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:27.024617 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3e4c0-8187-40ac-9525-ed74f1323aa0 None admin] RBAC: Adding query filter params (interface=admin, service_id=e9505e5402784d67b884ffb80b8bb6b9, region_id=RegionOne) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:27.025157 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3e4c0-8187-40ac-9525-ed74f1323aa0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:27.026819 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3e4c0-8187-40ac-9525-ed74f1323aa0 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:27.033559 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 360/737] 10.222.0.17 () {56 vars in 1249 bytes} [Thu Oct 20 14:29:26 2022] GET /identity/v3/endpoints?service_id=e9505e5402784d67b884ffb80b8bb6b9&interface=admin®ion_id=RegionOne => generated 193 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:27.039700 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3269ee-ea23-4596-971b-677a3333eaa3 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:27.144542 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3269ee-ea23-4596-971b-677a3333eaa3 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:27.183216 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d585aad-9153-43e2-897d-cf240ad7ecbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:27.183827 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d585aad-9153-43e2-897d-cf240ad7ecbb None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:27.184159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d585aad-9153-43e2-897d-cf240ad7ecbb None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:27.184443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d585aad-9153-43e2-897d-cf240ad7ecbb None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:27.185210 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d585aad-9153-43e2-897d-cf240ad7ecbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:27.186613 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d585aad-9153-43e2-897d-cf240ad7ecbb None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:27.193220 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 378/738] 10.222.0.17 () {56 vars in 1087 bytes} [Thu Oct 20 14:29:27 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:29:27.252607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3e4c0-8187-40ac-9525-ed74f1323aa0 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:27.285988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:27.368933 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3e4c0-8187-40ac-9525-ed74f1323aa0 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:27.405167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed118f91-4e8a-430e-ad2b-3c59d6fc87ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:27.405703 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed118f91-4e8a-430e-ad2b-3c59d6fc87ed None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:27.406013 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed118f91-4e8a-430e-ad2b-3c59d6fc87ed None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:27.406285 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed118f91-4e8a-430e-ad2b-3c59d6fc87ed None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:27.406943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed118f91-4e8a-430e-ad2b-3c59d6fc87ed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:27.408301 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed118f91-4e8a-430e-ad2b-3c59d6fc87ed None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:27.425883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 361/739] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Oct 20 14:29:27 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:29:28.193736 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983a53d-5474-4c88-be09-07e29df42102 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:28.194277 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983a53d-5474-4c88-be09-07e29df42102 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:28.194367 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983a53d-5474-4c88-be09-07e29df42102 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:28.195930 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 379/740] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:28.201881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7ab50-d70f-4682-9ab1-087463594e55 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:28.202394 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7ab50-d70f-4682-9ab1-087463594e55 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:28.202469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7ab50-d70f-4682-9ab1-087463594e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:28.223242 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-c5f7ab50-d70f-4682-9ab1-087463594e55 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:28.224480 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-c5f7ab50-d70f-4682-9ab1-087463594e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:28.302949 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 362/741] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:28 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:28.320039 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab1cb4-7b99-4c49-aa98-8e79527c5d15 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:28.320319 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab1cb4-7b99-4c49-aa98-8e79527c5d15 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:28.320593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab1cb4-7b99-4c49-aa98-8e79527c5d15 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:28.322173 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 380/742] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:28.327830 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f701a36-9c4f-4781-9858-1cb1d61d40fd None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:28.328117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f701a36-9c4f-4781-9858-1cb1d61d40fd None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:28.328385 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f701a36-9c4f-4781-9858-1cb1d61d40fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:28.346457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-3f701a36-9c4f-4781-9858-1cb1d61d40fd None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:28.347634 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-3f701a36-9c4f-4781-9858-1cb1d61d40fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:28.350494 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:28.419412 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 363/743] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:28 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:28.581015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab1cb4-7b99-4c49-aa98-8e79527c5d15 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:28.631896 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:28.687936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab1cb4-7b99-4c49-aa98-8e79527c5d15 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:28.696609 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f701a36-9c4f-4781-9858-1cb1d61d40fd None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:28.723204 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4efaf-9731-4f24-af36-c31bf5054ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:28.723806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4efaf-9731-4f24-af36-c31bf5054ed7 None admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:28.724084 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4efaf-9731-4f24-af36-c31bf5054ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:28.724350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4efaf-9731-4f24-af36-c31bf5054ed7 None admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:28.725116 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4efaf-9731-4f24-af36-c31bf5054ed7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:28.726752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4efaf-9731-4f24-af36-c31bf5054ed7 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:28.729443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: WARNING keystone.server.flask.common [None req-08e4efaf-9731-4f24-af36-c31bf5054ed7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 20 14:29:28.755317 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.sql.core [None req-08e4efaf-9731-4f24-af36-c31bf5054ed7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 20 14:29:28.755317 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 14:29:28.755317 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [parameters: {'id': '64b9b046e6304000a9dc01799f5acd57', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 20 14:29:28.755317 dv-cinder-779233-7-smb devstack@keystone.service[81801]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81801) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 20 14:29:28.780084 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-08e4efaf-9731-4f24-af36-c31bf5054ed7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 64b9b046e6304000a9dc01799f5acd57.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 64b9b046e6304000a9dc01799f5acd57. Oct 20 14:29:28.780084 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:28.780084 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 14:29:28.780084 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 14:29:28.780084 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 14:29:28.780084 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 14:29:28.780084 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 14:29:28.780084 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 14:29:28.780084 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 14:29:28.780084 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application conn.query(q) Oct 20 14:29:28.780084 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 14:29:28.780084 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 14:29:28.780084 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 14:29:28.780933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application result.read() Oct 20 14:29:28.780933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 14:29:28.780933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 14:29:28.780933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 14:29:28.780933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 14:29:28.780933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 14:29:28.780933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 14:29:28.780933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 14:29:28.780933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 14:29:28.780933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 20 14:29:28.780933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:28.780933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 20 14:29:28.780933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:28.780933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:28.780933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 20 14:29:28.780933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 20 14:29:28.780933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 20 14:29:28.780933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 20 14:29:28.781911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 14:29:28.781911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application next(self.gen) Oct 20 14:29:28.781911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 20 14:29:28.781911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application yield resource Oct 20 14:29:28.781911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 14:29:28.781911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application next(self.gen) Oct 20 14:29:28.781911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 20 14:29:28.781911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self.session.rollback() Oct 20 14:29:28.781911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 20 14:29:28.781911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self.force_reraise() Oct 20 14:29:28.781911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 20 14:29:28.781911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise self.value Oct 20 14:29:28.781911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 20 14:29:28.781911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 20 14:29:28.781911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 20 14:29:28.781911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application session.commit() Oct 20 14:29:28.781911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 20 14:29:28.782785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 20 14:29:28.782785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 20 14:29:28.782785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._prepare_impl() Oct 20 14:29:28.782785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 20 14:29:28.782785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self.session.flush() Oct 20 14:29:28.782785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 20 14:29:28.782785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._flush(objects) Oct 20 14:29:28.782785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 20 14:29:28.782785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 20 14:29:28.782785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 20 14:29:28.782785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application compat.raise_( Oct 20 14:29:28.782785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 14:29:28.782785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception Oct 20 14:29:28.782785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 20 14:29:28.782785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application flush_context.execute() Oct 20 14:29:28.782785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 20 14:29:28.782785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rec.execute(self) Oct 20 14:29:28.784737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 20 14:29:28.784737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 20 14:29:28.784737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 20 14:29:28.784737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 20 14:29:28.784737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 20 14:29:28.784737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 20 14:29:28.784737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 20 14:29:28.784737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 20 14:29:28.784737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 20 14:29:28.784737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 20 14:29:28.784737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 20 14:29:28.784737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 20 14:29:28.784737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 20 14:29:28.784737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 20 14:29:28.784737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 20 14:29:28.786436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 20 14:29:28.786436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 14:29:28.786436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception Oct 20 14:29:28.786436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 14:29:28.786436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 14:29:28.786436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 14:29:28.786436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 14:29:28.786436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 14:29:28.786436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 14:29:28.786436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 14:29:28.786436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application conn.query(q) Oct 20 14:29:28.786436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 14:29:28.786436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 14:29:28.786436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 14:29:28.786436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application result.read() Oct 20 14:29:28.786436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 14:29:28.786436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 14:29:28.789042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 14:29:28.789042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 14:29:28.789042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 14:29:28.789042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 14:29:28.789042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 14:29:28.789042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 14:29:28.789042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 20 14:29:28.789042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 14:29:28.789042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [parameters: {'id': '64b9b046e6304000a9dc01799f5acd57', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 20 14:29:28.789042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 20 14:29:28.789042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:28.789042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:28.789042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:28.789042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:28.789042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 20 14:29:28.791666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 20 14:29:28.791666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 20 14:29:28.791666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 20 14:29:28.791666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 20 14:29:28.791666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:28.791666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:28.791666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:28.791666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:28.791666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:28.791666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:28.791666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:28.791666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:28.791666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:28.791666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:28.791666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:28.791666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:28.791666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:28.794854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:28.794854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 20 14:29:28.794854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 20 14:29:28.794854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:28.794854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:28.794854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 20 14:29:28.794854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 20 14:29:28.794854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 64b9b046e6304000a9dc01799f5acd57. Oct 20 14:29:28.794854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:28.798106 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 381/744] 10.222.0.17 () {60 vars in 1140 bytes} [Thu Oct 20 14:29:28 2022] POST /identity/v3/projects => generated 262 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:28.803131 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4efaf-9731-4f24-af36-c31bf5054ed7 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:28.811193 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f701a36-9c4f-4781-9858-1cb1d61d40fd None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:28.852925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729d653-5813-4d62-b116-e68fe5862799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:28.853454 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729d653-5813-4d62-b116-e68fe5862799 None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:28.853752 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729d653-5813-4d62-b116-e68fe5862799 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:28.854178 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729d653-5813-4d62-b116-e68fe5862799 None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:28.854830 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729d653-5813-4d62-b116-e68fe5862799 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:28.857273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729d653-5813-4d62-b116-e68fe5862799 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:28.871945 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:28.882013 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 364/745] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Oct 20 14:29:28 2022] POST /identity/v3/services => generated 242 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:29:28.939296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4efaf-9731-4f24-af36-c31bf5054ed7 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:28.952859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:28.994472 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8aea3-cd63-4cfd-989f-336191f7cbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:28.995210 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8aea3-cd63-4cfd-989f-336191f7cbda None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:28.995487 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8aea3-cd63-4cfd-989f-336191f7cbda None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:28.995800 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8aea3-cd63-4cfd-989f-336191f7cbda None admin] PATH_INFO: `/v3/projects/service` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:29.003556 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8aea3-cd63-4cfd-989f-336191f7cbda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:29.005155 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8aea3-cd63-4cfd-989f-336191f7cbda None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:29.017422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-86c8aea3-cd63-4cfd-989f-336191f7cbda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:29:29.017422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:29.017422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:29.017422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:29.017422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:29.017422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:29.017422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:29.017422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:29.017422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:29.017422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:29.017422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:29.017422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:29.017422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:29:29.017422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:29:29.017422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:29:29.018405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:29:29.018405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:29.018405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:29.018405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:29.018405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:29.018405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:29.018405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:29.018405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:29.018405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:29.018405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:29.018405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:29.018405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:29.018405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:29.018405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:29.018405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:29.018405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:29.018405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:29.019268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:29:29.019268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:29:29.019268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:29:29.019268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:29:29.019268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:29:29.019268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:29:29.019268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:29:29.019268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:29.019268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 382/746] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:29:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:29.027027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729d653-5813-4d62-b116-e68fe5862799 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:29.142537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729d653-5813-4d62-b116-e68fe5862799 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:29.179425 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd1feb-1f8a-45e9-9fb5-88b3545ad228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:29.179833 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd1feb-1f8a-45e9-9fb5-88b3545ad228 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:29.180113 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd1feb-1f8a-45e9-9fb5-88b3545ad228 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:29.180384 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd1feb-1f8a-45e9-9fb5-88b3545ad228 None admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:29.181052 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd1feb-1f8a-45e9-9fb5-88b3545ad228 None admin] RBAC: Adding query filter params (name=service) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:29.181362 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd1feb-1f8a-45e9-9fb5-88b3545ad228 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:29.182865 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd1feb-1f8a-45e9-9fb5-88b3545ad228 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:29.201871 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 365/747] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Oct 20 14:29:29 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:29.477169 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f908160-edbe-46af-815e-c75ba4b9247e None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:29.477651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f908160-edbe-46af-815e-c75ba4b9247e None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:29.477651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f908160-edbe-46af-815e-c75ba4b9247e None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:29.479287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 383/748] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:29.484688 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb0309-5cc2-4cb8-917a-ebabd090de22 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:29.485105 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb0309-5cc2-4cb8-917a-ebabd090de22 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:29.485292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb0309-5cc2-4cb8-917a-ebabd090de22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:29.504251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-d2fb0309-5cc2-4cb8-917a-ebabd090de22 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:29.505432 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d2fb0309-5cc2-4cb8-917a-ebabd090de22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:29.564524 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:29.579654 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 366/749] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:29 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:29.720667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f2b2d-cb94-4375-8393-f5e3d2e40ce9 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:29.720990 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f2b2d-cb94-4375-8393-f5e3d2e40ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:29.721216 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f2b2d-cb94-4375-8393-f5e3d2e40ce9 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:29.722847 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 384/750] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:29.728238 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687eae7e-2c89-4491-a4b5-20d5a445998f None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:29.728471 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687eae7e-2c89-4491-a4b5-20d5a445998f None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:29.728740 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687eae7e-2c89-4491-a4b5-20d5a445998f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:29.748042 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-687eae7e-2c89-4491-a4b5-20d5a445998f None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:29.749278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-687eae7e-2c89-4491-a4b5-20d5a445998f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:29.818742 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 367/751] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:29 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:29.860755 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f2b2d-cb94-4375-8393-f5e3d2e40ce9 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:29.968947 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f2b2d-cb94-4375-8393-f5e3d2e40ce9 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:30.005205 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6beca83-68b4-4e6d-8b24-52e680be4625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:30.005801 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6beca83-68b4-4e6d-8b24-52e680be4625 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:30.006109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6beca83-68b4-4e6d-8b24-52e680be4625 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:30.006379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6beca83-68b4-4e6d-8b24-52e680be4625 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:30.007001 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6beca83-68b4-4e6d-8b24-52e680be4625 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:30.008379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6beca83-68b4-4e6d-8b24-52e680be4625 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:30.017601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-e6beca83-68b4-4e6d-8b24-52e680be4625 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 14:29:30.017601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:30.017601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:30.017601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:30.017601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:30.017601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:30.017601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:30.017601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:30.017601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 14:29:30.017601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:30.017601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:30.017601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:30.017601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:30.017601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:30.017601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:30.017601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:30.017601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:30.018590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:30.018590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:30.018590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:30.018590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:30.018590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:30.018590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:30.018590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:30.018590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:30.018590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:30.018590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:30.018590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:30.018590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:30.018590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:30.018590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:30.018590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:30.018590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:30.019792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:30.019792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:30.019792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:30.019792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:30.019792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:30.019792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:30.019792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:30.019792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:30.019792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:30.019792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:30.019792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:30.019792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:30.019792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 14:29:30.019792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:30.019792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 385/752] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Oct 20 14:29:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:30.025049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687eae7e-2c89-4491-a4b5-20d5a445998f None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:30.117919 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6beca83-68b4-4e6d-8b24-52e680be4625 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:30.127398 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687eae7e-2c89-4491-a4b5-20d5a445998f None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:30.146546 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:30.153371 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:30.177489 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d33fa-41ce-4269-855f-32b2853d6d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:30.177489 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d33fa-41ce-4269-855f-32b2853d6d33 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:30.177489 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d33fa-41ce-4269-855f-32b2853d6d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:30.177489 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d33fa-41ce-4269-855f-32b2853d6d33 None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:30.178168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d33fa-41ce-4269-855f-32b2853d6d33 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:30.178168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d33fa-41ce-4269-855f-32b2853d6d33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:30.181115 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d33fa-41ce-4269-855f-32b2853d6d33 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:30.188555 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 368/753] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Oct 20 14:29:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:30.195536 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d33fa-41ce-4269-855f-32b2853d6d33 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:30.250332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6beca83-68b4-4e6d-8b24-52e680be4625 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:30.286167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bcdf8-63f7-411c-8622-5703765c1002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:30.286708 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bcdf8-63f7-411c-8622-5703765c1002 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:30.286982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bcdf8-63f7-411c-8622-5703765c1002 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:30.287250 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bcdf8-63f7-411c-8622-5703765c1002 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:30.287832 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9bcdf8-63f7-411c-8622-5703765c1002 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:30.289256 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9bcdf8-63f7-411c-8622-5703765c1002 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:30.299156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-2c9bcdf8-63f7-411c-8622-5703765c1002 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 14:29:30.299156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:30.299156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:30.299156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:30.299156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:30.299156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:30.299156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:30.299156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:30.299156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 14:29:30.299156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:30.299156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:30.299156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:30.299156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:30.299156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:30.299156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:30.299156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:30.299156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:30.300196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:30.300196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:30.300196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:30.300196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:30.300196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:30.300196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:30.300196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:30.300196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:30.300196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:30.300196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:30.300196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:30.300196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:30.300196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:30.300196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:30.300196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:30.300196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:30.301024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:30.301024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:30.301024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:30.301024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:30.301024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:30.301024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:30.301024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:30.301024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:30.301024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:30.301024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:30.301024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:30.301024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:30.301024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 14:29:30.301024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:30.301024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 386/754] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:29:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:29:30.306219 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bcdf8-63f7-411c-8622-5703765c1002 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:30.311861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d33fa-41ce-4269-855f-32b2853d6d33 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:30.348830 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ceadb-f0d6-4ac8-bc9f-230f46c570b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:30.349433 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ceadb-f0d6-4ac8-bc9f-230f46c570b6 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:30.349895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ceadb-f0d6-4ac8-bc9f-230f46c570b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:30.350267 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ceadb-f0d6-4ac8-bc9f-230f46c570b6 None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:30.350894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ceadb-f0d6-4ac8-bc9f-230f46c570b6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:30.351193 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ceadb-f0d6-4ac8-bc9f-230f46c570b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:30.352542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ceadb-f0d6-4ac8-bc9f-230f46c570b6 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:30.362695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 369/755] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Oct 20 14:29:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:30.364708 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ceadb-f0d6-4ac8-bc9f-230f46c570b6 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:30.411008 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:30.421101 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:30.425817 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bcdf8-63f7-411c-8622-5703765c1002 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:30.460773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0fb11-6295-4626-8f65-bed8c580d2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:30.461376 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0fb11-6295-4626-8f65-bed8c580d2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:30.461654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0fb11-6295-4626-8f65-bed8c580d2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:30.461964 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0fb11-6295-4626-8f65-bed8c580d2c9 None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:30.462585 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0fb11-6295-4626-8f65-bed8c580d2c9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:30.462883 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0fb11-6295-4626-8f65-bed8c580d2c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:30.464424 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0fb11-6295-4626-8f65-bed8c580d2c9 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:30.470191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 387/756] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Oct 20 14:29:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:30.475568 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0fb11-6295-4626-8f65-bed8c580d2c9 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:30.482124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ceadb-f0d6-4ac8-bc9f-230f46c570b6 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:30.519332 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba46084-bf0d-4fb1-9aa5-f829aa45c659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:30.519961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba46084-bf0d-4fb1-9aa5-f829aa45c659 None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:30.520271 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba46084-bf0d-4fb1-9aa5-f829aa45c659 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:30.520543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba46084-bf0d-4fb1-9aa5-f829aa45c659 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:30.521238 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba46084-bf0d-4fb1-9aa5-f829aa45c659 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:30.522647 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba46084-bf0d-4fb1-9aa5-f829aa45c659 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:30.545964 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 370/757] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:29:30 2022] POST /identity/v3/endpoints => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:29:30.611429 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0fb11-6295-4626-8f65-bed8c580d2c9 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:30.660899 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35abc98-77a0-4423-a9c7-12a89649f994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:30.661512 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35abc98-77a0-4423-a9c7-12a89649f994 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:30.661787 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35abc98-77a0-4423-a9c7-12a89649f994 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:30.662087 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35abc98-77a0-4423-a9c7-12a89649f994 None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:30.662715 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35abc98-77a0-4423-a9c7-12a89649f994 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:30.663011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35abc98-77a0-4423-a9c7-12a89649f994 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:30.664402 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35abc98-77a0-4423-a9c7-12a89649f994 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:30.670734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 388/758] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Oct 20 14:29:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:30.676524 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba46084-bf0d-4fb1-9aa5-f829aa45c659 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:30.788226 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba46084-bf0d-4fb1-9aa5-f829aa45c659 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:30.797874 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:30.825329 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed79f09-44b3-4238-9e36-d5ffd95ff6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:30.825986 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed79f09-44b3-4238-9e36-d5ffd95ff6ca None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:30.826263 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed79f09-44b3-4238-9e36-d5ffd95ff6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:30.826526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed79f09-44b3-4238-9e36-d5ffd95ff6ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:30.827225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed79f09-44b3-4238-9e36-d5ffd95ff6ca None admin] RBAC: Adding query filter params (interface=public, service_id=d2fd3e05718f4c6ba244d4785c1d16e0, region_id=RegionOne) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:30.827584 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed79f09-44b3-4238-9e36-d5ffd95ff6ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:30.829224 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed79f09-44b3-4238-9e36-d5ffd95ff6ca None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:30.837807 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 371/759] 10.222.0.17 () {56 vars in 1251 bytes} [Thu Oct 20 14:29:30 2022] GET /identity/v3/endpoints?service_id=d2fd3e05718f4c6ba244d4785c1d16e0&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:30.841723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35abc98-77a0-4423-a9c7-12a89649f994 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:30.857705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:30.952198 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35abc98-77a0-4423-a9c7-12a89649f994 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:30.988215 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfb670-db7b-452e-8256-d92fa4e3aac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:30.988832 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfb670-db7b-452e-8256-d92fa4e3aac1 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:30.989116 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfb670-db7b-452e-8256-d92fa4e3aac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:30.989393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfb670-db7b-452e-8256-d92fa4e3aac1 None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:30.990036 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfb670-db7b-452e-8256-d92fa4e3aac1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:30.991446 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfb670-db7b-452e-8256-d92fa4e3aac1 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:30.999695 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 389/760] 10.222.0.17 () {56 vars in 1087 bytes} [Thu Oct 20 14:29:30 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:29:31.264942 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ff1cb-71fa-47c9-aaaf-dd6746ffc13c None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:31.265296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ff1cb-71fa-47c9-aaaf-dd6746ffc13c None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:31.265504 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ff1cb-71fa-47c9-aaaf-dd6746ffc13c None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:31.267115 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 372/761] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:31.272624 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d674c-56f6-464b-a65a-5c2f0bb42d2f None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:31.272919 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d674c-56f6-464b-a65a-5c2f0bb42d2f None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:31.273198 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d674c-56f6-464b-a65a-5c2f0bb42d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:31.292873 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-987d674c-56f6-464b-a65a-5c2f0bb42d2f None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:31.294647 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-987d674c-56f6-464b-a65a-5c2f0bb42d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:31.369497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 390/762] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:31 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:31.468570 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf4bdd-1351-4020-84e0-b7351bc3fa8a None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:31.468864 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf4bdd-1351-4020-84e0-b7351bc3fa8a None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:31.469043 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf4bdd-1351-4020-84e0-b7351bc3fa8a None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:31.470658 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 373/763] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:31.475847 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aaac9-7dc6-4216-b108-817f97af9088 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:31.476140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aaac9-7dc6-4216-b108-817f97af9088 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:31.476414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aaac9-7dc6-4216-b108-817f97af9088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:31.484051 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:31.495300 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-dd2aaac9-7dc6-4216-b108-817f97af9088 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:31.496734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-dd2aaac9-7dc6-4216-b108-817f97af9088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:31.568589 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 391/764] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:31 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:31.661108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf4bdd-1351-4020-84e0-b7351bc3fa8a None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:31.765991 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf4bdd-1351-4020-84e0-b7351bc3fa8a None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:31.800672 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471373c3-b9b6-49d8-a386-bd0c28319547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:31.801294 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471373c3-b9b6-49d8-a386-bd0c28319547 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:31.801569 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471373c3-b9b6-49d8-a386-bd0c28319547 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:31.801833 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471373c3-b9b6-49d8-a386-bd0c28319547 None admin] PATH_INFO: `/v3/services/image` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:31.802432 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471373c3-b9b6-49d8-a386-bd0c28319547 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:31.804038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471373c3-b9b6-49d8-a386-bd0c28319547 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:31.813653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-471373c3-b9b6-49d8-a386-bd0c28319547 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 14:29:31.813653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:31.813653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:31.813653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:31.813653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:31.813653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:31.813653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:31.813653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:31.813653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 14:29:31.813653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:31.813653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:31.813653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:31.813653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:31.813653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:31.813653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:31.813653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:31.813653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:31.814681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:31.814681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:31.814681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:31.814681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:31.814681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:31.814681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:31.814681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:31.814681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:31.814681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:31.814681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:31.814681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:31.814681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:31.814681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:31.814681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:31.814681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:31.814681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:31.815516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:31.815516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:31.815516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:31.815516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:31.815516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:31.815516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:31.815516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:31.815516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:31.815516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:31.815516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:31.815516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:31.815516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:31.815516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 14:29:31.815516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:31.815516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 374/765] 10.222.0.17 () {56 vars in 1105 bytes} [Thu Oct 20 14:29:31 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:31.822824 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aaac9-7dc6-4216-b108-817f97af9088 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:31.863239 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471373c3-b9b6-49d8-a386-bd0c28319547 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:31.904919 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:31.929992 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aaac9-7dc6-4216-b108-817f97af9088 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:31.966573 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91752d1-6ec8-4924-9009-e51c4d07dfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:31.967273 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91752d1-6ec8-4924-9009-e51c4d07dfa5 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:31.967656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91752d1-6ec8-4924-9009-e51c4d07dfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:31.968028 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91752d1-6ec8-4924-9009-e51c4d07dfa5 None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:31.968753 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91752d1-6ec8-4924-9009-e51c4d07dfa5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:31.969153 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91752d1-6ec8-4924-9009-e51c4d07dfa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:31.970742 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91752d1-6ec8-4924-9009-e51c4d07dfa5 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:31.971984 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:31.978237 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471373c3-b9b6-49d8-a386-bd0c28319547 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:31.981394 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 392/766] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:31.982638 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91752d1-6ec8-4924-9009-e51c4d07dfa5 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:32.021329 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28187fd-0ef4-4dd3-bf4e-a3ddc097ba0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:32.022184 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28187fd-0ef4-4dd3-bf4e-a3ddc097ba0f None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:32.022466 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28187fd-0ef4-4dd3-bf4e-a3ddc097ba0f None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:32.022734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28187fd-0ef4-4dd3-bf4e-a3ddc097ba0f None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:32.023390 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28187fd-0ef4-4dd3-bf4e-a3ddc097ba0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:32.024834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28187fd-0ef4-4dd3-bf4e-a3ddc097ba0f None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:32.027966 dv-cinder-779233-7-smb devstack@keystone.service[81802]: WARNING keystone.server.flask.common [None req-e28187fd-0ef4-4dd3-bf4e-a3ddc097ba0f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 20 14:29:32.042080 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.sql.core [None req-e28187fd-0ef4-4dd3-bf4e-a3ddc097ba0f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 20 14:29:32.042080 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 20 14:29:32.042080 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [parameters: {'user_id': 'b6956137164f4563a256820e84ef06ac', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 20 14:29:32.042080 dv-cinder-779233-7-smb devstack@keystone.service[81802]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81802) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 20 14:29:32.050724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-e28187fd-0ef4-4dd3-bf4e-a3ddc097ba0f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 20 14:29:32.050724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:32.050724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 14:29:32.050724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 14:29:32.050724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 14:29:32.050724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 14:29:32.050724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 14:29:32.050724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 14:29:32.050724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 14:29:32.050724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application conn.query(q) Oct 20 14:29:32.050724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 14:29:32.050724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 14:29:32.050724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 14:29:32.050724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application result.read() Oct 20 14:29:32.050724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 14:29:32.051590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 14:29:32.051590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 14:29:32.051590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 14:29:32.051590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 14:29:32.051590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 14:29:32.051590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 14:29:32.051590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 14:29:32.051590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 20 14:29:32.051590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:32.051590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 20 14:29:32.051590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:32.051590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:32.051590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 20 14:29:32.051590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 20 14:29:32.051590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 20 14:29:32.051590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 20 14:29:32.051590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 14:29:32.051590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application next(self.gen) Oct 20 14:29:32.052794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 20 14:29:32.052794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application yield resource Oct 20 14:29:32.052794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 14:29:32.052794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application next(self.gen) Oct 20 14:29:32.052794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 20 14:29:32.052794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self.session.rollback() Oct 20 14:29:32.052794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 20 14:29:32.052794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self.force_reraise() Oct 20 14:29:32.052794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 20 14:29:32.052794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise self.value Oct 20 14:29:32.052794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 20 14:29:32.052794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 20 14:29:32.052794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 20 14:29:32.052794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application session.commit() Oct 20 14:29:32.052794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 20 14:29:32.052794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 20 14:29:32.052794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 20 14:29:32.053702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._prepare_impl() Oct 20 14:29:32.053702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 20 14:29:32.053702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self.session.flush() Oct 20 14:29:32.053702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 20 14:29:32.053702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._flush(objects) Oct 20 14:29:32.053702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 20 14:29:32.053702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 20 14:29:32.053702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 20 14:29:32.053702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application compat.raise_( Oct 20 14:29:32.053702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 14:29:32.053702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception Oct 20 14:29:32.053702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 20 14:29:32.053702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application flush_context.execute() Oct 20 14:29:32.053702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 20 14:29:32.053702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rec.execute(self) Oct 20 14:29:32.053702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 20 14:29:32.053702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 20 14:29:32.054590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 20 14:29:32.054590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 20 14:29:32.054590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 20 14:29:32.054590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 20 14:29:32.054590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 20 14:29:32.054590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 20 14:29:32.054590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 20 14:29:32.054590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 20 14:29:32.054590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 20 14:29:32.054590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 20 14:29:32.054590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 20 14:29:32.054590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 20 14:29:32.054590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 20 14:29:32.054590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 20 14:29:32.054590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 14:29:32.054590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception Oct 20 14:29:32.055406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 14:29:32.055406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 14:29:32.055406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 14:29:32.055406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 14:29:32.055406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 14:29:32.055406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 14:29:32.055406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 14:29:32.055406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application conn.query(q) Oct 20 14:29:32.055406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 14:29:32.055406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 14:29:32.055406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 14:29:32.055406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application result.read() Oct 20 14:29:32.055406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 14:29:32.055406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 14:29:32.055406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 14:29:32.055406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 14:29:32.056220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 14:29:32.056220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 14:29:32.056220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 14:29:32.056220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 14:29:32.056220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 20 14:29:32.056220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 20 14:29:32.056220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b6956137164f4563a256820e84ef06ac', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 20 14:29:32.056220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 20 14:29:32.056220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:32.056220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:32.056220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:32.056220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:32.056220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:32.056220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:32.056220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:32.056984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:32.056984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:32.056984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:32.056984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:32.056984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:32.056984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:32.056984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:32.056984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 20 14:29:32.056984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 20 14:29:32.056984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:32.056984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:32.056984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:29:32.056984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:32.056984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:29:32.056984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:32.056984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 20 14:29:32.056984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 20 14:29:32.060170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 20 14:29:32.060170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 20 14:29:32.060170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 20 14:29:32.060170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 20 14:29:32.060170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 20 14:29:32.060170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:32.060170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 375/767] 10.222.0.17 () {60 vars in 1131 bytes} [Thu Oct 20 14:29:31 2022] POST /identity/v3/users => generated 160 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:29:32.060170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28187fd-0ef4-4dd3-bf4e-a3ddc097ba0f None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:32.101991 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91752d1-6ec8-4924-9009-e51c4d07dfa5 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:32.137691 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d0bb9-6e36-4420-886d-2930d47705cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:32.138694 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d0bb9-6e36-4420-886d-2930d47705cc None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:32.139179 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d0bb9-6e36-4420-886d-2930d47705cc None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:32.139672 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d0bb9-6e36-4420-886d-2930d47705cc None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:32.140502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d0bb9-6e36-4420-886d-2930d47705cc None admin] RBAC: Adding query filter params (type=image) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:32.141028 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d0bb9-6e36-4420-886d-2930d47705cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:32.142634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d0bb9-6e36-4420-886d-2930d47705cc None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:32.148191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 393/768] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:32.155992 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d0bb9-6e36-4420-886d-2930d47705cc None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:32.170829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:32.174448 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28187fd-0ef4-4dd3-bf4e-a3ddc097ba0f None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:32.218455 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff3ffc-9c10-4aa2-be3d-b24002f90428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:32.219154 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff3ffc-9c10-4aa2-be3d-b24002f90428 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:32.219884 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff3ffc-9c10-4aa2-be3d-b24002f90428 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:32.220172 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff3ffc-9c10-4aa2-be3d-b24002f90428 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:32.230259 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff3ffc-9c10-4aa2-be3d-b24002f90428 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:32.232548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff3ffc-9c10-4aa2-be3d-b24002f90428 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:32.246859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:32.247706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-9bff3ffc-9c10-4aa2-be3d-b24002f90428 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 14:29:32.247706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:32.247706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:32.247706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:32.247706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:32.247706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:32.247706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:32.247706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:32.247706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:32.247706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:32.247706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:32.247706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:32.247706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:29:32.247706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:29:32.247706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:29:32.247706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:29:32.248639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:32.248639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:32.248639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:29:32.248639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:32.248639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:29:32.248639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:32.248639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:32.248639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:32.248639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:32.248639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:32.248639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:32.248639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:32.248639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:32.248639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:32.248639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:32.248639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:32.248639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:32.248639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:32.249655 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:32.249655 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:32.249655 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:29:32.249655 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:29:32.249655 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:29:32.249655 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:29:32.249655 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:29:32.249655 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:29:32.249655 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 14:29:32.249655 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:32.253925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 376/769] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:29:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:29:32.254626 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff3ffc-9c10-4aa2-be3d-b24002f90428 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:32.300666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d0bb9-6e36-4420-886d-2930d47705cc None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:32.343253 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25be39c-c8c8-46f4-beb3-d6c1cb9daa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:32.343867 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25be39c-c8c8-46f4-beb3-d6c1cb9daa0b None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:32.344146 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25be39c-c8c8-46f4-beb3-d6c1cb9daa0b None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:32.344422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25be39c-c8c8-46f4-beb3-d6c1cb9daa0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:32.345233 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25be39c-c8c8-46f4-beb3-d6c1cb9daa0b None admin] RBAC: Adding query filter params (interface=public, service_id=ae8a634b81454924bc59fa56617a07fa, region_id=RegionOne) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:32.345542 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25be39c-c8c8-46f4-beb3-d6c1cb9daa0b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:32.347031 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25be39c-c8c8-46f4-beb3-d6c1cb9daa0b None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:32.357985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 394/770] 10.222.0.17 () {56 vars in 1251 bytes} [Thu Oct 20 14:29:32 2022] GET /identity/v3/endpoints?service_id=ae8a634b81454924bc59fa56617a07fa&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:32.359074 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25be39c-c8c8-46f4-beb3-d6c1cb9daa0b None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:32.374546 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff3ffc-9c10-4aa2-be3d-b24002f90428 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:32.413215 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945747b-c27c-4d12-9277-5895ec687531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:32.414366 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945747b-c27c-4d12-9277-5895ec687531 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:32.414898 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945747b-c27c-4d12-9277-5895ec687531 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:32.415428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945747b-c27c-4d12-9277-5895ec687531 None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:32.416367 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945747b-c27c-4d12-9277-5895ec687531 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:32.416858 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945747b-c27c-4d12-9277-5895ec687531 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:32.419164 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945747b-c27c-4d12-9277-5895ec687531 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:32.467022 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 377/771] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Oct 20 14:29:32 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:32.476330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25be39c-c8c8-46f4-beb3-d6c1cb9daa0b None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:32.507932 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:32.520239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009c0d4-3fae-41e3-9ac8-f99766346df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:32.521255 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009c0d4-3fae-41e3-9ac8-f99766346df4 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:32.521733 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009c0d4-3fae-41e3-9ac8-f99766346df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:32.522230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009c0d4-3fae-41e3-9ac8-f99766346df4 None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:32.523045 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009c0d4-3fae-41e3-9ac8-f99766346df4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:32.524687 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009c0d4-3fae-41e3-9ac8-f99766346df4 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:32.533392 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 395/772] 10.222.0.17 () {56 vars in 1087 bytes} [Thu Oct 20 14:29:32 2022] GET /identity/v3/services => generated 1957 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:29:32.875635 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44997f-ff79-490c-8e65-b5fa6f74339f None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:32.876146 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44997f-ff79-490c-8e65-b5fa6f74339f None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:32.876222 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44997f-ff79-490c-8e65-b5fa6f74339f None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:32.877683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 378/773] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:29:32.882735 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025af74-6f29-4a34-a754-e419db8dc29c None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:32.883136 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025af74-6f29-4a34-a754-e419db8dc29c None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:32.883294 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025af74-6f29-4a34-a754-e419db8dc29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:32.901740 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-2025af74-6f29-4a34-a754-e419db8dc29c None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:32.903036 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2025af74-6f29-4a34-a754-e419db8dc29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:32.970916 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 396/774] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:32 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:33.206077 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2646d0-d7e3-434a-9142-514f8ceab591 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:33.206378 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2646d0-d7e3-434a-9142-514f8ceab591 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:33.206634 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2646d0-d7e3-434a-9142-514f8ceab591 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:33.208006 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 379/775] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:33.213073 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2286aa0-e835-496f-8a65-29a54b53e0c9 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:33.213364 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2286aa0-e835-496f-8a65-29a54b53e0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:33.213635 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2286aa0-e835-496f-8a65-29a54b53e0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:33.232690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-f2286aa0-e835-496f-8a65-29a54b53e0c9 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:33.233876 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-f2286aa0-e835-496f-8a65-29a54b53e0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:33.238232 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2646d0-d7e3-434a-9142-514f8ceab591 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:33.257974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:33.304542 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 397/776] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:33 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:33.347923 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2646d0-d7e3-434a-9142-514f8ceab591 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:33.381341 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc350d2c-deef-44c1-bbaa-ddb6390abea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:33.381984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc350d2c-deef-44c1-bbaa-ddb6390abea1 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:33.382264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc350d2c-deef-44c1-bbaa-ddb6390abea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:33.382531 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc350d2c-deef-44c1-bbaa-ddb6390abea1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:33.383622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc350d2c-deef-44c1-bbaa-ddb6390abea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:33.385032 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc350d2c-deef-44c1-bbaa-ddb6390abea1 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:33.387320 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 380/777] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:33.392759 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2286aa0-e835-496f-8a65-29a54b53e0c9 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:33.441506 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:33.493244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2286aa0-e835-496f-8a65-29a54b53e0c9 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:33.526410 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783ad6c-5264-4d21-a0e8-a20f91d4277e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:33.527013 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783ad6c-5264-4d21-a0e8-a20f91d4277e None admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:33.527314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783ad6c-5264-4d21-a0e8-a20f91d4277e None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:33.527583 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783ad6c-5264-4d21-a0e8-a20f91d4277e None admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:33.528234 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783ad6c-5264-4d21-a0e8-a20f91d4277e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:33.529656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783ad6c-5264-4d21-a0e8-a20f91d4277e None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:33.555625 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 398/778] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Oct 20 14:29:33 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:29:33.582011 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc350d2c-deef-44c1-bbaa-ddb6390abea1 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:33.673187 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:33.691864 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc350d2c-deef-44c1-bbaa-ddb6390abea1 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:33.730676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a793fbf-e9ba-45a5-bb0c-c42ebeca893a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:33.731310 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a793fbf-e9ba-45a5-bb0c-c42ebeca893a None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:33.731608 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a793fbf-e9ba-45a5-bb0c-c42ebeca893a None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:33.731879 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a793fbf-e9ba-45a5-bb0c-c42ebeca893a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:33.732465 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a793fbf-e9ba-45a5-bb0c-c42ebeca893a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:33.733821 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a793fbf-e9ba-45a5-bb0c-c42ebeca893a None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:33.742709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-0a793fbf-e9ba-45a5-bb0c-c42ebeca893a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 14:29:33.742709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:33.742709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:33.742709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:33.742709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:33.742709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:33.742709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:33.742709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:33.742709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 14:29:33.742709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:33.742709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:33.742709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:33.742709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:33.742709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:33.742709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:33.742709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:33.742709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:33.743676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:33.743676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:33.743676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:33.743676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:33.743676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:33.743676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:33.743676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:33.743676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:33.743676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:33.743676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:33.743676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:33.743676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:33.743676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:33.743676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:33.743676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:33.743676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:33.744500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:33.744500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:33.744500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:33.744500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:33.744500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:33.744500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:33.744500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:33.744500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:33.744500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:33.744500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:33.744500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:33.744500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:33.744500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 14:29:33.744500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:33.744500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 381/779] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:29:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:33.750832 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783ad6c-5264-4d21-a0e8-a20f91d4277e None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:33.856322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783ad6c-5264-4d21-a0e8-a20f91d4277e None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:33.857881 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:33.894476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cf33e-301a-4f4a-b9f6-3fb01bb2b09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:33.895755 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cf33e-301a-4f4a-b9f6-3fb01bb2b09d None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:33.896180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cf33e-301a-4f4a-b9f6-3fb01bb2b09d None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:33.896599 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cf33e-301a-4f4a-b9f6-3fb01bb2b09d None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:33.897367 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cf33e-301a-4f4a-b9f6-3fb01bb2b09d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:33.897863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cf33e-301a-4f4a-b9f6-3fb01bb2b09d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:33.899378 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cf33e-301a-4f4a-b9f6-3fb01bb2b09d None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:33.905118 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 399/780] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Oct 20 14:29:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:33.910940 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a793fbf-e9ba-45a5-bb0c-c42ebeca893a None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:34.011017 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a793fbf-e9ba-45a5-bb0c-c42ebeca893a None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:34.043877 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fdc12-e788-4796-b997-261d75f6ef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:34.044483 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fdc12-e788-4796-b997-261d75f6ef5f None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:34.044763 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fdc12-e788-4796-b997-261d75f6ef5f None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:34.045032 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fdc12-e788-4796-b997-261d75f6ef5f None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:34.045662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fdc12-e788-4796-b997-261d75f6ef5f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:34.045996 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fdc12-e788-4796-b997-261d75f6ef5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:34.047375 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fdc12-e788-4796-b997-261d75f6ef5f None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:34.052346 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 382/781] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Oct 20 14:29:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:34.058119 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cf33e-301a-4f4a-b9f6-3fb01bb2b09d None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:34.160218 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cf33e-301a-4f4a-b9f6-3fb01bb2b09d None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:34.199441 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ef076-6fc6-45f1-83d5-17ab92ed87c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:34.200301 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ef076-6fc6-45f1-83d5-17ab92ed87c2 None admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:34.200740 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ef076-6fc6-45f1-83d5-17ab92ed87c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:34.201174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ef076-6fc6-45f1-83d5-17ab92ed87c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:34.202039 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ef076-6fc6-45f1-83d5-17ab92ed87c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:34.203552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ef076-6fc6-45f1-83d5-17ab92ed87c2 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:34.225233 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 400/782] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:29:34 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:29:34.759103 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55281bef-260c-4964-8652-5b8563ab40d2 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:34.759501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55281bef-260c-4964-8652-5b8563ab40d2 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:34.759702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55281bef-260c-4964-8652-5b8563ab40d2 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:34.761143 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 383/783] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:34.766366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d0b04-aa63-4475-a7de-7fd39d2b08dc None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:34.766663 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d0b04-aa63-4475-a7de-7fd39d2b08dc None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:34.766949 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d0b04-aa63-4475-a7de-7fd39d2b08dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:34.898839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-e08d0b04-aa63-4475-a7de-7fd39d2b08dc None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:34.900051 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e08d0b04-aa63-4475-a7de-7fd39d2b08dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:34.917468 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:34.976961 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 401/784] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:35.247503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55281bef-260c-4964-8652-5b8563ab40d2 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:35.263959 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:35.351407 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55281bef-260c-4964-8652-5b8563ab40d2 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:35.385431 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0313ce-f3a7-47e6-9a93-8021d6726946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:35.386085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0313ce-f3a7-47e6-9a93-8021d6726946 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:35.386381 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0313ce-f3a7-47e6-9a93-8021d6726946 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:35.386839 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0313ce-f3a7-47e6-9a93-8021d6726946 None admin] PATH_INFO: `/v3/services/image` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:35.387290 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0313ce-f3a7-47e6-9a93-8021d6726946 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:35.388656 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0313ce-f3a7-47e6-9a93-8021d6726946 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:35.397460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-2e0313ce-f3a7-47e6-9a93-8021d6726946 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 14:29:35.397460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:35.397460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:29:35.397460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:29:35.397460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:29:35.397460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:29:35.397460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:29:35.397460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:35.397460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 14:29:35.397460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:35.397460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:35.397460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:35.397460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:35.397460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:35.397460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:35.397460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:35.397460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:35.398473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:35.398473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:35.398473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:35.398473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:35.398473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:35.398473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:35.398473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:29:35.398473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:29:35.398473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:29:35.398473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:29:35.398473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:35.398473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:35.398473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:35.398473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:35.398473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:35.398473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:35.399313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:35.399313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:35.399313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:35.399313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:35.399313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:35.399313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:35.399313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:35.399313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:35.399313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:35.399313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:35.399313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:29:35.399313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:29:35.399313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 14:29:35.399313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:35.402199 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 384/785] 10.222.0.17 () {56 vars in 1105 bytes} [Thu Oct 20 14:29:35 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:29:35.404497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d0b04-aa63-4475-a7de-7fd39d2b08dc None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:35.504895 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d0b04-aa63-4475-a7de-7fd39d2b08dc None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:35.539203 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25978843-b212-460f-a5ab-e8797241118f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:35.539814 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25978843-b212-460f-a5ab-e8797241118f None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:35.540093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25978843-b212-460f-a5ab-e8797241118f None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:35.540366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25978843-b212-460f-a5ab-e8797241118f None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:35.540991 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25978843-b212-460f-a5ab-e8797241118f None admin] RBAC: Adding query filter params (name=image) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:35.541290 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25978843-b212-460f-a5ab-e8797241118f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:35.542779 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25978843-b212-460f-a5ab-e8797241118f None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:35.548213 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 402/786] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:35.553925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0313ce-f3a7-47e6-9a93-8021d6726946 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:35.632108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:35.656395 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0313ce-f3a7-47e6-9a93-8021d6726946 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:35.694793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acbd72-8d8b-49c4-82c9-d95a866be253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:35.695409 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acbd72-8d8b-49c4-82c9-d95a866be253 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:35.695691 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acbd72-8d8b-49c4-82c9-d95a866be253 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:35.695965 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acbd72-8d8b-49c4-82c9-d95a866be253 None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:35.696602 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acbd72-8d8b-49c4-82c9-d95a866be253 None admin] RBAC: Adding query filter params (type=image) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:35.696905 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acbd72-8d8b-49c4-82c9-d95a866be253 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:35.698315 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acbd72-8d8b-49c4-82c9-d95a866be253 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:35.703605 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 385/787] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:35.709158 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25978843-b212-460f-a5ab-e8797241118f None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:35.724872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:35.775425 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395d009-dbdd-48a8-a601-0bc8618fa5b0 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:35.775612 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395d009-dbdd-48a8-a601-0bc8618fa5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:35.775887 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395d009-dbdd-48a8-a601-0bc8618fa5b0 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:35.777418 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 386/788] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:29:35.782625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea47eb2-5983-44a6-945f-146edf93bd03 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:35.782916 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea47eb2-5983-44a6-945f-146edf93bd03 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:35.783185 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea47eb2-5983-44a6-945f-146edf93bd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:35.803744 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-1ea47eb2-5983-44a6-945f-146edf93bd03 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:35.805467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-1ea47eb2-5983-44a6-945f-146edf93bd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:35.815616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25978843-b212-460f-a5ab-e8797241118f None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:35.855136 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da062e39-dc40-44d4-a444-a7de49616f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:35.856841 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da062e39-dc40-44d4-a444-a7de49616f88 None admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:35.857338 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da062e39-dc40-44d4-a444-a7de49616f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:35.857952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da062e39-dc40-44d4-a444-a7de49616f88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:35.858958 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da062e39-dc40-44d4-a444-a7de49616f88 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:35.860532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da062e39-dc40-44d4-a444-a7de49616f88 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:35.877958 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 387/789] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 14:29:35.889887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 403/790] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:29:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:29:36.145954 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea47eb2-5983-44a6-945f-146edf93bd03 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:36.221271 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:36.252964 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea47eb2-5983-44a6-945f-146edf93bd03 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:36.293825 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecb070-5bb8-4039-8389-a59d72c7d055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:36.294472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecb070-5bb8-4039-8389-a59d72c7d055 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:36.295019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecb070-5bb8-4039-8389-a59d72c7d055 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:36.295290 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecb070-5bb8-4039-8389-a59d72c7d055 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:36.296385 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aecb070-5bb8-4039-8389-a59d72c7d055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:36.297804 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aecb070-5bb8-4039-8389-a59d72c7d055 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:36.299529 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 388/791] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:36.305370 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da062e39-dc40-44d4-a444-a7de49616f88 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:36.376257 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:36.413537 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da062e39-dc40-44d4-a444-a7de49616f88 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:36.447179 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661660b-7215-41c1-8cf8-80c02f0f7b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:36.447788 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661660b-7215-41c1-8cf8-80c02f0f7b5c None admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:36.448060 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661660b-7215-41c1-8cf8-80c02f0f7b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:36.448325 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661660b-7215-41c1-8cf8-80c02f0f7b5c None admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:36.449063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661660b-7215-41c1-8cf8-80c02f0f7b5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:36.450524 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661660b-7215-41c1-8cf8-80c02f0f7b5c None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:36.467585 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ce57d-369b-43ed-81db-15a7c38e2b74 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:36.467883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ce57d-369b-43ed-81db-15a7c38e2b74 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:36.468139 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ce57d-369b-43ed-81db-15a7c38e2b74 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:36.469631 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 389/792] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:29:36.474213 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 404/793] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Oct 20 14:29:36 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:29:36.474884 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e7e4c-c06a-48cd-8a83-fac58a477a1c None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:36.475386 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e7e4c-c06a-48cd-8a83-fac58a477a1c None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:36.475761 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e7e4c-c06a-48cd-8a83-fac58a477a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:36.497461 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-516e7e4c-c06a-48cd-8a83-fac58a477a1c None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:36.498828 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-516e7e4c-c06a-48cd-8a83-fac58a477a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:36.581895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 390/794] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:36.851320 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661660b-7215-41c1-8cf8-80c02f0f7b5c None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:36.950684 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661660b-7215-41c1-8cf8-80c02f0f7b5c None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:36.973517 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:36.987037 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f3214-f421-40ce-a061-c551c9e01c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:36.987727 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f3214-f421-40ce-a061-c551c9e01c16 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:36.988004 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f3214-f421-40ce-a061-c551c9e01c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:36.988268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f3214-f421-40ce-a061-c551c9e01c16 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:36.999025 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f3214-f421-40ce-a061-c551c9e01c16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:29:37.003734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-db7f3214-f421-40ce-a061-c551c9e01c16 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 14:29:37.003734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:37.003734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:37.003734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:37.003734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:37.003734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:37.003734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:37.003734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:37.003734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:37.003734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:37.003734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:37.003734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:37.003734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:29:37.003734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:29:37.003734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:29:37.003734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:29:37.004616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:29:37.004616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:29:37.004616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:29:37.004616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:29:37.004616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:37.004616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:37.004616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:37.004616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:37.004616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:37.004616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:37.004616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:37.004616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:37.004616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:37.004616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:37.004616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:37.004616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:37.005577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:37.005577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:37.005577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:37.005577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:37.005577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:29:37.005577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:29:37.005577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:29:37.005577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:29:37.005577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:29:37.005577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:29:37.005577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 14:29:37.005577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:37.005577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 405/795] 10.222.0.17 () {56 vars in 1120 bytes} [Thu Oct 20 14:29:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:37.010738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e7e4c-c06a-48cd-8a83-fac58a477a1c None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:37.076636 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:37.114704 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e7e4c-c06a-48cd-8a83-fac58a477a1c None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:37.149280 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d17904-ba06-4899-acf2-a683ed23818c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:37.149914 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d17904-ba06-4899-acf2-a683ed23818c None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:37.150199 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d17904-ba06-4899-acf2-a683ed23818c None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:37.150470 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d17904-ba06-4899-acf2-a683ed23818c None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:37.151136 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d17904-ba06-4899-acf2-a683ed23818c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:37.151439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d17904-ba06-4899-acf2-a683ed23818c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:37.152993 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d17904-ba06-4899-acf2-a683ed23818c None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:37.165891 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 391/796] 10.222.0.17 () {56 vars in 1115 bytes} [Thu Oct 20 14:29:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:37.168659 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f3214-f421-40ce-a061-c551c9e01c16 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:37.272175 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f3214-f421-40ce-a061-c551c9e01c16 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:37.306307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c8c7f-8406-4aef-a7e4-f9f55f1c0152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:37.306913 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c8c7f-8406-4aef-a7e4-f9f55f1c0152 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:37.307195 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c8c7f-8406-4aef-a7e4-f9f55f1c0152 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:37.307459 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c8c7f-8406-4aef-a7e4-f9f55f1c0152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:37.318373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c8c7f-8406-4aef-a7e4-f9f55f1c0152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:37.319876 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c8c7f-8406-4aef-a7e4-f9f55f1c0152 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:37.334443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-3c9c8c7f-8406-4aef-a7e4-f9f55f1c0152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:37.334443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:37.334443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:37.334443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:37.334443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:37.334443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:37.334443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:37.334443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:37.334443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:37.334443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:37.334443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:37.334443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:37.334443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:29:37.334443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:29:37.334443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:29:37.334443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:29:37.335391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:37.335391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:37.335391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:37.335391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:37.335391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:37.335391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:37.335391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:37.335391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:37.335391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:37.335391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:37.335391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:37.335391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:37.335391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:37.335391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:37.335391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:37.335391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:37.335391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:29:37.336349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:29:37.336349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:37.336349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:37.337921 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 406/797] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:37.341501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d17904-ba06-4899-acf2-a683ed23818c None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:37.450710 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d17904-ba06-4899-acf2-a683ed23818c None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:37.477059 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:37.487000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416abdb5-6018-49f2-887e-507361c3fe98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:37.487611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416abdb5-6018-49f2-887e-507361c3fe98 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:37.487890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416abdb5-6018-49f2-887e-507361c3fe98 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:37.488162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416abdb5-6018-49f2-887e-507361c3fe98 None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:37.488798 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416abdb5-6018-49f2-887e-507361c3fe98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:37.489096 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416abdb5-6018-49f2-887e-507361c3fe98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:37.490521 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416abdb5-6018-49f2-887e-507361c3fe98 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:37.502669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 392/798] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:37.508119 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c8c7f-8406-4aef-a7e4-f9f55f1c0152 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:37.545229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:37.611915 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c8c7f-8406-4aef-a7e4-f9f55f1c0152 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:37.646650 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b60ca2-e5e5-49e7-bca3-b6dcab93c674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:37.647289 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b60ca2-e5e5-49e7-bca3-b6dcab93c674 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:37.647568 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b60ca2-e5e5-49e7-bca3-b6dcab93c674 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:37.647839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b60ca2-e5e5-49e7-bca3-b6dcab93c674 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:37.655608 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b60ca2-e5e5-49e7-bca3-b6dcab93c674 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:37.657064 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b60ca2-e5e5-49e7-bca3-b6dcab93c674 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:37.668799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-32b60ca2-e5e5-49e7-bca3-b6dcab93c674 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 14:29:37.668799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:37.668799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:37.668799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:37.668799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:37.668799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:37.668799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:37.668799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:37.668799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:37.668799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:37.668799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:37.668799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:37.668799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:29:37.668799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:29:37.668799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:29:37.668799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:29:37.669707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:37.669707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:37.669707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:29:37.669707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:37.669707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:29:37.669707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:37.669707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:37.669707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:37.669707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:37.669707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:37.669707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:37.669707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:37.669707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:37.669707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:37.669707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:37.669707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:37.669707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:37.669707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:37.670682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:37.670682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:37.670682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:29:37.670682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:29:37.670682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:29:37.670682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:29:37.670682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:29:37.670682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:29:37.670682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 14:29:37.670682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:37.673916 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 407/799] 10.222.0.17 () {56 vars in 1093 bytes} [Thu Oct 20 14:29:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:37.675621 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416abdb5-6018-49f2-887e-507361c3fe98 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:37.778085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416abdb5-6018-49f2-887e-507361c3fe98 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:37.813401 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4c685-95dd-4df0-888b-3c43a78c5672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:37.814043 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4c685-95dd-4df0-888b-3c43a78c5672 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:37.814319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4c685-95dd-4df0-888b-3c43a78c5672 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:37.814586 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4c685-95dd-4df0-888b-3c43a78c5672 None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:37.815309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4c685-95dd-4df0-888b-3c43a78c5672 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:37.815663 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4c685-95dd-4df0-888b-3c43a78c5672 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:37.817069 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4c685-95dd-4df0-888b-3c43a78c5672 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:37.840443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 393/800] 10.222.0.17 () {56 vars in 1133 bytes} [Thu Oct 20 14:29:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:37.841912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b60ca2-e5e5-49e7-bca3-b6dcab93c674 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:37.936448 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:37.943564 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b60ca2-e5e5-49e7-bca3-b6dcab93c674 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:37.981325 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5156f-7205-4dff-9699-67647d80cd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:37.982097 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5156f-7205-4dff-9699-67647d80cd65 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:37.982380 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5156f-7205-4dff-9699-67647d80cd65 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:37.982647 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5156f-7205-4dff-9699-67647d80cd65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:37.994156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5156f-7205-4dff-9699-67647d80cd65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:37.995815 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5156f-7205-4dff-9699-67647d80cd65 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:38.009918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-c6d5156f-7205-4dff-9699-67647d80cd65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:38.009918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:38.009918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:38.009918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:38.009918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:38.009918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:38.009918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:38.009918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:38.009918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:38.009918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:38.009918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:38.009918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:38.009918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:29:38.009918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:29:38.009918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:29:38.009918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:29:38.010839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:38.010839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:38.010839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:38.010839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:38.010839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:38.010839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:38.010839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:38.010839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:38.010839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:38.010839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:38.010839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:38.010839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:38.010839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:38.010839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:38.010839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:38.010839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:38.010839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:29:38.012080 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:29:38.012080 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:38.012080 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:38.012080 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 408/801] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:29:38.018112 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4c685-95dd-4df0-888b-3c43a78c5672 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:38.064067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:38.067519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aab3b3-63a4-4d2b-8ba7-0648f9478de6 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:38.067781 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aab3b3-63a4-4d2b-8ba7-0648f9478de6 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:38.068054 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aab3b3-63a4-4d2b-8ba7-0648f9478de6 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:38.069425 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 409/802] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:38.075326 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6f80f-8a1d-4250-887f-a8d97f90b173 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:38.075606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6f80f-8a1d-4250-887f-a8d97f90b173 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:38.075877 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6f80f-8a1d-4250-887f-a8d97f90b173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:38.094588 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-4ee6f80f-8a1d-4250-887f-a8d97f90b173 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:38.095760 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-4ee6f80f-8a1d-4250-887f-a8d97f90b173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:38.121895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4c685-95dd-4df0-888b-3c43a78c5672 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:38.158671 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09685779-8532-4a71-910f-715f9bf16563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:38.159586 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09685779-8532-4a71-910f-715f9bf16563 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:38.160042 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09685779-8532-4a71-910f-715f9bf16563 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:38.160512 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09685779-8532-4a71-910f-715f9bf16563 None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:38.161315 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09685779-8532-4a71-910f-715f9bf16563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:38.161786 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09685779-8532-4a71-910f-715f9bf16563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:38.162580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 410/803] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 14:29:38.163511 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09685779-8532-4a71-910f-715f9bf16563 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:38.180194 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 394/804] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:38.185885 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6f80f-8a1d-4250-887f-a8d97f90b173 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:38.269432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:38.293018 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6f80f-8a1d-4250-887f-a8d97f90b173 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:38.328243 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be7880-4048-4f51-b7c9-c77825846784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:38.329630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be7880-4048-4f51-b7c9-c77825846784 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:38.330165 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be7880-4048-4f51-b7c9-c77825846784 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:38.330640 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be7880-4048-4f51-b7c9-c77825846784 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:38.337442 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be7880-4048-4f51-b7c9-c77825846784 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:38.339138 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be7880-4048-4f51-b7c9-c77825846784 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:38.350892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-25be7880-4048-4f51-b7c9-c77825846784 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:29:38.350892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:38.350892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:38.350892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:38.350892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:38.350892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:38.350892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:38.350892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:38.350892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:38.350892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:38.350892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:38.350892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:38.350892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:29:38.350892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:29:38.350892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:29:38.351818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:29:38.351818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:38.351818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:38.351818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:38.351818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:38.351818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:38.351818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:38.351818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:38.351818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:38.351818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:38.351818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:38.351818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:38.351818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:38.351818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:38.351818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:38.351818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:38.351818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:38.352763 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:29:38.352763 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:29:38.352763 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:29:38.352763 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:29:38.352763 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:29:38.352763 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:29:38.352763 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:29:38.352763 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:38.354334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 411/805] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:29:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:38.359951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09685779-8532-4a71-910f-715f9bf16563 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:38.427923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be7880-4048-4f51-b7c9-c77825846784 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:38.463672 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09685779-8532-4a71-910f-715f9bf16563 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:38.466750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:38.500439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4862cc-41fd-4d2f-9c83-b10d6e5bf52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:38.501052 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4862cc-41fd-4d2f-9c83-b10d6e5bf52a None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:38.501325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4862cc-41fd-4d2f-9c83-b10d6e5bf52a None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:38.501590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4862cc-41fd-4d2f-9c83-b10d6e5bf52a None admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:38.502309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4862cc-41fd-4d2f-9c83-b10d6e5bf52a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:38.502607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4862cc-41fd-4d2f-9c83-b10d6e5bf52a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:38.504134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4862cc-41fd-4d2f-9c83-b10d6e5bf52a None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:38.517080 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 395/806] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:29:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:38.522761 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4862cc-41fd-4d2f-9c83-b10d6e5bf52a None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:38.534328 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be7880-4048-4f51-b7c9-c77825846784 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:38.568712 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401e2af-ef7a-4626-ae30-cbf5b185335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:38.569342 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401e2af-ef7a-4626-ae30-cbf5b185335c None admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:38.569622 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401e2af-ef7a-4626-ae30-cbf5b185335c None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:38.569937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401e2af-ef7a-4626-ae30-cbf5b185335c None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:38.570650 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401e2af-ef7a-4626-ae30-cbf5b185335c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:38.572087 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401e2af-ef7a-4626-ae30-cbf5b185335c None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:38.581400 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.sql.core [None req-5401e2af-ef7a-4626-ae30-cbf5b185335c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 14:29:38.581400 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 14:29:38.581400 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [parameters: {'id': '93a718b6bb7a4e7da01075bb38b865b1', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 20 14:29:38.581400 dv-cinder-779233-7-smb devstack@keystone.service[81801]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81801) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 20 14:29:38.589068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-5401e2af-ef7a-4626-ae30-cbf5b185335c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 20 14:29:38.589068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:38.589068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 14:29:38.589068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 14:29:38.589068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 14:29:38.589068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 14:29:38.589068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 14:29:38.589068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 14:29:38.589068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 14:29:38.589068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application conn.query(q) Oct 20 14:29:38.589068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 14:29:38.589068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 14:29:38.589068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 14:29:38.589068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application result.read() Oct 20 14:29:38.596314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 14:29:38.596314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 14:29:38.596314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 14:29:38.596314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 14:29:38.596314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 14:29:38.596314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 14:29:38.596314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 14:29:38.596314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 14:29:38.596314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 14:29:38.596314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:38.596314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 20 14:29:38.596314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:38.596314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:38.596314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 20 14:29:38.596314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 20 14:29:38.596314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 20 14:29:38.596314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 20 14:29:38.596314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 14:29:38.597341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application next(self.gen) Oct 20 14:29:38.597341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 20 14:29:38.597341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application yield resource Oct 20 14:29:38.597341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 14:29:38.597341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application next(self.gen) Oct 20 14:29:38.597341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 20 14:29:38.597341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self.session.rollback() Oct 20 14:29:38.597341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 20 14:29:38.597341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self.force_reraise() Oct 20 14:29:38.597341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 20 14:29:38.597341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise self.value Oct 20 14:29:38.597341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 20 14:29:38.597341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 20 14:29:38.597341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 20 14:29:38.597341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application session.commit() Oct 20 14:29:38.597341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 20 14:29:38.597341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 20 14:29:38.598275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 20 14:29:38.598275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._prepare_impl() Oct 20 14:29:38.598275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 20 14:29:38.598275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self.session.flush() Oct 20 14:29:38.598275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 20 14:29:38.598275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._flush(objects) Oct 20 14:29:38.598275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 20 14:29:38.598275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 20 14:29:38.598275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 20 14:29:38.598275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application compat.raise_( Oct 20 14:29:38.598275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 14:29:38.598275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception Oct 20 14:29:38.598275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 20 14:29:38.598275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application flush_context.execute() Oct 20 14:29:38.598275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 20 14:29:38.598275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rec.execute(self) Oct 20 14:29:38.598275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 20 14:29:38.600166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 20 14:29:38.600166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 20 14:29:38.600166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 20 14:29:38.600166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 20 14:29:38.600166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 20 14:29:38.600166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 20 14:29:38.600166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 20 14:29:38.600166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 20 14:29:38.600166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 20 14:29:38.600166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 20 14:29:38.600166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 20 14:29:38.600166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 20 14:29:38.600166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 20 14:29:38.600166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 20 14:29:38.600166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 20 14:29:38.601872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 14:29:38.601872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception Oct 20 14:29:38.601872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 14:29:38.601872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 14:29:38.601872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 14:29:38.601872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 14:29:38.601872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 14:29:38.601872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 14:29:38.601872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 14:29:38.601872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application conn.query(q) Oct 20 14:29:38.601872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 14:29:38.601872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 14:29:38.601872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 14:29:38.601872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application result.read() Oct 20 14:29:38.601872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 14:29:38.601872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 14:29:38.601872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 14:29:38.604152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 14:29:38.604152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 14:29:38.604152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 14:29:38.604152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 14:29:38.604152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 14:29:38.604152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 14:29:38.604152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 14:29:38.604152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [parameters: {'id': '93a718b6bb7a4e7da01075bb38b865b1', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 20 14:29:38.604152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 20 14:29:38.604152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:38.604152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:38.604152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:38.604152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:38.604152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 20 14:29:38.604152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 20 14:29:38.607655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 20 14:29:38.607655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 20 14:29:38.607655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 20 14:29:38.607655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:38.607655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:29:38.607655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:38.607655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:38.607655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:38.607655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:38.607655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:38.607655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:38.607655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:38.607655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:38.607655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:38.607655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:38.607655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:38.607655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:38.609768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 20 14:29:38.609768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 20 14:29:38.609768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:38.609768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:38.609768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 20 14:29:38.609768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 20 14:29:38.609768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:38.609768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:38.609768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 20 14:29:38.609768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 20 14:29:38.609768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 20 14:29:38.609768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:38.609768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 412/807] 10.222.0.17 () {60 vars in 1137 bytes} [Thu Oct 20 14:29:38 2022] POST /identity/v3/domains => generated 190 bytes in 164 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:29:38.609768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401e2af-ef7a-4626-ae30-cbf5b185335c None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:38.611975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:38.656602 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4862cc-41fd-4d2f-9c83-b10d6e5bf52a None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:38.694144 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d88d4b-f4e7-4eea-b6e9-3f203dbf7e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:38.694807 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d88d4b-f4e7-4eea-b6e9-3f203dbf7e41 None admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:38.695085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d88d4b-f4e7-4eea-b6e9-3f203dbf7e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:38.695353 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d88d4b-f4e7-4eea-b6e9-3f203dbf7e41 None admin] PATH_INFO: `/v3/projects/88613722e7dc4950b5e47a1d92331575/users/172b859c0d774c8f8a98ce23bdc237d5/roles/7fb83e6f9dc74b8ab285f4540dea633d` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:38.697627 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d88d4b-f4e7-4eea-b6e9-3f203dbf7e41 None admin] RBAC: Authorizing `identity:create_grant(project_id=88613722e7dc4950b5e47a1d92331575, user_id=172b859c0d774c8f8a98ce23bdc237d5, role_id=7fb83e6f9dc74b8ab285f4540dea633d)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:38.699662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d88d4b-f4e7-4eea-b6e9-3f203dbf7e41 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:38.706907 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401e2af-ef7a-4626-ae30-cbf5b185335c None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:38.712102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 396/808] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:29:38 2022] PUT /identity/v3/projects/88613722e7dc4950b5e47a1d92331575/users/172b859c0d774c8f8a98ce23bdc237d5/roles/7fb83e6f9dc74b8ab285f4540dea633d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:29:38.713296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b3161-914b-4996-958a-ef8f2a40bddc None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:38.713577 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b3161-914b-4996-958a-ef8f2a40bddc None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:38.713869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b3161-914b-4996-958a-ef8f2a40bddc None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:38.715243 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 397/809] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:38.720993 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694c8cc-7bbd-41a1-b6c9-1815e8eb57e8 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:38.721358 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694c8cc-7bbd-41a1-b6c9-1815e8eb57e8 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:38.721694 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694c8cc-7bbd-41a1-b6c9-1815e8eb57e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:38.741739 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-5694c8cc-7bbd-41a1-b6c9-1815e8eb57e8 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:38.743010 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-5694c8cc-7bbd-41a1-b6c9-1815e8eb57e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:38.754863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0f46a-01db-46de-a774-6230bc839192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:38.755605 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0f46a-01db-46de-a774-6230bc839192 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:38.755891 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0f46a-01db-46de-a774-6230bc839192 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:38.756164 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0f46a-01db-46de-a774-6230bc839192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:38.764459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:38.769020 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0f46a-01db-46de-a774-6230bc839192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:38.770560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0f46a-01db-46de-a774-6230bc839192 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:38.788259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-54d0f46a-01db-46de-a774-6230bc839192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:38.788259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:38.788259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:38.788259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:38.788259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:38.788259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:38.788259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:38.788259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:38.788259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:38.788259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:38.788259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:38.788259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:38.788259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:29:38.788259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:29:38.788259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:29:38.788259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:29:38.789358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:38.789358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:38.789358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:38.789358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:38.789358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:38.789358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:38.789358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:38.789358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:38.789358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:38.789358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:38.789358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:38.789358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:38.789358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:38.789358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:38.789358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:38.789358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:38.789358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:29:38.790284 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:29:38.790284 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:38.790284 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:38.790284 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 413/810] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:38.796071 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0f46a-01db-46de-a774-6230bc839192 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:38.835064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 398/811] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 14:29:38.856613 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:38.904479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0f46a-01db-46de-a774-6230bc839192 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:38.938438 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895238f-bfcb-46be-b32a-f096794f1ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:38.939040 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895238f-bfcb-46be-b32a-f096794f1ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:38.939312 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895238f-bfcb-46be-b32a-f096794f1ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:38.939577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895238f-bfcb-46be-b32a-f096794f1ff6 None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:38.940205 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895238f-bfcb-46be-b32a-f096794f1ff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:38.940499 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895238f-bfcb-46be-b32a-f096794f1ff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:38.941888 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895238f-bfcb-46be-b32a-f096794f1ff6 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:38.954232 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 414/812] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:39.101218 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694c8cc-7bbd-41a1-b6c9-1815e8eb57e8 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:39.211653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694c8cc-7bbd-41a1-b6c9-1815e8eb57e8 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:39.249267 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53709001-1d3e-475f-ab1c-6dceb6cdb4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:39.250073 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53709001-1d3e-475f-ab1c-6dceb6cdb4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:39.250273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53709001-1d3e-475f-ab1c-6dceb6cdb4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:39.250488 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53709001-1d3e-475f-ab1c-6dceb6cdb4c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:39.261498 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53709001-1d3e-475f-ab1c-6dceb6cdb4c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:29:39.266542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-53709001-1d3e-475f-ab1c-6dceb6cdb4c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:29:39.266542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:39.266542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:39.266542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:39.266542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:39.266542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:39.266542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:39.266542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:39.266542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:39.266542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:39.266542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:39.266542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:39.266542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:29:39.266542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:29:39.266542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:29:39.266542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:29:39.267456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:29:39.267456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:29:39.267456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:29:39.267456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:29:39.267456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:39.267456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:39.267456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:39.267456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:39.267456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:39.267456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:39.267456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:39.267456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:39.267456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:39.267456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:39.267456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:39.267456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:39.268307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:39.268307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:39.268307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:39.268307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:39.268307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:29:39.268307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:29:39.268307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:29:39.268307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:29:39.268307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:29:39.268307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:29:39.268307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:29:39.268307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:39.268307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 399/813] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:29:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:39.274047 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895238f-bfcb-46be-b32a-f096794f1ff6 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:39.375892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895238f-bfcb-46be-b32a-f096794f1ff6 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:39.389671 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:39.410769 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32374827-bcac-489c-bb59-4f98eeae249d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:39.411372 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32374827-bcac-489c-bb59-4f98eeae249d None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:39.411649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32374827-bcac-489c-bb59-4f98eeae249d None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:39.411915 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32374827-bcac-489c-bb59-4f98eeae249d None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:39.412563 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32374827-bcac-489c-bb59-4f98eeae249d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:39.412856 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32374827-bcac-489c-bb59-4f98eeae249d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:39.414253 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32374827-bcac-489c-bb59-4f98eeae249d None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:39.422826 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 415/814] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:29:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:39.428846 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53709001-1d3e-475f-ab1c-6dceb6cdb4c0 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:39.444719 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:39.524949 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53709001-1d3e-475f-ab1c-6dceb6cdb4c0 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:39.557780 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfda22f-a1c1-45cf-8524-ef6edad06f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:39.558524 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfda22f-a1c1-45cf-8524-ef6edad06f2e None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:39.558796 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfda22f-a1c1-45cf-8524-ef6edad06f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:39.559062 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfda22f-a1c1-45cf-8524-ef6edad06f2e None admin] PATH_INFO: `/v3/users/d19a975d51a345e8a81c9a2ef335ecd7` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:39.571460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfda22f-a1c1-45cf-8524-ef6edad06f2e None admin] RBAC: Authorizing `identity:get_user(user_id=d19a975d51a345e8a81c9a2ef335ecd7)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:39.572894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfda22f-a1c1-45cf-8524-ef6edad06f2e None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:39.574533 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 400/815] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:29:39 2022] GET /identity/v3/users/d19a975d51a345e8a81c9a2ef335ecd7 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:39.580364 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32374827-bcac-489c-bb59-4f98eeae249d None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:39.680085 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32374827-bcac-489c-bb59-4f98eeae249d None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:39.712385 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e6683-4dc6-4d36-b128-1d3fb4199456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:39.713007 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e6683-4dc6-4d36-b128-1d3fb4199456 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:39.713284 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e6683-4dc6-4d36-b128-1d3fb4199456 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:39.713548 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e6683-4dc6-4d36-b128-1d3fb4199456 None admin] PATH_INFO: `/v3/projects/04cbccf342f24e3facbdff20ca3808d3` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:39.714943 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e6683-4dc6-4d36-b128-1d3fb4199456 None admin] RBAC: Authorizing `identity:get_project(project_id=04cbccf342f24e3facbdff20ca3808d3)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:39.716372 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e6683-4dc6-4d36-b128-1d3fb4199456 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:39.718155 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 416/816] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:29:39 2022] GET /identity/v3/projects/04cbccf342f24e3facbdff20ca3808d3 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:39.723969 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfda22f-a1c1-45cf-8524-ef6edad06f2e None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:39.789724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:39.819765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfda22f-a1c1-45cf-8524-ef6edad06f2e None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:39.852728 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309cbdd-19ca-4828-b0a1-c79079eb95ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:39.853376 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309cbdd-19ca-4828-b0a1-c79079eb95ed None admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:39.853655 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309cbdd-19ca-4828-b0a1-c79079eb95ed None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:39.853962 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309cbdd-19ca-4828-b0a1-c79079eb95ed None admin] PATH_INFO: `/v3/projects/04cbccf342f24e3facbdff20ca3808d3/users/d19a975d51a345e8a81c9a2ef335ecd7/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:39.856656 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309cbdd-19ca-4828-b0a1-c79079eb95ed None admin] RBAC: Authorizing `identity:create_grant(project_id=04cbccf342f24e3facbdff20ca3808d3, user_id=d19a975d51a345e8a81c9a2ef335ecd7, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:39.858210 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309cbdd-19ca-4828-b0a1-c79079eb95ed None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:39.872417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 401/817] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:29:39 2022] PUT /identity/v3/projects/04cbccf342f24e3facbdff20ca3808d3/users/d19a975d51a345e8a81c9a2ef335ecd7/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:29:40.867428 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187bc6b-fa5c-49c5-bd22-d2bbf379a5b7 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:40.867974 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187bc6b-fa5c-49c5-bd22-d2bbf379a5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:40.868076 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187bc6b-fa5c-49c5-bd22-d2bbf379a5b7 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:40.869420 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 417/818] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:40.874772 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239938fa-73ae-4b74-bd83-55deb2e35ee2 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:40.875167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239938fa-73ae-4b74-bd83-55deb2e35ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:40.875316 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239938fa-73ae-4b74-bd83-55deb2e35ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:40.892943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-239938fa-73ae-4b74-bd83-55deb2e35ee2 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:40.894175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-239938fa-73ae-4b74-bd83-55deb2e35ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:40.958861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 402/819] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:41.228008 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187bc6b-fa5c-49c5-bd22-d2bbf379a5b7 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:41.273034 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:41.326094 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187bc6b-fa5c-49c5-bd22-d2bbf379a5b7 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:41.358443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3353e-565e-4a82-b6fc-4451dc2a48bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:41.359058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3353e-565e-4a82-b6fc-4451dc2a48bc None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:41.359333 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3353e-565e-4a82-b6fc-4451dc2a48bc None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:41.359600 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3353e-565e-4a82-b6fc-4451dc2a48bc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:41.369159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3353e-565e-4a82-b6fc-4451dc2a48bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:29:41.373894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-4fc3353e-565e-4a82-b6fc-4451dc2a48bc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 14:29:41.373894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:41.373894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:41.373894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:41.373894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:41.373894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:41.373894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:41.373894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:41.373894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:41.373894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:41.373894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:41.373894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:41.373894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:29:41.373894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:29:41.373894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:29:41.373894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:29:41.374997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:29:41.374997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:29:41.374997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:29:41.374997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:29:41.374997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:41.374997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:41.374997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:41.374997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:41.374997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:41.374997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:41.374997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:41.374997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:41.374997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:41.374997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:41.374997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:41.374997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:41.375834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:41.375834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:41.375834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:41.375834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:41.375834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:29:41.375834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:29:41.375834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:29:41.375834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:29:41.375834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:29:41.375834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:29:41.375834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 14:29:41.375834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:41.375834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 418/820] 10.222.0.17 () {56 vars in 1120 bytes} [Thu Oct 20 14:29:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:41.380989 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239938fa-73ae-4b74-bd83-55deb2e35ee2 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:41.439920 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:41.479137 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239938fa-73ae-4b74-bd83-55deb2e35ee2 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:41.511801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60fbdf-b445-4c0c-823b-eed4960d9b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:41.512390 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60fbdf-b445-4c0c-823b-eed4960d9b77 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:41.512665 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60fbdf-b445-4c0c-823b-eed4960d9b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:41.512931 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60fbdf-b445-4c0c-823b-eed4960d9b77 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:41.513583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60fbdf-b445-4c0c-823b-eed4960d9b77 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:41.513905 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60fbdf-b445-4c0c-823b-eed4960d9b77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:41.515278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60fbdf-b445-4c0c-823b-eed4960d9b77 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:41.522913 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 403/821] 10.222.0.17 () {56 vars in 1115 bytes} [Thu Oct 20 14:29:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:41.528847 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3353e-565e-4a82-b6fc-4451dc2a48bc None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:41.626863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3353e-565e-4a82-b6fc-4451dc2a48bc None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:41.629123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:41.660997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785df54-c7ee-4b11-9d1f-2d39cd350a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:41.661619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785df54-c7ee-4b11-9d1f-2d39cd350a0d None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:41.661923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785df54-c7ee-4b11-9d1f-2d39cd350a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:41.662194 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785df54-c7ee-4b11-9d1f-2d39cd350a0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:41.672518 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785df54-c7ee-4b11-9d1f-2d39cd350a0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:41.673983 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785df54-c7ee-4b11-9d1f-2d39cd350a0d None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:41.688296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-7785df54-c7ee-4b11-9d1f-2d39cd350a0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:41.688296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:41.688296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:41.688296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:41.688296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:41.688296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:41.688296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:41.688296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:41.688296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:41.688296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:41.688296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:41.688296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:41.688296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:29:41.688296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:29:41.688296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:29:41.688296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:29:41.689395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:41.689395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:41.689395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:41.689395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:41.689395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:41.689395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:41.689395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:41.689395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:41.689395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:41.689395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:41.689395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:41.689395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:41.689395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:41.689395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:41.689395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:41.689395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:41.689395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:29:41.690930 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:29:41.690930 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:41.690930 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:41.690930 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 419/822] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:41.695090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60fbdf-b445-4c0c-823b-eed4960d9b77 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:41.789621 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60fbdf-b445-4c0c-823b-eed4960d9b77 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:41.811957 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:41.822545 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1a3c8-8065-4962-b71c-28e91fe58c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:41.823147 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1a3c8-8065-4962-b71c-28e91fe58c5e None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:41.823461 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1a3c8-8065-4962-b71c-28e91fe58c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:41.823726 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1a3c8-8065-4962-b71c-28e91fe58c5e None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:41.824367 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1a3c8-8065-4962-b71c-28e91fe58c5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:41.824668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1a3c8-8065-4962-b71c-28e91fe58c5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:41.826052 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1a3c8-8065-4962-b71c-28e91fe58c5e None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:41.838023 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 404/823] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:41.843945 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785df54-c7ee-4b11-9d1f-2d39cd350a0d None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:41.946783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785df54-c7ee-4b11-9d1f-2d39cd350a0d None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:41.980642 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc567a-54a4-4d38-ac84-a7ad670685d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:41.981352 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc567a-54a4-4d38-ac84-a7ad670685d5 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:41.981632 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc567a-54a4-4d38-ac84-a7ad670685d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:41.981927 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc567a-54a4-4d38-ac84-a7ad670685d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:41.989534 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc567a-54a4-4d38-ac84-a7ad670685d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:41.990996 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc567a-54a4-4d38-ac84-a7ad670685d5 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:42.002710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-b8dc567a-54a4-4d38-ac84-a7ad670685d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 14:29:42.002710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:42.002710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:42.002710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:42.002710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:42.002710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:42.002710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:42.002710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:42.002710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:42.002710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:42.002710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:42.002710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:42.002710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:29:42.002710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:29:42.002710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:29:42.002710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:29:42.003828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:42.003828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:42.003828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:29:42.003828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:42.003828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:29:42.003828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:29:42.003828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:42.003828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:42.003828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:42.003828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:42.003828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:42.003828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:42.003828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:42.003828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:42.003828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:42.003828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:42.003828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:42.003828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:42.004772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:42.004772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:42.004772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:29:42.004772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:29:42.004772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:29:42.004772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:29:42.004772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:29:42.004772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:29:42.004772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 14:29:42.004772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:42.004772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 420/824] 10.222.0.17 () {56 vars in 1093 bytes} [Thu Oct 20 14:29:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:29:42.009609 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1a3c8-8065-4962-b71c-28e91fe58c5e None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:42.010772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b733fc-f049-464c-9e38-7b70ff1dff80 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:42.011102 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b733fc-f049-464c-9e38-7b70ff1dff80 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:42.011463 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b733fc-f049-464c-9e38-7b70ff1dff80 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:42.012749 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 421/825] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:42.017627 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb63f6-a3a5-486b-b103-173a8c41f859 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:42.017946 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb63f6-a3a5-486b-b103-173a8c41f859 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:42.018229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb63f6-a3a5-486b-b103-173a8c41f859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:42.036089 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-c0fb63f6-a3a5-486b-b103-173a8c41f859 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:42.037292 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-c0fb63f6-a3a5-486b-b103-173a8c41f859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:42.048641 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:42.102747 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 422/826] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 14:29:42.109951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1a3c8-8065-4962-b71c-28e91fe58c5e None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:42.142818 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce05646-1e6d-47c3-95be-d01c9cf28321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:42.143419 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce05646-1e6d-47c3-95be-d01c9cf28321 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:42.143700 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce05646-1e6d-47c3-95be-d01c9cf28321 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:42.143974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce05646-1e6d-47c3-95be-d01c9cf28321 None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:42.144693 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce05646-1e6d-47c3-95be-d01c9cf28321 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:42.145020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce05646-1e6d-47c3-95be-d01c9cf28321 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:42.146484 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce05646-1e6d-47c3-95be-d01c9cf28321 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:42.168042 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 405/827] 10.222.0.17 () {56 vars in 1133 bytes} [Thu Oct 20 14:29:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:42.169275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb63f6-a3a5-486b-b103-173a8c41f859 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:42.265828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb63f6-a3a5-486b-b103-173a8c41f859 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:42.298054 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608ad92-734e-4c7c-bc19-ce10a7f37065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:42.298655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608ad92-734e-4c7c-bc19-ce10a7f37065 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:42.298936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608ad92-734e-4c7c-bc19-ce10a7f37065 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:42.299208 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608ad92-734e-4c7c-bc19-ce10a7f37065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:42.314471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:42.365414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608ad92-734e-4c7c-bc19-ce10a7f37065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:42.366903 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608ad92-734e-4c7c-bc19-ce10a7f37065 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:42.372346 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce05646-1e6d-47c3-95be-d01c9cf28321 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:42.415403 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:42.465044 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 423/828] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:29:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 14:29:42.470857 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608ad92-734e-4c7c-bc19-ce10a7f37065 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:42.472050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce05646-1e6d-47c3-95be-d01c9cf28321 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:42.505795 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e77931-5fb4-4077-b4cf-9c116ff9b36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:42.506437 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e77931-5fb4-4077-b4cf-9c116ff9b36f None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:42.506712 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e77931-5fb4-4077-b4cf-9c116ff9b36f None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:42.506974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e77931-5fb4-4077-b4cf-9c116ff9b36f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:42.516066 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:42.516888 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e77931-5fb4-4077-b4cf-9c116ff9b36f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:29:42.521947 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-c3e77931-5fb4-4077-b4cf-9c116ff9b36f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:29:42.521947 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:42.521947 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:42.521947 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:42.521947 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:42.521947 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:42.521947 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:42.521947 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:42.521947 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:42.521947 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:42.521947 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:42.521947 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:42.521947 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:29:42.521947 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:29:42.521947 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:29:42.521947 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:29:42.523090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:29:42.523090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:29:42.523090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:29:42.523090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:29:42.523090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:42.523090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:42.523090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:42.523090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:42.523090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:42.523090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:42.523090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:42.523090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:42.523090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:42.523090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:42.523090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:42.523090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:42.523943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:42.523943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:42.523943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:42.523943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:42.523943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:29:42.523943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:29:42.523943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:29:42.523943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:29:42.523943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:29:42.523943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:29:42.523943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:29:42.523943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:29:42.523943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 406/829] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:29:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:29:42.529515 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e77931-5fb4-4077-b4cf-9c116ff9b36f None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:42.572495 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608ad92-734e-4c7c-bc19-ce10a7f37065 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:42.605718 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855ae73-2c40-4f81-b0b6-be86dc0dad12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:42.606355 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855ae73-2c40-4f81-b0b6-be86dc0dad12 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:42.606630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855ae73-2c40-4f81-b0b6-be86dc0dad12 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:42.606896 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855ae73-2c40-4f81-b0b6-be86dc0dad12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:42.616582 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855ae73-2c40-4f81-b0b6-be86dc0dad12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:42.618062 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855ae73-2c40-4f81-b0b6-be86dc0dad12 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:42.632591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-d855ae73-2c40-4f81-b0b6-be86dc0dad12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:42.632591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:42.632591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:42.632591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:42.632591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:42.632591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:42.632591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:42.632591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:42.632591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:42.632591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:42.632591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:42.632591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:42.632591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:29:42.632591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:29:42.632591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:29:42.632591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:29:42.633535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:42.633535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:42.633535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:42.633535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:42.633535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:42.633535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:42.633535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:42.633535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:42.633535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:42.633535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:42.633535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:42.633535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:42.633535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:42.633535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:42.633535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:42.633535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:42.633535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:29:42.634492 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:29:42.634492 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:29:42.634492 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:42.634492 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 424/830] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:29:42.634723 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e77931-5fb4-4077-b4cf-9c116ff9b36f None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:42.635494 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:42.639790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855ae73-2c40-4f81-b0b6-be86dc0dad12 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:42.669357 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f899658-b31d-4215-99f8-547a48b2e68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:42.669984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f899658-b31d-4215-99f8-547a48b2e68c None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:42.670271 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f899658-b31d-4215-99f8-547a48b2e68c None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:42.670543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f899658-b31d-4215-99f8-547a48b2e68c None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:42.671205 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f899658-b31d-4215-99f8-547a48b2e68c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:42.671503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f899658-b31d-4215-99f8-547a48b2e68c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:42.672877 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f899658-b31d-4215-99f8-547a48b2e68c None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:42.681307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 407/831] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:29:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:42.687823 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f899658-b31d-4215-99f8-547a48b2e68c None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:42.735523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:42.739498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855ae73-2c40-4f81-b0b6-be86dc0dad12 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:42.773367 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b2653-ccd8-4ba0-bf16-62cf185eeb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:42.773932 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b2653-ccd8-4ba0-bf16-62cf185eeb50 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:42.774214 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b2653-ccd8-4ba0-bf16-62cf185eeb50 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:42.774483 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b2653-ccd8-4ba0-bf16-62cf185eeb50 None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:42.775116 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b2653-ccd8-4ba0-bf16-62cf185eeb50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:42.775414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b2653-ccd8-4ba0-bf16-62cf185eeb50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:42.776794 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b2653-ccd8-4ba0-bf16-62cf185eeb50 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:42.783000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f899658-b31d-4215-99f8-547a48b2e68c None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:42.788258 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 425/832] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:42.794589 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b2653-ccd8-4ba0-bf16-62cf185eeb50 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:42.816571 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeaeaae-03b4-43b0-a209-5150ebfaa575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:42.817200 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeaeaae-03b4-43b0-a209-5150ebfaa575 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:42.817482 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeaeaae-03b4-43b0-a209-5150ebfaa575 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:42.817757 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeaeaae-03b4-43b0-a209-5150ebfaa575 None admin] PATH_INFO: `/v3/users/d19a975d51a345e8a81c9a2ef335ecd7` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:42.818916 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeaeaae-03b4-43b0-a209-5150ebfaa575 None admin] RBAC: Authorizing `identity:get_user(user_id=d19a975d51a345e8a81c9a2ef335ecd7)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:42.820336 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeaeaae-03b4-43b0-a209-5150ebfaa575 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:42.827265 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 408/833] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:29:42 2022] GET /identity/v3/users/d19a975d51a345e8a81c9a2ef335ecd7 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:42.828237 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeaeaae-03b4-43b0-a209-5150ebfaa575 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:42.858892 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:42.893426 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b2653-ccd8-4ba0-bf16-62cf185eeb50 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:42.927314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f926e-3222-4c04-bd3b-9936e3bb6e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:42.927927 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f926e-3222-4c04-bd3b-9936e3bb6e55 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:42.928200 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f926e-3222-4c04-bd3b-9936e3bb6e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:42.928322 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeaeaae-03b4-43b0-a209-5150ebfaa575 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:42.928467 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f926e-3222-4c04-bd3b-9936e3bb6e55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:42.935914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f926e-3222-4c04-bd3b-9936e3bb6e55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:42.937367 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f926e-3222-4c04-bd3b-9936e3bb6e55 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:42.948471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-b09f926e-3222-4c04-bd3b-9936e3bb6e55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:29:42.948471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:29:42.948471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:29:42.948471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:29:42.948471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:29:42.948471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:29:42.948471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:29:42.948471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:29:42.948471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:29:42.948471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:29:42.948471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:29:42.948471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:29:42.948471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:29:42.948471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:29:42.948471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:29:42.949909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:29:42.949909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:29:42.949909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:29:42.949909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:29:42.949909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:29:42.949909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:29:42.949909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:29:42.949909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:29:42.949909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:29:42.949909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:29:42.949909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:29:42.949909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:29:42.949909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:29:42.949909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:29:42.949909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:29:42.949909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:29:42.949909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:29:42.950799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:29:42.950799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:29:42.950799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:29:42.950799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:29:42.950799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:29:42.950799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:29:42.950799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:29:42.950799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:29:42.950799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 426/834] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:29:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:29:42.955374 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f926e-3222-4c04-bd3b-9936e3bb6e55 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:42.961035 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec355b8-23f0-4a1a-9383-e8f6feb7e48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:42.961659 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec355b8-23f0-4a1a-9383-e8f6feb7e48e None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:42.961937 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec355b8-23f0-4a1a-9383-e8f6feb7e48e None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:42.962208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec355b8-23f0-4a1a-9383-e8f6feb7e48e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:42.974544 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:43.028820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec355b8-23f0-4a1a-9383-e8f6feb7e48e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:43.030208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec355b8-23f0-4a1a-9383-e8f6feb7e48e None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:43.059159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f926e-3222-4c04-bd3b-9936e3bb6e55 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:43.059467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:43.092446 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f47d2-d155-4c7d-91c0-d8f1c272c1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:43.093134 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f47d2-d155-4c7d-91c0-d8f1c272c1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:43.093414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f47d2-d155-4c7d-91c0-d8f1c272c1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:43.093682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f47d2-d155-4c7d-91c0-d8f1c272c1a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:43.094405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f47d2-d155-4c7d-91c0-d8f1c272c1a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:43.094704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f47d2-d155-4c7d-91c0-d8f1c272c1a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:43.096134 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f47d2-d155-4c7d-91c0-d8f1c272c1a1 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:43.108294 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 427/835] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:29:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:43.114296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f47d2-d155-4c7d-91c0-d8f1c272c1a1 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:43.129267 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 409/836] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:29:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 20 14:29:43.135010 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec355b8-23f0-4a1a-9383-e8f6feb7e48e None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:43.195047 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:43.217497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f47d2-d155-4c7d-91c0-d8f1c272c1a1 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:43.232401 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec355b8-23f0-4a1a-9383-e8f6feb7e48e None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:43.250975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafa9f2-98ba-4827-a96f-ba5efe58c743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:43.251575 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafa9f2-98ba-4827-a96f-ba5efe58c743 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:43.251853 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafa9f2-98ba-4827-a96f-ba5efe58c743 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:43.252127 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafa9f2-98ba-4827-a96f-ba5efe58c743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:43.252835 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafa9f2-98ba-4827-a96f-ba5efe58c743 None admin] RBAC: Adding query filter params (role.id=7fb83e6f9dc74b8ab285f4540dea633d, scope.project.id=88613722e7dc4950b5e47a1d92331575, user.id=172b859c0d774c8f8a98ce23bdc237d5) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:43.253137 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafa9f2-98ba-4827-a96f-ba5efe58c743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:43.254601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafa9f2-98ba-4827-a96f-ba5efe58c743 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:43.260218 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 428/837] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:29:43 2022] GET /identity/v3/role_assignments?user.id=172b859c0d774c8f8a98ce23bdc237d5&scope.project.id=88613722e7dc4950b5e47a1d92331575&role.id=7fb83e6f9dc74b8ab285f4540dea633d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:43.261610 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:43.266583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35874c2c-9804-42c0-8dce-aaf57c77d078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:43.267279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35874c2c-9804-42c0-8dce-aaf57c77d078 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:43.267786 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35874c2c-9804-42c0-8dce-aaf57c77d078 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:43.268242 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35874c2c-9804-42c0-8dce-aaf57c77d078 None admin] PATH_INFO: `/v3/projects/04cbccf342f24e3facbdff20ca3808d3` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:43.269637 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35874c2c-9804-42c0-8dce-aaf57c77d078 None admin] RBAC: Authorizing `identity:get_project(project_id=04cbccf342f24e3facbdff20ca3808d3)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:43.271156 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35874c2c-9804-42c0-8dce-aaf57c77d078 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:43.272874 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 410/838] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:29:43 2022] GET /identity/v3/projects/04cbccf342f24e3facbdff20ca3808d3 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:29:43.280015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafa9f2-98ba-4827-a96f-ba5efe58c743 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:43.385692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafa9f2-98ba-4827-a96f-ba5efe58c743 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:43.422059 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b40c62-90bd-4347-a875-31866154a899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:43.422671 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b40c62-90bd-4347-a875-31866154a899 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:43.422947 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b40c62-90bd-4347-a875-31866154a899 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:43.423216 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b40c62-90bd-4347-a875-31866154a899 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:43.423942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b40c62-90bd-4347-a875-31866154a899 None admin] RBAC: Adding query filter params (role.id=fe3ee5741c6143adb5459b5de54450c8, scope.project.id=04cbccf342f24e3facbdff20ca3808d3, user.id=d19a975d51a345e8a81c9a2ef335ecd7) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:43.424245 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b40c62-90bd-4347-a875-31866154a899 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:43.425680 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b40c62-90bd-4347-a875-31866154a899 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:43.432102 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 429/839] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:29:43 2022] GET /identity/v3/role_assignments?user.id=d19a975d51a345e8a81c9a2ef335ecd7&scope.project.id=04cbccf342f24e3facbdff20ca3808d3&role.id=fe3ee5741c6143adb5459b5de54450c8 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:45.582597 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cd256-a43a-4824-825b-c74d42baa747 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:45.583107 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cd256-a43a-4824-825b-c74d42baa747 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:45.583212 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cd256-a43a-4824-825b-c74d42baa747 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:45.584467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 411/840] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:45.589575 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be8be9-d79f-449e-9285-85deebe9c1a0 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:45.589999 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be8be9-d79f-449e-9285-85deebe9c1a0 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:45.590134 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be8be9-d79f-449e-9285-85deebe9c1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:45.603113 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:45.609324 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-c7be8be9-d79f-449e-9285-85deebe9c1a0 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:45.610534 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-c7be8be9-d79f-449e-9285-85deebe9c1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:45.673578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 430/841] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:45.946116 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cd256-a43a-4824-825b-c74d42baa747 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:46.043025 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cd256-a43a-4824-825b-c74d42baa747 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:46.075693 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160b7f5-5634-4152-bd59-14d28a85f920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:46.076302 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160b7f5-5634-4152-bd59-14d28a85f920 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:46.076580 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160b7f5-5634-4152-bd59-14d28a85f920 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:46.076850 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160b7f5-5634-4152-bd59-14d28a85f920 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:46.077961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160b7f5-5634-4152-bd59-14d28a85f920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:46.079385 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160b7f5-5634-4152-bd59-14d28a85f920 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:46.080902 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 412/842] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:46.086651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be8be9-d79f-449e-9285-85deebe9c1a0 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:46.183310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be8be9-d79f-449e-9285-85deebe9c1a0 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:46.216684 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddd4b7-3522-4947-8152-11dd74a0c366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:46.217229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddd4b7-3522-4947-8152-11dd74a0c366 None admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:46.217510 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddd4b7-3522-4947-8152-11dd74a0c366 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:46.217784 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddd4b7-3522-4947-8152-11dd74a0c366 None admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:46.218468 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddd4b7-3522-4947-8152-11dd74a0c366 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:46.219896 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddd4b7-3522-4947-8152-11dd74a0c366 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:46.228630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:46.242040 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 431/843] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Oct 20 14:29:46 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:29:48.385339 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb830f-5eb3-4726-98ac-207808ce9137 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:48.386479 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb830f-5eb3-4726-98ac-207808ce9137 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:48.386479 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb830f-5eb3-4726-98ac-207808ce9137 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:48.387797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 413/844] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:48.392937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6bd3c-bda3-4e92-85e6-b50ae89578cb None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:48.393346 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6bd3c-bda3-4e92-85e6-b50ae89578cb None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:48.393490 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6bd3c-bda3-4e92-85e6-b50ae89578cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:48.411290 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-60b6bd3c-bda3-4e92-85e6-b50ae89578cb None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:48.412468 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-60b6bd3c-bda3-4e92-85e6-b50ae89578cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:48.476600 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 432/845] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:48.746938 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb830f-5eb3-4726-98ac-207808ce9137 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:48.812406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:48.845633 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb830f-5eb3-4726-98ac-207808ce9137 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:48.992226 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cabc10-cfe8-4179-9084-b705649349ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:48.992836 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cabc10-cfe8-4179-9084-b705649349ae None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:48.993112 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cabc10-cfe8-4179-9084-b705649349ae None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:48.993379 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cabc10-cfe8-4179-9084-b705649349ae None admin] PATH_INFO: `/v3/roles/e37d07e878834488b4da4408ae42afd2` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:48.995266 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cabc10-cfe8-4179-9084-b705649349ae None admin] RBAC: Authorizing `identity:get_role(role_id=e37d07e878834488b4da4408ae42afd2)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:48.996597 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cabc10-cfe8-4179-9084-b705649349ae None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:48.997944 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 414/846] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:29:48 2022] GET /identity/v3/roles/e37d07e878834488b4da4408ae42afd2 => generated 223 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:49.003727 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6bd3c-bda3-4e92-85e6-b50ae89578cb None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:49.100562 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6bd3c-bda3-4e92-85e6-b50ae89578cb None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:49.122817 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:49.135091 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574b6a6-6df7-443a-b518-642138b9bc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:49.136285 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574b6a6-6df7-443a-b518-642138b9bc5f None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:49.136559 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574b6a6-6df7-443a-b518-642138b9bc5f None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:49.136858 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574b6a6-6df7-443a-b518-642138b9bc5f None admin] PATH_INFO: `/v3/users/de76a236bb334f8d9c34cb6537f7ab4e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:49.149500 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574b6a6-6df7-443a-b518-642138b9bc5f None admin] RBAC: Authorizing `identity:get_user(user_id=de76a236bb334f8d9c34cb6537f7ab4e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:49.150967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574b6a6-6df7-443a-b518-642138b9bc5f None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:49.152527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 433/847] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:29:49 2022] GET /identity/v3/users/de76a236bb334f8d9c34cb6537f7ab4e => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:49.158283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cabc10-cfe8-4179-9084-b705649349ae None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:49.255303 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cabc10-cfe8-4179-9084-b705649349ae None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:49.287818 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16a2cf-8bb3-4761-82ab-478c3eb1669a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:49.288430 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16a2cf-8bb3-4761-82ab-478c3eb1669a None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:49.288707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16a2cf-8bb3-4761-82ab-478c3eb1669a None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:49.288979 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16a2cf-8bb3-4761-82ab-478c3eb1669a None admin] PATH_INFO: `/v3/projects/04cbccf342f24e3facbdff20ca3808d3` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:49.290091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16a2cf-8bb3-4761-82ab-478c3eb1669a None admin] RBAC: Authorizing `identity:get_project(project_id=04cbccf342f24e3facbdff20ca3808d3)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:49.291565 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16a2cf-8bb3-4761-82ab-478c3eb1669a None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:49.293621 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 415/848] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:29:49 2022] GET /identity/v3/projects/04cbccf342f24e3facbdff20ca3808d3 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:49.299624 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574b6a6-6df7-443a-b518-642138b9bc5f None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:49.395825 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574b6a6-6df7-443a-b518-642138b9bc5f None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:49.428396 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd5fb2-5e74-471e-afdb-a60b1da0d558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:49.429037 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd5fb2-5e74-471e-afdb-a60b1da0d558 None admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:49.429313 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd5fb2-5e74-471e-afdb-a60b1da0d558 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:49.429582 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd5fb2-5e74-471e-afdb-a60b1da0d558 None admin] PATH_INFO: `/v3/projects/04cbccf342f24e3facbdff20ca3808d3/users/de76a236bb334f8d9c34cb6537f7ab4e/roles/e37d07e878834488b4da4408ae42afd2` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:49.431699 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd5fb2-5e74-471e-afdb-a60b1da0d558 None admin] RBAC: Authorizing `identity:create_grant(project_id=04cbccf342f24e3facbdff20ca3808d3, user_id=de76a236bb334f8d9c34cb6537f7ab4e, role_id=e37d07e878834488b4da4408ae42afd2)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:49.433264 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd5fb2-5e74-471e-afdb-a60b1da0d558 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:49.445728 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 434/849] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:29:49 2022] PUT /identity/v3/projects/04cbccf342f24e3facbdff20ca3808d3/users/de76a236bb334f8d9c34cb6537f7ab4e/roles/e37d07e878834488b4da4408ae42afd2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:29:51.549575 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68cbb5-d392-44b8-b41f-e2afcf9f6531 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:51.550100 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68cbb5-d392-44b8-b41f-e2afcf9f6531 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:51.550100 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68cbb5-d392-44b8-b41f-e2afcf9f6531 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:51.551419 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 416/850] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:51.556764 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf828e-8d64-4083-a43c-01e8533adc76 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:51.557698 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf828e-8d64-4083-a43c-01e8533adc76 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:51.557828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf828e-8d64-4083-a43c-01e8533adc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:51.576187 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-02bf828e-8d64-4083-a43c-01e8533adc76 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:51.577358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-02bf828e-8d64-4083-a43c-01e8533adc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:51.610127 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:51.642645 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 435/851] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:51.912794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68cbb5-d392-44b8-b41f-e2afcf9f6531 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:51.917325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:52.013052 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68cbb5-d392-44b8-b41f-e2afcf9f6531 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:52.045987 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab681ee1-35de-4b7e-9b35-724cb6bfb54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:52.046599 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab681ee1-35de-4b7e-9b35-724cb6bfb54c None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:52.046878 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab681ee1-35de-4b7e-9b35-724cb6bfb54c None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:52.047148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab681ee1-35de-4b7e-9b35-724cb6bfb54c None admin] PATH_INFO: `/v3/roles/e37d07e878834488b4da4408ae42afd2` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:52.048522 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab681ee1-35de-4b7e-9b35-724cb6bfb54c None admin] RBAC: Authorizing `identity:get_role(role_id=e37d07e878834488b4da4408ae42afd2)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:52.049904 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab681ee1-35de-4b7e-9b35-724cb6bfb54c None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:52.051183 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 417/852] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:29:51 2022] GET /identity/v3/roles/e37d07e878834488b4da4408ae42afd2 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:52.057343 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf828e-8d64-4083-a43c-01e8533adc76 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:52.149669 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf828e-8d64-4083-a43c-01e8533adc76 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:52.183218 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44de8b-cda5-4d4c-9694-fdc2ab583d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:52.183843 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44de8b-cda5-4d4c-9694-fdc2ab583d3b None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:52.184119 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44de8b-cda5-4d4c-9694-fdc2ab583d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:52.184388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44de8b-cda5-4d4c-9694-fdc2ab583d3b None admin] PATH_INFO: `/v3/users/de76a236bb334f8d9c34cb6537f7ab4e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:52.185469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44de8b-cda5-4d4c-9694-fdc2ab583d3b None admin] RBAC: Authorizing `identity:get_user(user_id=de76a236bb334f8d9c34cb6537f7ab4e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:52.186928 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44de8b-cda5-4d4c-9694-fdc2ab583d3b None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:52.188473 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 436/853] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:29:52 2022] GET /identity/v3/users/de76a236bb334f8d9c34cb6537f7ab4e => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:52.194317 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab681ee1-35de-4b7e-9b35-724cb6bfb54c None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:52.261208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:52.290387 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab681ee1-35de-4b7e-9b35-724cb6bfb54c None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:52.323006 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb8336-dd1c-4396-b74c-0e84bd5abc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:52.323541 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb8336-dd1c-4396-b74c-0e84bd5abc5a None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:52.323820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb8336-dd1c-4396-b74c-0e84bd5abc5a None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:52.324097 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb8336-dd1c-4396-b74c-0e84bd5abc5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:52.387820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb8336-dd1c-4396-b74c-0e84bd5abc5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:52.389249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb8336-dd1c-4396-b74c-0e84bd5abc5a None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:52.453970 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:52.483750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 418/854] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:29:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 14:29:52.489615 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44de8b-cda5-4d4c-9694-fdc2ab583d3b None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:52.528631 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:52.587076 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44de8b-cda5-4d4c-9694-fdc2ab583d3b None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:52.620863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587d6d1-c3e5-4450-a291-5cebb0a01900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:52.621486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587d6d1-c3e5-4450-a291-5cebb0a01900 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:52.621772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587d6d1-c3e5-4450-a291-5cebb0a01900 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:52.622071 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587d6d1-c3e5-4450-a291-5cebb0a01900 None admin] PATH_INFO: `/v3/projects/04cbccf342f24e3facbdff20ca3808d3` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:52.623172 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587d6d1-c3e5-4450-a291-5cebb0a01900 None admin] RBAC: Authorizing `identity:get_project(project_id=04cbccf342f24e3facbdff20ca3808d3)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:52.624615 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587d6d1-c3e5-4450-a291-5cebb0a01900 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:52.626268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 437/855] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:29:52 2022] GET /identity/v3/projects/04cbccf342f24e3facbdff20ca3808d3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:52.632545 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb8336-dd1c-4396-b74c-0e84bd5abc5a None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:52.727169 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb8336-dd1c-4396-b74c-0e84bd5abc5a None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:52.759955 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce6d51-7a56-40cc-9555-21c86b2db679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:52.761124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce6d51-7a56-40cc-9555-21c86b2db679 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:52.761398 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce6d51-7a56-40cc-9555-21c86b2db679 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:52.761667 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce6d51-7a56-40cc-9555-21c86b2db679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:52.762407 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce6d51-7a56-40cc-9555-21c86b2db679 None admin] RBAC: Adding query filter params (role.id=e37d07e878834488b4da4408ae42afd2, scope.project.id=04cbccf342f24e3facbdff20ca3808d3, user.id=de76a236bb334f8d9c34cb6537f7ab4e) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:29:52.762709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce6d51-7a56-40cc-9555-21c86b2db679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:52.764119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce6d51-7a56-40cc-9555-21c86b2db679 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:52.769539 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 419/856] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:29:52 2022] GET /identity/v3/role_assignments?user.id=de76a236bb334f8d9c34cb6537f7ab4e&scope.project.id=04cbccf342f24e3facbdff20ca3808d3&role.id=e37d07e878834488b4da4408ae42afd2 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:54.875410 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab30c0-c75c-490e-9798-df15fe6f2c88 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:54.875931 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab30c0-c75c-490e-9798-df15fe6f2c88 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:54.875931 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab30c0-c75c-490e-9798-df15fe6f2c88 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:54.877268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 438/857] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:54.882356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719606f-8a01-4d5e-99ce-c5920c7b297b None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:54.882719 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719606f-8a01-4d5e-99ce-c5920c7b297b None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:54.882896 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719606f-8a01-4d5e-99ce-c5920c7b297b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:54.901371 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-b719606f-8a01-4d5e-99ce-c5920c7b297b None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:54.902557 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-b719606f-8a01-4d5e-99ce-c5920c7b297b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:54.930073 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:54.966817 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 420/858] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:55.240315 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab30c0-c75c-490e-9798-df15fe6f2c88 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:55.339635 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab30c0-c75c-490e-9798-df15fe6f2c88 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:55.346697 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:55.373995 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b82fd-4f65-4ee1-ab91-1006a434dd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:55.374611 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b82fd-4f65-4ee1-ab91-1006a434dd70 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:55.374889 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b82fd-4f65-4ee1-ab91-1006a434dd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:55.375157 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b82fd-4f65-4ee1-ab91-1006a434dd70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:55.376250 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b82fd-4f65-4ee1-ab91-1006a434dd70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:55.377677 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b82fd-4f65-4ee1-ab91-1006a434dd70 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:55.379230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 439/859] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:55.384976 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719606f-8a01-4d5e-99ce-c5920c7b297b None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:55.478256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719606f-8a01-4d5e-99ce-c5920c7b297b None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:55.510595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85985e0-b57f-4d1d-a404-d8eb37ff4bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:55.511177 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85985e0-b57f-4d1d-a404-d8eb37ff4bb4 None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:55.511451 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85985e0-b57f-4d1d-a404-d8eb37ff4bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:55.511718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85985e0-b57f-4d1d-a404-d8eb37ff4bb4 None admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:55.512370 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85985e0-b57f-4d1d-a404-d8eb37ff4bb4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:55.513772 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85985e0-b57f-4d1d-a404-d8eb37ff4bb4 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:55.539171 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 421/860] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Oct 20 14:29:55 2022] POST /identity/v3/projects => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:29:57.687080 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd6e19-a1d4-4bf1-8b26-51ca6e877491 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:57.687598 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd6e19-a1d4-4bf1-8b26-51ca6e877491 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:57.687598 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd6e19-a1d4-4bf1-8b26-51ca6e877491 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:57.688939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 440/861] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:29:57.694242 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc98070-f4db-49fb-81ed-7b0031baa228 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:57.694633 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc98070-f4db-49fb-81ed-7b0031baa228 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:57.694798 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc98070-f4db-49fb-81ed-7b0031baa228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:57.713449 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-2fc98070-f4db-49fb-81ed-7b0031baa228 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:29:57.714658 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-2fc98070-f4db-49fb-81ed-7b0031baa228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:29:57.727585 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:29:57.779637 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 422/862] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:29:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:29:58.053741 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd6e19-a1d4-4bf1-8b26-51ca6e877491 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:58.151294 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd6e19-a1d4-4bf1-8b26-51ca6e877491 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:58.184792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3eeb6-bcea-4624-807d-0fe68def247e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:58.185418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3eeb6-bcea-4624-807d-0fe68def247e None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:58.185698 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3eeb6-bcea-4624-807d-0fe68def247e None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:58.185996 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3eeb6-bcea-4624-807d-0fe68def247e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:58.187089 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3eeb6-bcea-4624-807d-0fe68def247e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:58.188515 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3eeb6-bcea-4624-807d-0fe68def247e None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:58.190103 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 441/863] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:29:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:29:58.195781 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc98070-f4db-49fb-81ed-7b0031baa228 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:29:58.289798 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc98070-f4db-49fb-81ed-7b0031baa228 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:29:58.322143 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdb699-5ab0-4b7b-a678-f85dfd5a062c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:29:58.322738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdb699-5ab0-4b7b-a678-f85dfd5a062c None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:29:58.323011 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdb699-5ab0-4b7b-a678-f85dfd5a062c None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:29:58.323280 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdb699-5ab0-4b7b-a678-f85dfd5a062c None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:29:58.323921 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdb699-5ab0-4b7b-a678-f85dfd5a062c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:29:58.325587 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdb699-5ab0-4b7b-a678-f85dfd5a062c None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:29:58.345977 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 423/864] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Oct 20 14:29:58 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:30:00.489255 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab86174-fa0d-4087-9b28-e214b8b3b88c None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:00.489751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab86174-fa0d-4087-9b28-e214b8b3b88c None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:00.489751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab86174-fa0d-4087-9b28-e214b8b3b88c None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:00.491054 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 442/865] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:30:00.496784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd63d9d-997b-46a7-a71a-ebd344c51291 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:00.497191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd63d9d-997b-46a7-a71a-ebd344c51291 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:00.497329 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd63d9d-997b-46a7-a71a-ebd344c51291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:00.504483 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:00.516674 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-bdd63d9d-997b-46a7-a71a-ebd344c51291 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:30:00.517887 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-bdd63d9d-997b-46a7-a71a-ebd344c51291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:30:00.581737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 424/866] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:30:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:30:00.853932 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab86174-fa0d-4087-9b28-e214b8b3b88c None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:00.897806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:00.954775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab86174-fa0d-4087-9b28-e214b8b3b88c None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:00.987223 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522d66b-f23e-487d-9758-e25c4278be7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:00.987838 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522d66b-f23e-487d-9758-e25c4278be7f None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:00.988112 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522d66b-f23e-487d-9758-e25c4278be7f None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:00.988376 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522d66b-f23e-487d-9758-e25c4278be7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:00.997931 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522d66b-f23e-487d-9758-e25c4278be7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:30:01.002596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-e522d66b-f23e-487d-9758-e25c4278be7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:30:01.002596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:30:01.002596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:30:01.002596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:30:01.002596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:30:01.002596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:30:01.002596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:30:01.002596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:30:01.002596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:30:01.002596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:30:01.002596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:30:01.002596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:30:01.002596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:30:01.002596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:30:01.002596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:30:01.002596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:30:01.003668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:30:01.003668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:30:01.003668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:30:01.003668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:30:01.003668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:30:01.003668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:30:01.003668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:30:01.003668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:30:01.003668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:30:01.003668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:30:01.003668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:30:01.003668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:30:01.003668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:30:01.003668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:30:01.003668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:30:01.003668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:30:01.004863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:30:01.004863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:30:01.004863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:30:01.004863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:30:01.004863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:30:01.004863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:30:01.004863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:30:01.004863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:30:01.004863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:30:01.004863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:30:01.004863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:30:01.004863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:30:01.004863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 443/867] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:30:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:30:01.009637 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd63d9d-997b-46a7-a71a-ebd344c51291 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:01.105080 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd63d9d-997b-46a7-a71a-ebd344c51291 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:01.141619 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0bb97-27ad-470e-8ffe-ebdf718a8d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:01.142261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0bb97-27ad-470e-8ffe-ebdf718a8d97 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:01.142537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0bb97-27ad-470e-8ffe-ebdf718a8d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:01.142803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0bb97-27ad-470e-8ffe-ebdf718a8d97 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:01.143456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc0bb97-27ad-470e-8ffe-ebdf718a8d97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:30:01.143751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc0bb97-27ad-470e-8ffe-ebdf718a8d97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:01.145099 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc0bb97-27ad-470e-8ffe-ebdf718a8d97 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:01.146406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:01.154337 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 425/868] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:30:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:30:01.160103 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522d66b-f23e-487d-9758-e25c4278be7f None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:01.256072 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522d66b-f23e-487d-9758-e25c4278be7f None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:01.257529 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:01.289395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9ff9b-8948-46f0-b82a-af83f64b2d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:01.290035 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9ff9b-8948-46f0-b82a-af83f64b2d06 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:01.290311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9ff9b-8948-46f0-b82a-af83f64b2d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:01.291194 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9ff9b-8948-46f0-b82a-af83f64b2d06 None admin] PATH_INFO: `/v3/users/971ad8bac7e441a4bc87b8c082e542e9` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:01.303857 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9ff9b-8948-46f0-b82a-af83f64b2d06 None admin] RBAC: Authorizing `identity:get_user(user_id=971ad8bac7e441a4bc87b8c082e542e9)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:01.305291 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9ff9b-8948-46f0-b82a-af83f64b2d06 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:01.306906 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 444/869] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:30:01 2022] GET /identity/v3/users/971ad8bac7e441a4bc87b8c082e542e9 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:30:01.312711 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0bb97-27ad-470e-8ffe-ebdf718a8d97 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:01.428249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0bb97-27ad-470e-8ffe-ebdf718a8d97 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:01.461333 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a8e0d-6cef-40f5-bcd0-ba7c0185ee3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:01.461992 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a8e0d-6cef-40f5-bcd0-ba7c0185ee3e None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:01.462273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a8e0d-6cef-40f5-bcd0-ba7c0185ee3e None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:01.463228 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a8e0d-6cef-40f5-bcd0-ba7c0185ee3e None admin] PATH_INFO: `/v3/projects/32c8c247d23e4ba39994f7ecb934abda` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:01.464352 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a8e0d-6cef-40f5-bcd0-ba7c0185ee3e None admin] RBAC: Authorizing `identity:get_project(project_id=32c8c247d23e4ba39994f7ecb934abda)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:01.465792 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a8e0d-6cef-40f5-bcd0-ba7c0185ee3e None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:01.467451 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 426/870] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:30:01 2022] GET /identity/v3/projects/32c8c247d23e4ba39994f7ecb934abda => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:30:01.473495 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9ff9b-8948-46f0-b82a-af83f64b2d06 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:01.573649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9ff9b-8948-46f0-b82a-af83f64b2d06 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:01.607626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3247f5-76c8-4ce6-9f5e-1bfb837df3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:01.608278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3247f5-76c8-4ce6-9f5e-1bfb837df3d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:01.608554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3247f5-76c8-4ce6-9f5e-1bfb837df3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:01.608817 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3247f5-76c8-4ce6-9f5e-1bfb837df3d9 None admin] PATH_INFO: `/v3/projects/32c8c247d23e4ba39994f7ecb934abda/users/971ad8bac7e441a4bc87b8c082e542e9/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:01.610705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3247f5-76c8-4ce6-9f5e-1bfb837df3d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=32c8c247d23e4ba39994f7ecb934abda, user_id=971ad8bac7e441a4bc87b8c082e542e9, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:01.612135 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3247f5-76c8-4ce6-9f5e-1bfb837df3d9 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:01.625715 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 445/871] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:30:01 2022] PUT /identity/v3/projects/32c8c247d23e4ba39994f7ecb934abda/users/971ad8bac7e441a4bc87b8c082e542e9/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:30:03.743238 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c1c07-8eaa-4e28-832c-c8cc8b71b682 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:03.743963 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c1c07-8eaa-4e28-832c-c8cc8b71b682 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:03.743963 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c1c07-8eaa-4e28-832c-c8cc8b71b682 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:03.745155 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 427/872] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:30:03.750437 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dfbd4-a47b-4f11-a9de-b3c7c92c8eec None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:03.750800 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dfbd4-a47b-4f11-a9de-b3c7c92c8eec None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:03.750990 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dfbd4-a47b-4f11-a9de-b3c7c92c8eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:03.769675 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-4e1dfbd4-a47b-4f11-a9de-b3c7c92c8eec None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:30:03.770866 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-4e1dfbd4-a47b-4f11-a9de-b3c7c92c8eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:30:03.785149 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:03.836374 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 446/873] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:30:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:30:04.100230 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c1c07-8eaa-4e28-832c-c8cc8b71b682 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:04.162120 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:04.201284 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c1c07-8eaa-4e28-832c-c8cc8b71b682 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:04.233199 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d32379-e8f0-47f7-ba57-022507db3ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:04.233808 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d32379-e8f0-47f7-ba57-022507db3ecf None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:04.234115 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d32379-e8f0-47f7-ba57-022507db3ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:04.234387 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d32379-e8f0-47f7-ba57-022507db3ecf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:04.245194 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d32379-e8f0-47f7-ba57-022507db3ecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:30:04.249975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-39d32379-e8f0-47f7-ba57-022507db3ecf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:30:04.249975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:30:04.249975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:30:04.249975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:30:04.249975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:30:04.249975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:30:04.249975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:30:04.249975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:30:04.249975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:30:04.249975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:30:04.249975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:30:04.249975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:30:04.249975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:30:04.249975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:30:04.249975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:30:04.249975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:30:04.251065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:30:04.251065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:30:04.251065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:30:04.251065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:30:04.251065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:30:04.251065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:30:04.251065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:30:04.251065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:30:04.251065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:30:04.251065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:30:04.251065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:30:04.251065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:30:04.251065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:30:04.251065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:30:04.251065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:30:04.251065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:30:04.252091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:30:04.252091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:30:04.252091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:30:04.252091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:30:04.252091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:30:04.252091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:30:04.252091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:30:04.252091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:30:04.252091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:30:04.252091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:30:04.252091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:30:04.252091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:30:04.252091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 428/874] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:30:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:30:04.257062 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dfbd4-a47b-4f11-a9de-b3c7c92c8eec None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:04.352023 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dfbd4-a47b-4f11-a9de-b3c7c92c8eec None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:04.385212 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e1582-2b0d-4560-8af2-72ea7627c074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:04.385806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e1582-2b0d-4560-8af2-72ea7627c074 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:04.386110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e1582-2b0d-4560-8af2-72ea7627c074 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:04.386376 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e1582-2b0d-4560-8af2-72ea7627c074 None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:04.387018 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e1582-2b0d-4560-8af2-72ea7627c074 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:30:04.387314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e1582-2b0d-4560-8af2-72ea7627c074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:04.388673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e1582-2b0d-4560-8af2-72ea7627c074 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:04.396244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 447/875] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:30:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:30:04.402231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d32379-e8f0-47f7-ba57-022507db3ecf None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:04.498045 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d32379-e8f0-47f7-ba57-022507db3ecf None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:04.519467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:04.530221 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4ed0f-5dbd-413e-9023-59fea010e6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:04.530830 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4ed0f-5dbd-413e-9023-59fea010e6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:04.531110 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4ed0f-5dbd-413e-9023-59fea010e6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:04.531379 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4ed0f-5dbd-413e-9023-59fea010e6e0 None admin] PATH_INFO: `/v3/users/971ad8bac7e441a4bc87b8c082e542e9` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:04.532480 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4ed0f-5dbd-413e-9023-59fea010e6e0 None admin] RBAC: Authorizing `identity:get_user(user_id=971ad8bac7e441a4bc87b8c082e542e9)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:04.533919 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4ed0f-5dbd-413e-9023-59fea010e6e0 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:04.535453 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 429/876] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:30:04 2022] GET /identity/v3/users/971ad8bac7e441a4bc87b8c082e542e9 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:30:04.541823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e1582-2b0d-4560-8af2-72ea7627c074 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:04.557335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:04.637692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e1582-2b0d-4560-8af2-72ea7627c074 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:04.669860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f8664-faee-4a10-bfc3-f2c0771b5490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:04.670467 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f8664-faee-4a10-bfc3-f2c0771b5490 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:04.670747 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f8664-faee-4a10-bfc3-f2c0771b5490 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:04.671017 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f8664-faee-4a10-bfc3-f2c0771b5490 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:04.735928 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f8664-faee-4a10-bfc3-f2c0771b5490 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:04.737363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f8664-faee-4a10-bfc3-f2c0771b5490 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:04.750101 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:04.830716 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 448/877] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:30:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 14:30:04.836630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4ed0f-5dbd-413e-9023-59fea010e6e0 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:04.932755 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4ed0f-5dbd-413e-9023-59fea010e6e0 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:04.964515 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a4185-66f3-4b6c-9e51-bd168c3ad915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:04.965121 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a4185-66f3-4b6c-9e51-bd168c3ad915 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:04.965399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a4185-66f3-4b6c-9e51-bd168c3ad915 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:04.965670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a4185-66f3-4b6c-9e51-bd168c3ad915 None admin] PATH_INFO: `/v3/projects/32c8c247d23e4ba39994f7ecb934abda` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:04.966789 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a4185-66f3-4b6c-9e51-bd168c3ad915 None admin] RBAC: Authorizing `identity:get_project(project_id=32c8c247d23e4ba39994f7ecb934abda)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:04.968203 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a4185-66f3-4b6c-9e51-bd168c3ad915 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:04.969773 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 430/878] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:30:04 2022] GET /identity/v3/projects/32c8c247d23e4ba39994f7ecb934abda => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:30:04.975712 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f8664-faee-4a10-bfc3-f2c0771b5490 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:05.069755 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f8664-faee-4a10-bfc3-f2c0771b5490 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:05.082104 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:05.104209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554a9b-2c21-4dbf-a8ae-6e7588abcceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:05.104812 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554a9b-2c21-4dbf-a8ae-6e7588abcceb None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:05.105095 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554a9b-2c21-4dbf-a8ae-6e7588abcceb None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:05.105366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554a9b-2c21-4dbf-a8ae-6e7588abcceb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:05.106107 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d554a9b-2c21-4dbf-a8ae-6e7588abcceb None admin] RBAC: Adding query filter params (role.id=fe3ee5741c6143adb5459b5de54450c8, scope.project.id=32c8c247d23e4ba39994f7ecb934abda, user.id=971ad8bac7e441a4bc87b8c082e542e9) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:30:05.106414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d554a9b-2c21-4dbf-a8ae-6e7588abcceb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:05.107844 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d554a9b-2c21-4dbf-a8ae-6e7588abcceb None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:05.113405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 449/879] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:30:04 2022] GET /identity/v3/role_assignments?user.id=971ad8bac7e441a4bc87b8c082e542e9&scope.project.id=32c8c247d23e4ba39994f7ecb934abda&role.id=fe3ee5741c6143adb5459b5de54450c8 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:30:07.241893 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1d45e-b280-4096-be1e-a50510a8c675 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:07.242401 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1d45e-b280-4096-be1e-a50510a8c675 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:07.242494 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1d45e-b280-4096-be1e-a50510a8c675 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:07.244033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 431/880] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:30:07.249299 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be5227-0e59-4606-b36d-e759ecc99294 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:07.249711 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be5227-0e59-4606-b36d-e759ecc99294 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:07.249861 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be5227-0e59-4606-b36d-e759ecc99294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:07.268430 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-34be5227-0e59-4606-b36d-e759ecc99294 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:30:07.269595 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-34be5227-0e59-4606-b36d-e759ecc99294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:30:07.337483 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 450/881] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:30:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 14:30:07.608474 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1d45e-b280-4096-be1e-a50510a8c675 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:07.668926 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:07.710397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1d45e-b280-4096-be1e-a50510a8c675 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:07.743065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd906d2-12b4-4405-bd3c-65bb4053e520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:07.744240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd906d2-12b4-4405-bd3c-65bb4053e520 None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:07.744525 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd906d2-12b4-4405-bd3c-65bb4053e520 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:07.744800 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd906d2-12b4-4405-bd3c-65bb4053e520 None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:07.745464 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd906d2-12b4-4405-bd3c-65bb4053e520 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:07.746854 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd906d2-12b4-4405-bd3c-65bb4053e520 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:07.762228 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 432/882] 10.222.0.17 () {60 vars in 1138 bytes} [Thu Oct 20 14:30:07 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:30:09.952471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28256f50-bff9-4c03-abef-92faa44eb4eb None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:09.953053 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28256f50-bff9-4c03-abef-92faa44eb4eb None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:09.953053 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28256f50-bff9-4c03-abef-92faa44eb4eb None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:09.954396 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 451/883] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:30:09.959802 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040b42c-5006-4d1c-901a-9805dd4615ee None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:09.960243 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040b42c-5006-4d1c-901a-9805dd4615ee None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:09.960349 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040b42c-5006-4d1c-901a-9805dd4615ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:09.979279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-c040b42c-5006-4d1c-901a-9805dd4615ee None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:30:09.980434 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-c040b42c-5006-4d1c-901a-9805dd4615ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:30:10.043481 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 433/884] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:30:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:30:10.316234 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28256f50-bff9-4c03-abef-92faa44eb4eb None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:10.415182 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28256f50-bff9-4c03-abef-92faa44eb4eb None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:10.422806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:10.450910 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad4430-0c98-48d6-a0fc-7fc80bb2d676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:10.451536 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad4430-0c98-48d6-a0fc-7fc80bb2d676 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:10.451810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad4430-0c98-48d6-a0fc-7fc80bb2d676 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:10.452077 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad4430-0c98-48d6-a0fc-7fc80bb2d676 None admin] PATH_INFO: `/v3/domains/fe43a887342a4b2e931819e73b487cbe` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:10.462784 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad4430-0c98-48d6-a0fc-7fc80bb2d676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fe43a887342a4b2e931819e73b487cbe)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:10.464245 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad4430-0c98-48d6-a0fc-7fc80bb2d676 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:10.465876 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 452/885] 10.222.0.17 () {56 vars in 1183 bytes} [Thu Oct 20 14:30:10 2022] GET /identity/v3/domains/fe43a887342a4b2e931819e73b487cbe => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:30:10.471705 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040b42c-5006-4d1c-901a-9805dd4615ee None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:10.526643 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:10.578954 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040b42c-5006-4d1c-901a-9805dd4615ee None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:10.612366 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb74e06-0df4-497e-a2ed-712dfcc7eb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:10.612967 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb74e06-0df4-497e-a2ed-712dfcc7eb43 None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:10.613240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb74e06-0df4-497e-a2ed-712dfcc7eb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:10.613507 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb74e06-0df4-497e-a2ed-712dfcc7eb43 None admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:10.614195 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb74e06-0df4-497e-a2ed-712dfcc7eb43 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:10.615615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb74e06-0df4-497e-a2ed-712dfcc7eb43 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:10.657873 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 434/886] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Oct 20 14:30:10 2022] POST /identity/v3/projects => generated 361 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:30:12.792340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee9ab5-b5b0-4ab1-a288-240d357e0864 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:12.792340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee9ab5-b5b0-4ab1-a288-240d357e0864 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:12.792340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee9ab5-b5b0-4ab1-a288-240d357e0864 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:12.792340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 453/887] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:30:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:30:12.797643 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89a208-0e73-4d52-a0b0-7557395323e6 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:12.798052 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89a208-0e73-4d52-a0b0-7557395323e6 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:12.798226 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89a208-0e73-4d52-a0b0-7557395323e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:12.817532 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-5b89a208-0e73-4d52-a0b0-7557395323e6 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:30:12.818748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-5b89a208-0e73-4d52-a0b0-7557395323e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:30:12.884265 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 435/888] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:30:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:30:13.154655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee9ab5-b5b0-4ab1-a288-240d357e0864 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:13.255667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee9ab5-b5b0-4ab1-a288-240d357e0864 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:13.287820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2988d-2dcf-446d-83bc-51df442e3e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:13.288433 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2988d-2dcf-446d-83bc-51df442e3e2a None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:13.288707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2988d-2dcf-446d-83bc-51df442e3e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:13.288972 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2988d-2dcf-446d-83bc-51df442e3e2a None admin] PATH_INFO: `/v3/domains/fe43a887342a4b2e931819e73b487cbe` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:13.290173 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2988d-2dcf-446d-83bc-51df442e3e2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=fe43a887342a4b2e931819e73b487cbe)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:13.291608 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2988d-2dcf-446d-83bc-51df442e3e2a None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:13.293135 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 454/889] 10.222.0.17 () {56 vars in 1183 bytes} [Thu Oct 20 14:30:13 2022] GET /identity/v3/domains/fe43a887342a4b2e931819e73b487cbe => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:30:13.298909 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89a208-0e73-4d52-a0b0-7557395323e6 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:13.328905 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:13.395452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89a208-0e73-4d52-a0b0-7557395323e6 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:13.428059 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867966a3-7460-4f4b-bb96-4383b48cc09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:13.428601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867966a3-7460-4f4b-bb96-4383b48cc09d None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:13.428878 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867966a3-7460-4f4b-bb96-4383b48cc09d None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:13.429147 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867966a3-7460-4f4b-bb96-4383b48cc09d None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:13.429789 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867966a3-7460-4f4b-bb96-4383b48cc09d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:13.431981 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867966a3-7460-4f4b-bb96-4383b48cc09d None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:13.451952 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 436/890] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Oct 20 14:30:13 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:30:15.611852 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf5025-52e1-49b0-ae30-e65f4a975854 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:15.612358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf5025-52e1-49b0-ae30-e65f4a975854 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:15.612470 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf5025-52e1-49b0-ae30-e65f4a975854 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:15.613708 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 455/891] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:30:15.619777 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c875d-4b74-48af-aa00-549ea275460b None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:15.620200 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c875d-4b74-48af-aa00-549ea275460b None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:15.620324 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c875d-4b74-48af-aa00-549ea275460b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:15.638301 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-184c875d-4b74-48af-aa00-549ea275460b None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:30:15.639511 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-184c875d-4b74-48af-aa00-549ea275460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:30:15.703654 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 437/892] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:30:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:30:15.974092 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf5025-52e1-49b0-ae30-e65f4a975854 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:16.008115 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:16.073194 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf5025-52e1-49b0-ae30-e65f4a975854 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:16.106580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd112fea-5644-4923-884e-d18a6b256195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:16.107208 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd112fea-5644-4923-884e-d18a6b256195 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:16.107492 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd112fea-5644-4923-884e-d18a6b256195 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:16.107756 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd112fea-5644-4923-884e-d18a6b256195 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:16.117709 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd112fea-5644-4923-884e-d18a6b256195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:30:16.122469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-dd112fea-5644-4923-884e-d18a6b256195 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:30:16.122469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:30:16.122469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:30:16.122469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:30:16.122469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:30:16.122469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:30:16.122469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:30:16.122469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:30:16.122469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:30:16.122469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:30:16.122469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:30:16.122469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:30:16.122469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:30:16.122469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:30:16.122469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:30:16.122469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:30:16.123432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:30:16.123432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:30:16.123432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:30:16.123432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:30:16.123432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:30:16.123432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:30:16.123432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:30:16.123432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:30:16.123432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:30:16.123432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:30:16.123432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:30:16.123432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:30:16.123432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:30:16.123432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:30:16.123432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:30:16.123432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:30:16.124316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:30:16.124316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:30:16.124316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:30:16.124316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:30:16.124316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:30:16.124316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:30:16.124316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:30:16.124316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:30:16.124316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:30:16.124316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:30:16.124316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:30:16.124316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:30:16.124316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 456/893] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:30:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:30:16.129624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c875d-4b74-48af-aa00-549ea275460b None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:16.147116 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:16.227926 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c875d-4b74-48af-aa00-549ea275460b None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:16.259657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a61fe9-bd43-4b4b-8c88-e1d7c4262a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:16.260249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a61fe9-bd43-4b4b-8c88-e1d7c4262a3f None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:16.260525 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a61fe9-bd43-4b4b-8c88-e1d7c4262a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:16.260793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a61fe9-bd43-4b4b-8c88-e1d7c4262a3f None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:16.261447 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a61fe9-bd43-4b4b-8c88-e1d7c4262a3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:30:16.261743 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a61fe9-bd43-4b4b-8c88-e1d7c4262a3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:16.263125 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a61fe9-bd43-4b4b-8c88-e1d7c4262a3f None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:16.270933 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 438/894] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:30:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:30:16.277243 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd112fea-5644-4923-884e-d18a6b256195 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:16.368832 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:16.376002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd112fea-5644-4923-884e-d18a6b256195 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:16.409333 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c3af0-d268-42e6-ad71-887fc22a8aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:16.409981 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c3af0-d268-42e6-ad71-887fc22a8aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:16.410264 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c3af0-d268-42e6-ad71-887fc22a8aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:16.410537 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c3af0-d268-42e6-ad71-887fc22a8aa5 None admin] PATH_INFO: `/v3/users/dc7f49dc6e794124958624ac64c6962c` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:16.423093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c3af0-d268-42e6-ad71-887fc22a8aa5 None admin] RBAC: Authorizing `identity:get_user(user_id=dc7f49dc6e794124958624ac64c6962c)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:16.424550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c3af0-d268-42e6-ad71-887fc22a8aa5 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:16.426459 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 457/895] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:30:16 2022] GET /identity/v3/users/dc7f49dc6e794124958624ac64c6962c => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:30:16.432415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a61fe9-bd43-4b4b-8c88-e1d7c4262a3f None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:16.511227 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:16.529515 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a61fe9-bd43-4b4b-8c88-e1d7c4262a3f None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:16.562268 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f63ec7-b7a6-47d4-a980-d5660f90c018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:16.562878 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f63ec7-b7a6-47d4-a980-d5660f90c018 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:16.563149 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f63ec7-b7a6-47d4-a980-d5660f90c018 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:16.563416 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f63ec7-b7a6-47d4-a980-d5660f90c018 None admin] PATH_INFO: `/v3/projects/408c10fa99cd400cb1c64c1f76e97e05` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:16.564502 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f63ec7-b7a6-47d4-a980-d5660f90c018 None admin] RBAC: Authorizing `identity:get_project(project_id=408c10fa99cd400cb1c64c1f76e97e05)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:16.565943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f63ec7-b7a6-47d4-a980-d5660f90c018 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:16.567519 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 439/896] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:30:16 2022] GET /identity/v3/projects/408c10fa99cd400cb1c64c1f76e97e05 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:30:16.573426 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c3af0-d268-42e6-ad71-887fc22a8aa5 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:16.671569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c3af0-d268-42e6-ad71-887fc22a8aa5 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:16.704551 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c6969-efd6-4f8d-a52a-8e1639dee13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:16.705191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c6969-efd6-4f8d-a52a-8e1639dee13c None admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:16.705465 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c6969-efd6-4f8d-a52a-8e1639dee13c None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:16.705732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c6969-efd6-4f8d-a52a-8e1639dee13c None admin] PATH_INFO: `/v3/projects/408c10fa99cd400cb1c64c1f76e97e05/users/dc7f49dc6e794124958624ac64c6962c/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:16.707602 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c6969-efd6-4f8d-a52a-8e1639dee13c None admin] RBAC: Authorizing `identity:create_grant(project_id=408c10fa99cd400cb1c64c1f76e97e05, user_id=dc7f49dc6e794124958624ac64c6962c, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:16.709025 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c6969-efd6-4f8d-a52a-8e1639dee13c None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:16.722611 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 458/897] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:30:16 2022] PUT /identity/v3/projects/408c10fa99cd400cb1c64c1f76e97e05/users/dc7f49dc6e794124958624ac64c6962c/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:30:18.809468 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cb1da-f06d-4df4-a223-7be2ccc85f0b None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:18.810034 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cb1da-f06d-4df4-a223-7be2ccc85f0b None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:18.810034 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cb1da-f06d-4df4-a223-7be2ccc85f0b None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:18.811373 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 440/898] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:30:18.816503 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2677c24-a44c-420a-ba15-1967f691068c None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:18.816890 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2677c24-a44c-420a-ba15-1967f691068c None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:18.817037 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2677c24-a44c-420a-ba15-1967f691068c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:18.834613 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-f2677c24-a44c-420a-ba15-1967f691068c None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:30:18.835773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-f2677c24-a44c-420a-ba15-1967f691068c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:30:18.843066 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:18.900594 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 459/899] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:30:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:30:19.168374 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cb1da-f06d-4df4-a223-7be2ccc85f0b None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:19.268090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cb1da-f06d-4df4-a223-7be2ccc85f0b None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:19.299803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b02ce-e02e-420a-9a3a-fe14efa80919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:19.300673 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b02ce-e02e-420a-9a3a-fe14efa80919 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:19.300955 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b02ce-e02e-420a-9a3a-fe14efa80919 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:19.301228 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b02ce-e02e-420a-9a3a-fe14efa80919 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:19.311814 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b02ce-e02e-420a-9a3a-fe14efa80919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:30:19.316595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-977b02ce-e02e-420a-9a3a-fe14efa80919 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:30:19.316595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:30:19.316595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:30:19.316595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:30:19.316595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:30:19.316595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:30:19.316595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:30:19.316595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:30:19.316595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:30:19.316595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:30:19.316595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:30:19.316595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:30:19.316595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:30:19.316595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:30:19.316595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:30:19.316595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:30:19.317669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:30:19.317669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:30:19.317669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:30:19.317669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:30:19.317669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:30:19.317669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:30:19.317669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:30:19.317669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:30:19.317669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:30:19.317669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:30:19.317669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:30:19.317669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:30:19.317669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:30:19.317669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:30:19.317669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:30:19.317669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:30:19.318576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:30:19.318576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:30:19.318576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:30:19.318576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:30:19.318576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:30:19.318576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:30:19.318576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:30:19.318576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:30:19.318576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:30:19.318576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:30:19.318576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:30:19.318576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:30:19.318576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 441/900] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:30:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:30:19.324793 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2677c24-a44c-420a-ba15-1967f691068c None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:19.422580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2677c24-a44c-420a-ba15-1967f691068c None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:19.455563 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d7cb8-5f4e-43bc-838d-b685766c6125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:19.456160 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d7cb8-5f4e-43bc-838d-b685766c6125 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:19.456440 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d7cb8-5f4e-43bc-838d-b685766c6125 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:19.456711 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d7cb8-5f4e-43bc-838d-b685766c6125 None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:19.457367 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d7cb8-5f4e-43bc-838d-b685766c6125 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:30:19.457668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d7cb8-5f4e-43bc-838d-b685766c6125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:19.459067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d7cb8-5f4e-43bc-838d-b685766c6125 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:19.467175 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 460/901] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:30:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:30:19.473064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b02ce-e02e-420a-9a3a-fe14efa80919 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:19.484488 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:19.572771 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b02ce-e02e-420a-9a3a-fe14efa80919 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:19.605999 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c810ed5-5025-4f72-90b3-fe74bc6972ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:19.606620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c810ed5-5025-4f72-90b3-fe74bc6972ec None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:19.606897 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c810ed5-5025-4f72-90b3-fe74bc6972ec None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:19.607163 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c810ed5-5025-4f72-90b3-fe74bc6972ec None admin] PATH_INFO: `/v3/users/dc7f49dc6e794124958624ac64c6962c` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:19.608269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c810ed5-5025-4f72-90b3-fe74bc6972ec None admin] RBAC: Authorizing `identity:get_user(user_id=dc7f49dc6e794124958624ac64c6962c)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:19.609689 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c810ed5-5025-4f72-90b3-fe74bc6972ec None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:19.611272 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 442/902] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Oct 20 14:30:19 2022] GET /identity/v3/users/dc7f49dc6e794124958624ac64c6962c => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:30:19.617091 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d7cb8-5f4e-43bc-838d-b685766c6125 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:19.622054 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:19.718331 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d7cb8-5f4e-43bc-838d-b685766c6125 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:19.750744 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4b19a-6a9a-44aa-ba15-d1ff3899a42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:19.751350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4b19a-6a9a-44aa-ba15-d1ff3899a42f None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:19.751631 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4b19a-6a9a-44aa-ba15-d1ff3899a42f None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:19.751902 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4b19a-6a9a-44aa-ba15-d1ff3899a42f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:19.815898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4b19a-6a9a-44aa-ba15-d1ff3899a42f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:19.817357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4b19a-6a9a-44aa-ba15-d1ff3899a42f None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:19.819919 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:19.911690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 461/903] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:30:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 14:30:19.918230 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c810ed5-5025-4f72-90b3-fe74bc6972ec None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:19.993011 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:20.014895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c810ed5-5025-4f72-90b3-fe74bc6972ec None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:20.047961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051fc67-ff90-404f-90fb-4924b3122a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:20.048577 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051fc67-ff90-404f-90fb-4924b3122a65 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:20.048861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051fc67-ff90-404f-90fb-4924b3122a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:20.049136 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051fc67-ff90-404f-90fb-4924b3122a65 None admin] PATH_INFO: `/v3/projects/408c10fa99cd400cb1c64c1f76e97e05` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:20.050269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051fc67-ff90-404f-90fb-4924b3122a65 None admin] RBAC: Authorizing `identity:get_project(project_id=408c10fa99cd400cb1c64c1f76e97e05)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:20.051953 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051fc67-ff90-404f-90fb-4924b3122a65 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:20.053550 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 443/904] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Oct 20 14:30:19 2022] GET /identity/v3/projects/408c10fa99cd400cb1c64c1f76e97e05 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:30:20.059751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4b19a-6a9a-44aa-ba15-d1ff3899a42f None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:30:20.156634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4b19a-6a9a-44aa-ba15-d1ff3899a42f None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:30:20.158942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:20.191651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bd887-4d20-4388-b7cc-2da762dedb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:30:20.192253 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bd887-4d20-4388-b7cc-2da762dedb77 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:30:20.192533 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bd887-4d20-4388-b7cc-2da762dedb77 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:30:20.192805 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bd887-4d20-4388-b7cc-2da762dedb77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:30:20.193515 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bd887-4d20-4388-b7cc-2da762dedb77 None admin] RBAC: Adding query filter params (role.id=fe3ee5741c6143adb5459b5de54450c8, scope.project.id=408c10fa99cd400cb1c64c1f76e97e05, user.id=dc7f49dc6e794124958624ac64c6962c) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:30:20.193819 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bd887-4d20-4388-b7cc-2da762dedb77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:30:20.196562 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bd887-4d20-4388-b7cc-2da762dedb77 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:30:20.201800 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 462/905] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:30:20 2022] GET /identity/v3/role_assignments?user.id=dc7f49dc6e794124958624ac64c6962c&scope.project.id=408c10fa99cd400cb1c64c1f76e97e05&role.id=fe3ee5741c6143adb5459b5de54450c8 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:30:30.043846 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=28 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:30:30.199397 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=16 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:16.055696 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dc42e-6e07-43ef-ad2f-f6a98fc0cafe None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:16.056300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dc42e-6e07-43ef-ad2f-f6a98fc0cafe None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:16.056401 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dc42e-6e07-43ef-ad2f-f6a98fc0cafe None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:16.058611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 444/906] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:31:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:31:16.065392 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0893b-eabb-429d-95bf-584279348a09 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:16.066728 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0893b-eabb-429d-95bf-584279348a09 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:16.066728 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0893b-eabb-429d-95bf-584279348a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:16.091204 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-73b0893b-eabb-429d-95bf-584279348a09 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:31:16.092402 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-73b0893b-eabb-429d-95bf-584279348a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:31:16.177376 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 463/907] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:31:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:31:16.480663 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6dc42e-6e07-43ef-ad2f-f6a98fc0cafe None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:16.612280 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6dc42e-6e07-43ef-ad2f-f6a98fc0cafe None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:16.651448 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26022f-a2b8-4319-9a4c-8e6fb919adb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:16.652004 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26022f-a2b8-4319-9a4c-8e6fb919adb4 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:16.652255 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26022f-a2b8-4319-9a4c-8e6fb919adb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:16.652524 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26022f-a2b8-4319-9a4c-8e6fb919adb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:16.663862 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26022f-a2b8-4319-9a4c-8e6fb919adb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:16.665298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26022f-a2b8-4319-9a4c-8e6fb919adb4 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:16.680261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-4d26022f-a2b8-4319-9a4c-8e6fb919adb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:31:16.680261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:16.680261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:16.680261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:16.680261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:16.680261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:16.680261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:16.680261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:16.680261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:16.680261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:16.680261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:16.680261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:16.680261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:31:16.680261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:31:16.680261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:31:16.680261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:31:16.681490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:16.681490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:16.681490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:16.681490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:16.681490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:16.681490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:16.681490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:16.681490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:16.681490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:16.681490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:16.681490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:16.681490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:16.681490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:16.681490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:16.681490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:16.681490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:16.681490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:31:16.682539 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:31:16.682539 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:31:16.682539 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:31:16.682539 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 445/908] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:16.687599 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0893b-eabb-429d-95bf-584279348a09 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:16.814340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0893b-eabb-429d-95bf-584279348a09 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:16.857066 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:16.869180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0a668-20b8-434d-a1c2-eeec50a5aefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:16.869810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0a668-20b8-434d-a1c2-eeec50a5aefa None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:16.870112 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0a668-20b8-434d-a1c2-eeec50a5aefa None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:16.870382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0a668-20b8-434d-a1c2-eeec50a5aefa None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:16.871156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0a668-20b8-434d-a1c2-eeec50a5aefa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:16.871441 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0a668-20b8-434d-a1c2-eeec50a5aefa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:16.872933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0a668-20b8-434d-a1c2-eeec50a5aefa None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:16.895128 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 464/909] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:16.896626 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26022f-a2b8-4319-9a4c-8e6fb919adb4 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:16.976186 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:17.037730 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26022f-a2b8-4319-9a4c-8e6fb919adb4 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:17.077611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a72d5-e940-4108-b822-796279b337c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:17.078312 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a72d5-e940-4108-b822-796279b337c9 None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:17.078501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a72d5-e940-4108-b822-796279b337c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:17.078715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a72d5-e940-4108-b822-796279b337c9 None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:17.079388 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a72d5-e940-4108-b822-796279b337c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:17.080835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a72d5-e940-4108-b822-796279b337c9 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:17.110492 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 446/910] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Oct 20 14:31:16 2022] POST /identity/v3/users => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:31:19.731028 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7898d04-05e4-4a4b-bdb3-6083bfd83864 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:19.731576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7898d04-05e4-4a4b-bdb3-6083bfd83864 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:19.731576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7898d04-05e4-4a4b-bdb3-6083bfd83864 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:19.732924 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 465/911] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:31:19.739206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddfae3-b2aa-4b8d-9df3-d3eedb57f3d1 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:19.741047 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddfae3-b2aa-4b8d-9df3-d3eedb57f3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:19.741047 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddfae3-b2aa-4b8d-9df3-d3eedb57f3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:19.761176 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-f5ddfae3-b2aa-4b8d-9df3-d3eedb57f3d1 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:31:19.762528 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-f5ddfae3-b2aa-4b8d-9df3-d3eedb57f3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:31:19.842848 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 447/912] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:31:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:31:20.152129 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7898d04-05e4-4a4b-bdb3-6083bfd83864 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:20.279390 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7898d04-05e4-4a4b-bdb3-6083bfd83864 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:20.323101 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4adc2e-a08a-4107-9860-0de5c55f16fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:20.325338 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4adc2e-a08a-4107-9860-0de5c55f16fc None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:20.325338 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4adc2e-a08a-4107-9860-0de5c55f16fc None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:20.325338 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4adc2e-a08a-4107-9860-0de5c55f16fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:20.337152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4adc2e-a08a-4107-9860-0de5c55f16fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:31:20.342011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-7c4adc2e-a08a-4107-9860-0de5c55f16fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:31:20.342011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:20.342011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:20.342011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:20.342011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:20.342011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:20.342011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:20.342011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:20.342011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:20.342011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:20.342011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:20.342011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:20.342011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:31:20.342011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:31:20.342011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:31:20.342011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:31:20.342988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:31:20.342988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:31:20.342988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:31:20.342988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:31:20.342988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:20.342988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:20.342988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:20.342988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:20.342988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:20.342988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:20.342988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:20.342988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:20.342988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:20.342988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:20.342988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:20.342988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:20.343806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:20.343806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:20.343806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:20.343806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:20.343806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:31:20.343806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:31:20.343806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:31:20.343806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:31:20.343806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:31:20.343806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:31:20.343806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:31:20.343806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:31:20.343806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 466/913] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Oct 20 14:31:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:20.351297 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ddfae3-b2aa-4b8d-9df3-d3eedb57f3d1 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:20.395031 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:20.470739 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ddfae3-b2aa-4b8d-9df3-d3eedb57f3d1 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:20.509989 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37515e4c-2d7a-435d-bf30-2caacea8e870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:20.510656 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37515e4c-2d7a-435d-bf30-2caacea8e870 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:20.510933 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37515e4c-2d7a-435d-bf30-2caacea8e870 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:20.511197 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37515e4c-2d7a-435d-bf30-2caacea8e870 None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:20.511918 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37515e4c-2d7a-435d-bf30-2caacea8e870 None admin] RBAC: Adding query filter params (name=service) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:20.512216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37515e4c-2d7a-435d-bf30-2caacea8e870 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:20.513666 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37515e4c-2d7a-435d-bf30-2caacea8e870 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:20.527191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 448/914] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Oct 20 14:31:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:20.528415 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4adc2e-a08a-4107-9860-0de5c55f16fc None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:20.591922 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:20.651002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4adc2e-a08a-4107-9860-0de5c55f16fc None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:20.692123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b09c6a-5097-40bc-8b8d-b5b8a9cc3447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:20.693273 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b09c6a-5097-40bc-8b8d-b5b8a9cc3447 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:20.695277 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b09c6a-5097-40bc-8b8d-b5b8a9cc3447 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:20.695277 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b09c6a-5097-40bc-8b8d-b5b8a9cc3447 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:20.707059 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b09c6a-5097-40bc-8b8d-b5b8a9cc3447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:20.708949 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b09c6a-5097-40bc-8b8d-b5b8a9cc3447 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:20.728011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-b0b09c6a-5097-40bc-8b8d-b5b8a9cc3447 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:31:20.728011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:20.728011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:20.728011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:20.728011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:20.728011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:20.728011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:20.728011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:20.728011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:20.728011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:20.728011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:20.728011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:20.728011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:31:20.728011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:31:20.728011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:31:20.728011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:31:20.728998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:20.728998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:20.728998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:20.728998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:20.728998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:20.728998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:20.728998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:20.728998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:20.728998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:20.728998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:20.728998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:20.728998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:20.728998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:20.728998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:20.728998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:20.728998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:20.728998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:31:20.729946 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:31:20.729946 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:31:20.729946 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:31:20.733717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 467/915] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:20.735419 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37515e4c-2d7a-435d-bf30-2caacea8e870 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:20.848233 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:20.851725 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37515e4c-2d7a-435d-bf30-2caacea8e870 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:20.895201 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4de3ce-ef5e-4789-8fb0-ecaa7fce7329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:20.895834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4de3ce-ef5e-4789-8fb0-ecaa7fce7329 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:20.896151 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4de3ce-ef5e-4789-8fb0-ecaa7fce7329 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:20.896441 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4de3ce-ef5e-4789-8fb0-ecaa7fce7329 None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:20.897744 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4de3ce-ef5e-4789-8fb0-ecaa7fce7329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:20.898201 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4de3ce-ef5e-4789-8fb0-ecaa7fce7329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:20.900114 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4de3ce-ef5e-4789-8fb0-ecaa7fce7329 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:20.918233 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 449/916] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:20.919535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b09c6a-5097-40bc-8b8d-b5b8a9cc3447 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:21.033978 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b09c6a-5097-40bc-8b8d-b5b8a9cc3447 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:21.035840 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:21.073670 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d4ac8-f70e-4b13-a56c-679e168fe6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:21.074396 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d4ac8-f70e-4b13-a56c-679e168fe6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:21.074635 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d4ac8-f70e-4b13-a56c-679e168fe6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:21.074891 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d4ac8-f70e-4b13-a56c-679e168fe6d7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:21.083647 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d4ac8-f70e-4b13-a56c-679e168fe6d7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:21.085484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d4ac8-f70e-4b13-a56c-679e168fe6d7 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:21.100340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-6c2d4ac8-f70e-4b13-a56c-679e168fe6d7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 20 14:31:21.100340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:21.100340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:21.100340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:21.100340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:21.100340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:21.100340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:21.100340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:21.100340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:21.100340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:21.100340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:21.100340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:21.100340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:31:21.100340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:31:21.100340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:31:21.100340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:31:21.101478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:21.101478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:21.101478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:31:21.101478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:31:21.101478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:31:21.101478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:31:21.101478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:21.101478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:21.101478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:21.101478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:21.101478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:21.101478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:21.101478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:21.101478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:21.101478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:21.101478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:21.101478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:21.101478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:21.102502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:21.102502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:21.102502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:31:21.102502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:31:21.102502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:31:21.102502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:31:21.102502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:31:21.102502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:31:21.102502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 20 14:31:21.102502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:31:21.104040 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 468/917] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:31:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:21.110461 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4de3ce-ef5e-4789-8fb0-ecaa7fce7329 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:21.233994 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4de3ce-ef5e-4789-8fb0-ecaa7fce7329 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:21.274140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936162cd-cb82-46ca-8e38-46ec4c7ce0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:21.274870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936162cd-cb82-46ca-8e38-46ec4c7ce0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:21.275180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936162cd-cb82-46ca-8e38-46ec4c7ce0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:21.275453 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936162cd-cb82-46ca-8e38-46ec4c7ce0e5 None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:21.276186 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936162cd-cb82-46ca-8e38-46ec4c7ce0e5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:21.276488 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936162cd-cb82-46ca-8e38-46ec4c7ce0e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:21.277939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936162cd-cb82-46ca-8e38-46ec4c7ce0e5 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:21.302491 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 450/918] 10.222.0.17 () {56 vars in 1143 bytes} [Thu Oct 20 14:31:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:31:21.304457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d4ac8-f70e-4b13-a56c-679e168fe6d7 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:21.419333 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d4ac8-f70e-4b13-a56c-679e168fe6d7 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:21.464893 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a10d7-079b-4527-b596-7cef1a3e6d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:21.465535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a10d7-079b-4527-b596-7cef1a3e6d95 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:21.465892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a10d7-079b-4527-b596-7cef1a3e6d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:21.466175 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a10d7-079b-4527-b596-7cef1a3e6d95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:21.479638 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a10d7-079b-4527-b596-7cef1a3e6d95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:21.481453 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a10d7-079b-4527-b596-7cef1a3e6d95 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:21.498734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-e26a10d7-079b-4527-b596-7cef1a3e6d95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:31:21.498734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:21.498734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:21.498734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:21.498734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:21.498734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:21.498734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:21.498734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:21.498734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:21.498734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:21.498734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:21.498734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:21.498734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:31:21.498734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:31:21.498734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:31:21.498734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:31:21.500151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:21.500151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:21.500151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:21.500151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:21.500151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:21.500151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:21.500151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:21.500151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:21.500151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:21.500151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:21.500151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:21.500151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:21.500151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:21.500151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:21.500151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:21.500151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:21.500151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:31:21.501248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:31:21.501248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:31:21.501248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:31:21.501644 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 469/919] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:21.508299 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936162cd-cb82-46ca-8e38-46ec4c7ce0e5 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:21.530561 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:21.627035 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936162cd-cb82-46ca-8e38-46ec4c7ce0e5 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:21.677568 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28384b81-4899-431b-8bf1-50c3c729f331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:21.678229 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28384b81-4899-431b-8bf1-50c3c729f331 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:21.678504 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28384b81-4899-431b-8bf1-50c3c729f331 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:21.678771 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28384b81-4899-431b-8bf1-50c3c729f331 None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:21.679428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28384b81-4899-431b-8bf1-50c3c729f331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:21.679726 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28384b81-4899-431b-8bf1-50c3c729f331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:21.681126 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28384b81-4899-431b-8bf1-50c3c729f331 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:21.694822 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 451/920] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:21.701142 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a10d7-079b-4527-b596-7cef1a3e6d95 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:21.720767 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:21.820425 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a10d7-079b-4527-b596-7cef1a3e6d95 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:21.860224 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc1643-f925-4850-ab12-c0e719bc821a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:21.861087 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc1643-f925-4850-ab12-c0e719bc821a None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:21.861396 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc1643-f925-4850-ab12-c0e719bc821a None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:21.861838 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc1643-f925-4850-ab12-c0e719bc821a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:21.871492 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc1643-f925-4850-ab12-c0e719bc821a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:21.873267 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc1643-f925-4850-ab12-c0e719bc821a None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:21.887560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-8ecc1643-f925-4850-ab12-c0e719bc821a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:31:21.887560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:21.887560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:21.887560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:21.887560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:21.887560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:21.887560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:21.887560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:21.887560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:21.887560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:21.887560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:21.887560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:21.887560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:31:21.887560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:31:21.887560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:31:21.888626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:31:21.888626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:21.888626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:21.888626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:21.888626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:21.888626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:21.888626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:21.888626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:21.888626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:21.888626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:21.888626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:21.888626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:21.888626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:21.888626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:21.888626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:21.888626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:21.888626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:21.889521 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:31:21.889521 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:31:21.889521 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:31:21.889521 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:31:21.889521 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:31:21.889521 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:31:21.889521 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:31:21.889521 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:31:21.889521 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 470/921] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:31:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:21.895477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28384b81-4899-431b-8bf1-50c3c729f331 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:21.983215 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:22.007254 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28384b81-4899-431b-8bf1-50c3c729f331 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:22.044644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45ed5b-e8cc-4931-82de-d9f18f734b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:22.045254 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45ed5b-e8cc-4931-82de-d9f18f734b20 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:22.045537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45ed5b-e8cc-4931-82de-d9f18f734b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:22.045814 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45ed5b-e8cc-4931-82de-d9f18f734b20 None admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:22.046534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45ed5b-e8cc-4931-82de-d9f18f734b20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:22.046839 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45ed5b-e8cc-4931-82de-d9f18f734b20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:22.048645 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45ed5b-e8cc-4931-82de-d9f18f734b20 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:22.062054 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 452/922] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:31:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:22.068599 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc1643-f925-4850-ab12-c0e719bc821a None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:22.151539 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:22.182623 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc1643-f925-4850-ab12-c0e719bc821a None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:22.219203 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d10d2-d9f2-49b0-90fd-752ca8beab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:22.219932 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d10d2-d9f2-49b0-90fd-752ca8beab3f None admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:22.220177 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d10d2-d9f2-49b0-90fd-752ca8beab3f None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:22.220474 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d10d2-d9f2-49b0-90fd-752ca8beab3f None admin] PATH_INFO: `/v3/projects/88613722e7dc4950b5e47a1d92331575/users/1e94a60e43914cf38a5f2f88b182083f/roles/af10f9c70a5d4fcb999f273845290676` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:22.236304 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d10d2-d9f2-49b0-90fd-752ca8beab3f None admin] RBAC: Authorizing `identity:create_grant(project_id=88613722e7dc4950b5e47a1d92331575, user_id=1e94a60e43914cf38a5f2f88b182083f, role_id=af10f9c70a5d4fcb999f273845290676)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:22.238600 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d10d2-d9f2-49b0-90fd-752ca8beab3f None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:22.251764 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 471/923] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:31:22 2022] PUT /identity/v3/projects/88613722e7dc4950b5e47a1d92331575/users/1e94a60e43914cf38a5f2f88b182083f/roles/af10f9c70a5d4fcb999f273845290676 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:31:24.584234 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c538dc4-71d3-4353-b81a-231341e4f053 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:24.584791 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c538dc4-71d3-4353-b81a-231341e4f053 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:24.584791 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c538dc4-71d3-4353-b81a-231341e4f053 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:24.586126 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 453/924] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:31:24.591309 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63069e-cfe2-4c09-8f7e-cf819d873263 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:24.591762 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63069e-cfe2-4c09-8f7e-cf819d873263 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:24.591874 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63069e-cfe2-4c09-8f7e-cf819d873263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:24.612606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-5f63069e-cfe2-4c09-8f7e-cf819d873263 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:31:24.613812 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-5f63069e-cfe2-4c09-8f7e-cf819d873263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:31:24.695296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 472/925] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:31:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:31:24.993715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c538dc4-71d3-4353-b81a-231341e4f053 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:25.101497 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c538dc4-71d3-4353-b81a-231341e4f053 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:25.145312 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9268361-f88e-4a89-886a-668591d191ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:25.145969 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9268361-f88e-4a89-886a-668591d191ce None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:25.146241 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9268361-f88e-4a89-886a-668591d191ce None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:25.146507 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9268361-f88e-4a89-886a-668591d191ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:25.154033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:25.158264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9268361-f88e-4a89-886a-668591d191ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:31:25.164547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-b9268361-f88e-4a89-886a-668591d191ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:31:25.164547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:25.164547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:25.164547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:25.164547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:25.164547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:25.164547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:25.164547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:25.164547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:25.164547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:25.164547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:25.164547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:25.164547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:31:25.164547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:31:25.164547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:31:25.164547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:31:25.165670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:31:25.165670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:31:25.165670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:31:25.165670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:31:25.165670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:25.165670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:25.165670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:25.165670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:25.165670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:25.165670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:25.165670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:25.165670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:25.165670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:25.165670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:25.165670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:25.165670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:25.171108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:25.171108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:25.171108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:25.171108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:25.171108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:31:25.171108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:31:25.171108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:31:25.171108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:31:25.171108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:31:25.171108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:31:25.171108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 14:31:25.171108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:31:25.171108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 454/926] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Oct 20 14:31:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:25.171937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63069e-cfe2-4c09-8f7e-cf819d873263 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:25.232799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:25.283701 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63069e-cfe2-4c09-8f7e-cf819d873263 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:25.321593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf35ba-7daa-4be5-8610-9a8a4c9300ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:25.322194 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf35ba-7daa-4be5-8610-9a8a4c9300ed None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:25.322459 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf35ba-7daa-4be5-8610-9a8a4c9300ed None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:25.322729 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf35ba-7daa-4be5-8610-9a8a4c9300ed None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:25.323390 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf35ba-7daa-4be5-8610-9a8a4c9300ed None admin] RBAC: Adding query filter params (name=service) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:25.323681 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf35ba-7daa-4be5-8610-9a8a4c9300ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:25.325049 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf35ba-7daa-4be5-8610-9a8a4c9300ed None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:25.333813 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 473/927] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Oct 20 14:31:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:25.339828 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9268361-f88e-4a89-886a-668591d191ce None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:25.441319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9268361-f88e-4a89-886a-668591d191ce None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:25.477987 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d416f-632d-43a4-a827-a20b311d92aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:25.478612 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d416f-632d-43a4-a827-a20b311d92aa None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:25.478890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d416f-632d-43a4-a827-a20b311d92aa None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:25.479160 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d416f-632d-43a4-a827-a20b311d92aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:25.489588 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d416f-632d-43a4-a827-a20b311d92aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:25.491262 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d416f-632d-43a4-a827-a20b311d92aa None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:25.509734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-4f8d416f-632d-43a4-a827-a20b311d92aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:31:25.509734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:25.509734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:25.509734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:25.509734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:25.509734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:25.509734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:25.509734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:25.509734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:25.509734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:25.509734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:25.509734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:25.509734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:31:25.509734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:31:25.509734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:31:25.509734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:31:25.511040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:25.511040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:25.511040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:25.511040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:25.511040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:25.511040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:25.511040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:25.511040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:25.511040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:25.511040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:25.511040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:25.511040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:25.511040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:25.511040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:25.511040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:25.511040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:25.511040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:31:25.512286 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:31:25.512286 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:31:25.512286 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:31:25.513027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 455/928] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:25.520357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf35ba-7daa-4be5-8610-9a8a4c9300ed None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:25.629239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf35ba-7daa-4be5-8610-9a8a4c9300ed None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:25.648072 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:25.668738 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24debe16-ce9c-4c3e-badb-e5098cb81b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:25.669346 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24debe16-ce9c-4c3e-badb-e5098cb81b37 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:25.669629 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24debe16-ce9c-4c3e-badb-e5098cb81b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:25.669944 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24debe16-ce9c-4c3e-badb-e5098cb81b37 None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:25.670653 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24debe16-ce9c-4c3e-badb-e5098cb81b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:25.670959 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24debe16-ce9c-4c3e-badb-e5098cb81b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:25.672688 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24debe16-ce9c-4c3e-badb-e5098cb81b37 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:25.687426 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 474/929] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:25.694350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d416f-632d-43a4-a827-a20b311d92aa None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:25.748034 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:25.802905 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d416f-632d-43a4-a827-a20b311d92aa None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:25.838578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3e120-29c4-4474-a31d-f32fc5f313e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:25.839261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3e120-29c4-4474-a31d-f32fc5f313e5 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:25.839555 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3e120-29c4-4474-a31d-f32fc5f313e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:25.839844 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3e120-29c4-4474-a31d-f32fc5f313e5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:25.849011 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3e120-29c4-4474-a31d-f32fc5f313e5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:25.850501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3e120-29c4-4474-a31d-f32fc5f313e5 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:25.864124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-90b3e120-29c4-4474-a31d-f32fc5f313e5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 20 14:31:25.864124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:25.864124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:25.864124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:25.864124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:25.864124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:25.864124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:25.864124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:25.864124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:25.864124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:25.864124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:25.864124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:25.864124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:31:25.864124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:31:25.864124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:31:25.864124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:31:25.865344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:25.865344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:25.865344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:31:25.865344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:31:25.865344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:31:25.865344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:31:25.865344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:25.865344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:25.865344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:25.865344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:25.865344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:25.865344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:25.865344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:25.865344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:25.865344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:25.865344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:25.865344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:25.865344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:25.866756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:25.866756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:25.866756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:31:25.866756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:31:25.866756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:31:25.866756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:31:25.866756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:31:25.866756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:31:25.866756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 20 14:31:25.866756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:31:25.866756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 456/930] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:31:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:25.871520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24debe16-ce9c-4c3e-badb-e5098cb81b37 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:25.974533 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24debe16-ce9c-4c3e-badb-e5098cb81b37 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:26.009673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e554f8c-1606-472f-9d86-233e464072ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:26.010544 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e554f8c-1606-472f-9d86-233e464072ee None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:26.010853 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e554f8c-1606-472f-9d86-233e464072ee None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:26.011295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e554f8c-1606-472f-9d86-233e464072ee None admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:26.012051 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e554f8c-1606-472f-9d86-233e464072ee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:26.012363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e554f8c-1606-472f-9d86-233e464072ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:26.013809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e554f8c-1606-472f-9d86-233e464072ee None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:26.032863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 475/931] 10.222.0.17 () {56 vars in 1143 bytes} [Thu Oct 20 14:31:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:31:26.039144 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3e120-29c4-4474-a31d-f32fc5f313e5 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:26.144094 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3e120-29c4-4474-a31d-f32fc5f313e5 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:26.155653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:26.190622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7c143-eb1d-4f83-beed-3f85067fbd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:26.192612 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7c143-eb1d-4f83-beed-3f85067fbd3c None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:26.193007 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7c143-eb1d-4f83-beed-3f85067fbd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:26.193278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7c143-eb1d-4f83-beed-3f85067fbd3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:26.272758 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7c143-eb1d-4f83-beed-3f85067fbd3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:26.274223 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7c143-eb1d-4f83-beed-3f85067fbd3c None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:26.379622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 457/932] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:31:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 14:31:26.385649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e554f8c-1606-472f-9d86-233e464072ee None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:26.425919 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:26.501098 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e554f8c-1606-472f-9d86-233e464072ee None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:26.538852 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd340af2-05f8-41f9-af47-960f6c9ed80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:26.539560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd340af2-05f8-41f9-af47-960f6c9ed80f None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:26.539848 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd340af2-05f8-41f9-af47-960f6c9ed80f None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:26.540196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd340af2-05f8-41f9-af47-960f6c9ed80f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:26.552582 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd340af2-05f8-41f9-af47-960f6c9ed80f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:26.554238 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd340af2-05f8-41f9-af47-960f6c9ed80f None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:26.570692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-fd340af2-05f8-41f9-af47-960f6c9ed80f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:31:26.570692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:26.570692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:26.570692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:26.570692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:26.570692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:26.570692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:26.570692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:26.570692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:26.570692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:26.570692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:26.570692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:26.570692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:31:26.570692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:31:26.570692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:31:26.570692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:31:26.571863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:26.571863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:26.571863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:26.571863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:26.571863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:26.571863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:26.571863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:26.571863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:26.571863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:26.571863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:26.571863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:26.571863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:26.571863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:26.571863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:26.571863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:26.571863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:26.571863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:31:26.572914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:31:26.572914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:31:26.572914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:31:26.573287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 476/933] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:31:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:26.577501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7c143-eb1d-4f83-beed-3f85067fbd3c None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:26.589187 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:26.684086 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7c143-eb1d-4f83-beed-3f85067fbd3c None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:26.720129 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b1d97-4cf7-4ed7-ac00-6faefd4cc453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:26.720875 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b1d97-4cf7-4ed7-ac00-6faefd4cc453 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:26.721719 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b1d97-4cf7-4ed7-ac00-6faefd4cc453 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:26.722091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b1d97-4cf7-4ed7-ac00-6faefd4cc453 None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:26.722886 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b1d97-4cf7-4ed7-ac00-6faefd4cc453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:26.723213 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b1d97-4cf7-4ed7-ac00-6faefd4cc453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:26.724788 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b1d97-4cf7-4ed7-ac00-6faefd4cc453 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:26.736494 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 458/934] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:31:26.742306 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd340af2-05f8-41f9-af47-960f6c9ed80f None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:26.834169 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:26.848197 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd340af2-05f8-41f9-af47-960f6c9ed80f None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:26.891753 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebee19e-2165-4b97-be33-c8f38b268d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:26.892379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebee19e-2165-4b97-be33-c8f38b268d45 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:26.892671 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebee19e-2165-4b97-be33-c8f38b268d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:26.893630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebee19e-2165-4b97-be33-c8f38b268d45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:26.901027 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebee19e-2165-4b97-be33-c8f38b268d45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:26.902543 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebee19e-2165-4b97-be33-c8f38b268d45 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:26.915141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-3ebee19e-2165-4b97-be33-c8f38b268d45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:31:26.915141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:26.915141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:26.915141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:26.915141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:26.915141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:26.915141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:26.915141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:26.915141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:26.915141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:26.915141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:26.915141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:26.915141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:31:26.915141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:31:26.915141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:31:26.916399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:31:26.916399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:26.916399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:26.916399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:26.916399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:26.916399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:26.916399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:26.916399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:26.916399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:26.916399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:26.916399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:26.916399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:26.916399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:26.916399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:26.916399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:26.916399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:26.916399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:26.917489 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:31:26.917489 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:31:26.917489 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:31:26.917489 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:31:26.917489 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:31:26.917489 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:31:26.917489 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:31:26.917489 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:31:26.917489 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 477/935] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:31:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:26.922787 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b1d97-4cf7-4ed7-ac00-6faefd4cc453 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:27.002749 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:27.036030 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b1d97-4cf7-4ed7-ac00-6faefd4cc453 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:27.070367 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb3662-d1a9-4c36-a254-a627a8b74280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:27.070971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb3662-d1a9-4c36-a254-a627a8b74280 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:27.071294 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb3662-d1a9-4c36-a254-a627a8b74280 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:27.071524 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb3662-d1a9-4c36-a254-a627a8b74280 None admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:27.072225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb3662-d1a9-4c36-a254-a627a8b74280 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:27.072503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb3662-d1a9-4c36-a254-a627a8b74280 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:27.073938 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb3662-d1a9-4c36-a254-a627a8b74280 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:27.086824 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 459/936] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:31:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:27.092850 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebee19e-2165-4b97-be33-c8f38b268d45 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:27.207066 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebee19e-2165-4b97-be33-c8f38b268d45 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:27.245946 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163eebe-8bb3-4245-a743-949a106402c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:27.246551 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163eebe-8bb3-4245-a743-949a106402c1 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:27.246824 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163eebe-8bb3-4245-a743-949a106402c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:27.247093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163eebe-8bb3-4245-a743-949a106402c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:27.247805 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163eebe-8bb3-4245-a743-949a106402c1 None admin] RBAC: Adding query filter params (role.id=af10f9c70a5d4fcb999f273845290676, scope.project.id=88613722e7dc4950b5e47a1d92331575, user.id=1e94a60e43914cf38a5f2f88b182083f) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:27.248106 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163eebe-8bb3-4245-a743-949a106402c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:27.249534 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163eebe-8bb3-4245-a743-949a106402c1 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:27.256106 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 478/937] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:31:27 2022] GET /identity/v3/role_assignments?user.id=1e94a60e43914cf38a5f2f88b182083f&scope.project.id=88613722e7dc4950b5e47a1d92331575&role.id=af10f9c70a5d4fcb999f273845290676 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:29.505877 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5966e63-01c3-405a-8875-bd0bcc6d10e1 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:29.506398 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5966e63-01c3-405a-8875-bd0bcc6d10e1 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:29.506398 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5966e63-01c3-405a-8875-bd0bcc6d10e1 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:29.507826 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 460/938] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:31:29.512975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bedb38-f384-4604-b5ec-30d64d7ca607 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:29.513379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bedb38-f384-4604-b5ec-30d64d7ca607 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:29.513575 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bedb38-f384-4604-b5ec-30d64d7ca607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:29.535167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-b6bedb38-f384-4604-b5ec-30d64d7ca607 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:31:29.536472 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b6bedb38-f384-4604-b5ec-30d64d7ca607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:31:29.539520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:29.608746 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 479/939] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:31:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:31:29.873691 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5966e63-01c3-405a-8875-bd0bcc6d10e1 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:29.980721 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5966e63-01c3-405a-8875-bd0bcc6d10e1 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:30.011268 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:30.017469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc87abe-20d3-479c-8322-1c81ceb35666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:30.018344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc87abe-20d3-479c-8322-1c81ceb35666 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:30.019945 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc87abe-20d3-479c-8322-1c81ceb35666 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:30.019945 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc87abe-20d3-479c-8322-1c81ceb35666 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:30.029498 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc87abe-20d3-479c-8322-1c81ceb35666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:31:30.035173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-3fc87abe-20d3-479c-8322-1c81ceb35666 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:31:30.035173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:30.035173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:30.035173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:30.035173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:30.035173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:30.035173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:30.035173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:30.035173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:30.035173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:30.035173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:30.035173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:30.035173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:31:30.035173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:31:30.035173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:31:30.035173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:31:30.036590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:31:30.036590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:31:30.036590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:31:30.036590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:31:30.036590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:30.036590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:30.036590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:30.036590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:30.036590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:30.036590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:30.036590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:30.036590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:30.036590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:30.036590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:30.036590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:30.036590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:30.037578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:30.037578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:30.037578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:30.037578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:30.037578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:31:30.037578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:31:30.037578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:31:30.037578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:31:30.037578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:31:30.037578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:31:30.037578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:31:30.037578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:31:30.037578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 461/940] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:31:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:30.042847 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bedb38-f384-4604-b5ec-30d64d7ca607 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:30.145696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bedb38-f384-4604-b5ec-30d64d7ca607 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:30.183311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf17194-81a5-4f8c-951b-d1e78968948b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:30.183932 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf17194-81a5-4f8c-951b-d1e78968948b None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:30.184207 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf17194-81a5-4f8c-951b-d1e78968948b None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:30.184473 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf17194-81a5-4f8c-951b-d1e78968948b None admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:30.185133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf17194-81a5-4f8c-951b-d1e78968948b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:30.185431 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf17194-81a5-4f8c-951b-d1e78968948b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:30.186839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf17194-81a5-4f8c-951b-d1e78968948b None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:30.197192 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 480/941] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:31:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:30.203039 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc87abe-20d3-479c-8322-1c81ceb35666 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:30.321456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc87abe-20d3-479c-8322-1c81ceb35666 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:30.358094 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c27961-5228-458c-a2f2-66344caa6aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:30.358719 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c27961-5228-458c-a2f2-66344caa6aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:30.359062 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c27961-5228-458c-a2f2-66344caa6aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:30.359256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c27961-5228-458c-a2f2-66344caa6aa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:30.369867 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c27961-5228-458c-a2f2-66344caa6aa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:30.371622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c27961-5228-458c-a2f2-66344caa6aa3 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:30.387514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-29c27961-5228-458c-a2f2-66344caa6aa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:31:30.387514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:30.387514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:30.387514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:30.387514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:30.387514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:30.387514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:30.387514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:30.387514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:30.387514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:30.387514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:30.387514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:30.387514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:31:30.387514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:31:30.387514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:31:30.387514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:31:30.388649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:30.388649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:30.388649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:30.388649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:30.388649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:30.388649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:30.388649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:30.388649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:30.388649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:30.388649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:30.388649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:30.388649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:30.388649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:30.388649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:30.388649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:30.388649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:30.388649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:31:30.389548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:31:30.389548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:31:30.389548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:31:30.389548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 462/942] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:31:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:30.395090 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf17194-81a5-4f8c-951b-d1e78968948b None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:30.398522 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:30.505175 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf17194-81a5-4f8c-951b-d1e78968948b None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:30.539207 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b301b-d93a-4cc5-9ca4-0c71ce5c313a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:30.539891 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b301b-d93a-4cc5-9ca4-0c71ce5c313a None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:30.540102 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b301b-d93a-4cc5-9ca4-0c71ce5c313a None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:30.540318 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b301b-d93a-4cc5-9ca4-0c71ce5c313a None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:30.540954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b301b-d93a-4cc5-9ca4-0c71ce5c313a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:30.541249 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b301b-d93a-4cc5-9ca4-0c71ce5c313a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:30.542638 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b301b-d93a-4cc5-9ca4-0c71ce5c313a None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:30.556256 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 481/943] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:30.562071 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c27961-5228-458c-a2f2-66344caa6aa3 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:30.611108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:30.672577 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c27961-5228-458c-a2f2-66344caa6aa3 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:30.708462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ff6d0-451a-452a-9f64-6e73783a6e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:30.709216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ff6d0-451a-452a-9f64-6e73783a6e3c None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:30.709601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ff6d0-451a-452a-9f64-6e73783a6e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:30.709881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ff6d0-451a-452a-9f64-6e73783a6e3c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:30.718057 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ff6d0-451a-452a-9f64-6e73783a6e3c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:30.719492 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ff6d0-451a-452a-9f64-6e73783a6e3c None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:30.732281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-839ff6d0-451a-452a-9f64-6e73783a6e3c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 20 14:31:30.732281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:30.732281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:30.732281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:30.732281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:30.732281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:30.732281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:30.732281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:30.732281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:30.732281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:30.732281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:30.732281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:30.732281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:31:30.732281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:31:30.732281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:31:30.732281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:31:30.733325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:30.733325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:30.733325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:31:30.733325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:31:30.733325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:31:30.733325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:31:30.733325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:30.733325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:30.733325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:30.733325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:30.733325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:30.733325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:30.733325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:30.733325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:30.733325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:30.733325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:30.733325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:30.733325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:30.734552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:30.734552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:30.734552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:31:30.734552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:31:30.734552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:31:30.734552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:31:30.734552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:31:30.734552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:31:30.734552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 20 14:31:30.734552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:31:30.734552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 463/944] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:31:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:30.740284 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b301b-d93a-4cc5-9ca4-0c71ce5c313a None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:30.815424 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:30.862741 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b301b-d93a-4cc5-9ca4-0c71ce5c313a None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:30.905155 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae21a5a-c25b-4a8d-94a2-d05de95bb511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:30.905911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae21a5a-c25b-4a8d-94a2-d05de95bb511 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:30.906189 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae21a5a-c25b-4a8d-94a2-d05de95bb511 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:30.906460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae21a5a-c25b-4a8d-94a2-d05de95bb511 None admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:30.907205 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae21a5a-c25b-4a8d-94a2-d05de95bb511 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:30.907494 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae21a5a-c25b-4a8d-94a2-d05de95bb511 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:30.909969 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae21a5a-c25b-4a8d-94a2-d05de95bb511 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:30.928030 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 482/945] 10.222.0.17 () {56 vars in 1143 bytes} [Thu Oct 20 14:31:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:30.933911 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ff6d0-451a-452a-9f64-6e73783a6e3c None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:31.049290 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ff6d0-451a-452a-9f64-6e73783a6e3c None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:31.051428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:31.088339 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416b5d4-7d1a-4e7f-a288-cb3313146c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:31.089043 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416b5d4-7d1a-4e7f-a288-cb3313146c65 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:31.089448 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416b5d4-7d1a-4e7f-a288-cb3313146c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:31.089749 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416b5d4-7d1a-4e7f-a288-cb3313146c65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:31.102402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416b5d4-7d1a-4e7f-a288-cb3313146c65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:31.104229 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416b5d4-7d1a-4e7f-a288-cb3313146c65 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:31.121790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-c416b5d4-7d1a-4e7f-a288-cb3313146c65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:31:31.121790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:31.121790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:31.121790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:31.121790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:31.121790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:31.121790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:31.121790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:31.121790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:31.121790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:31.121790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:31.121790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:31.121790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:31:31.121790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:31:31.121790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:31:31.121790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:31:31.122890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:31.122890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:31.122890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:31.122890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:31.122890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:31.122890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:31.122890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:31.122890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:31.122890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:31.122890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:31.122890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:31.122890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:31.122890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:31.122890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:31.122890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:31.122890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:31.122890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:31:31.123915 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:31:31.123915 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:31:31.123915 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:31:31.123915 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 464/946] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:31:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:31.129617 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae21a5a-c25b-4a8d-94a2-d05de95bb511 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:31.238327 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae21a5a-c25b-4a8d-94a2-d05de95bb511 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:31.261139 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:31.277654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718b2e7-f3bc-487c-8615-e547574e7c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:31.278351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718b2e7-f3bc-487c-8615-e547574e7c18 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:31.278611 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718b2e7-f3bc-487c-8615-e547574e7c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:31.278964 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718b2e7-f3bc-487c-8615-e547574e7c18 None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:31.279634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718b2e7-f3bc-487c-8615-e547574e7c18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:31.279938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718b2e7-f3bc-487c-8615-e547574e7c18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:31.281411 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718b2e7-f3bc-487c-8615-e547574e7c18 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:31.293528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 483/947] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:31.300454 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416b5d4-7d1a-4e7f-a288-cb3313146c65 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:31.407373 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416b5d4-7d1a-4e7f-a288-cb3313146c65 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:31.445508 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61158493-38f5-48ee-961c-1aa0a8c59f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:31.446649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61158493-38f5-48ee-961c-1aa0a8c59f97 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:31.447244 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61158493-38f5-48ee-961c-1aa0a8c59f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:31.447637 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61158493-38f5-48ee-961c-1aa0a8c59f97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:31.456298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61158493-38f5-48ee-961c-1aa0a8c59f97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:31.457829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61158493-38f5-48ee-961c-1aa0a8c59f97 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:31.469747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-61158493-38f5-48ee-961c-1aa0a8c59f97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:31:31.469747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:31.469747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:31.469747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:31.469747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:31.469747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:31.469747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:31.469747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:31.469747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:31.469747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:31.469747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:31.469747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:31.469747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:31:31.469747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:31:31.469747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:31:31.471181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:31:31.471181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:31.471181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:31.471181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:31.471181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:31.471181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:31.471181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:31.471181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:31.471181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:31.471181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:31.471181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:31.471181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:31.471181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:31.471181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:31.471181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:31.471181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:31.471181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:31.472065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:31:31.472065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:31:31.472065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:31:31.472065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:31:31.472065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:31:31.472065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:31:31.472065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:31:31.472065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:31:31.472065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 465/948] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:31:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:31.478088 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718b2e7-f3bc-487c-8615-e547574e7c18 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:31.598339 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718b2e7-f3bc-487c-8615-e547574e7c18 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:31.636988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661545e-eaa4-42cf-9b3a-850c5e84adec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:31.637715 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661545e-eaa4-42cf-9b3a-850c5e84adec None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:31.638241 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661545e-eaa4-42cf-9b3a-850c5e84adec None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:31.638527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661545e-eaa4-42cf-9b3a-850c5e84adec None admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:31.639310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661545e-eaa4-42cf-9b3a-850c5e84adec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:31.639851 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661545e-eaa4-42cf-9b3a-850c5e84adec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:31.641611 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661545e-eaa4-42cf-9b3a-850c5e84adec None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:31.659915 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 484/949] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:31:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:31.662393 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61158493-38f5-48ee-961c-1aa0a8c59f97 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:31.681165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:31.773335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61158493-38f5-48ee-961c-1aa0a8c59f97 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:31.810057 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63e5bb-2bfb-46b4-87dc-5d2a581fc1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:31.810721 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63e5bb-2bfb-46b4-87dc-5d2a581fc1eb None admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:31.811001 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63e5bb-2bfb-46b4-87dc-5d2a581fc1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:31.811271 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63e5bb-2bfb-46b4-87dc-5d2a581fc1eb None admin] PATH_INFO: `/v3/projects/88613722e7dc4950b5e47a1d92331575/users/1e94a60e43914cf38a5f2f88b182083f/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:31.813398 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63e5bb-2bfb-46b4-87dc-5d2a581fc1eb None admin] RBAC: Authorizing `identity:create_grant(project_id=88613722e7dc4950b5e47a1d92331575, user_id=1e94a60e43914cf38a5f2f88b182083f, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:31.815046 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63e5bb-2bfb-46b4-87dc-5d2a581fc1eb None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:31.828306 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 466/950] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Oct 20 14:31:31 2022] PUT /identity/v3/projects/88613722e7dc4950b5e47a1d92331575/users/1e94a60e43914cf38a5f2f88b182083f/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:31:34.163312 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ef90d-aaf8-432c-bcb9-60417dc040cb None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:34.163948 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ef90d-aaf8-432c-bcb9-60417dc040cb None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:34.163948 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ef90d-aaf8-432c-bcb9-60417dc040cb None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:34.165221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 485/951] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:31:34.171626 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffadf2-e103-4897-aeaf-f4e6a56bfb0b None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:34.172363 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffadf2-e103-4897-aeaf-f4e6a56bfb0b None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:34.172476 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffadf2-e103-4897-aeaf-f4e6a56bfb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:34.192109 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-87ffadf2-e103-4897-aeaf-f4e6a56bfb0b None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:31:34.193502 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-87ffadf2-e103-4897-aeaf-f4e6a56bfb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:31:34.268217 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 467/952] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:31:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:31:34.537403 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ef90d-aaf8-432c-bcb9-60417dc040cb None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:34.584593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:34.646496 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ef90d-aaf8-432c-bcb9-60417dc040cb None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:34.682268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d133ebc-d68f-475e-b66a-5f4ecbb27180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:34.683003 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d133ebc-d68f-475e-b66a-5f4ecbb27180 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:34.683277 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d133ebc-d68f-475e-b66a-5f4ecbb27180 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:34.683632 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d133ebc-d68f-475e-b66a-5f4ecbb27180 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:34.694238 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d133ebc-d68f-475e-b66a-5f4ecbb27180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 14:31:34.699278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-4d133ebc-d68f-475e-b66a-5f4ecbb27180 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:31:34.699278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:34.699278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:34.699278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:34.699278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:34.699278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:34.699278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:34.699278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:34.699278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:34.699278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:34.699278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:34.699278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:34.699278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 14:31:34.699278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 14:31:34.699278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 14:31:34.699278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 14:31:34.700288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 14:31:34.700288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 14:31:34.700288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 14:31:34.700288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 14:31:34.700288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:34.700288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:34.700288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:34.700288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:34.700288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:34.700288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:34.700288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:34.700288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:34.700288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:34.700288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:34.700288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:34.700288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:34.701129 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:34.701129 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:34.701129 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:34.701129 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:34.701129 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 14:31:34.701129 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 14:31:34.701129 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 14:31:34.701129 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 14:31:34.701129 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 14:31:34.701129 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 14:31:34.701129 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 14:31:34.701129 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:31:34.701129 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 486/953] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Oct 20 14:31:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 14:31:34.706625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ffadf2-e103-4897-aeaf-f4e6a56bfb0b None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:34.711164 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:34.813757 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ffadf2-e103-4897-aeaf-f4e6a56bfb0b None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:34.851822 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e256a-921d-40ee-8832-1c5ebc12da7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:34.852496 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e256a-921d-40ee-8832-1c5ebc12da7e None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:34.852873 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e256a-921d-40ee-8832-1c5ebc12da7e None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:34.853121 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e256a-921d-40ee-8832-1c5ebc12da7e None admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:34.853963 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e256a-921d-40ee-8832-1c5ebc12da7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:34.854367 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e256a-921d-40ee-8832-1c5ebc12da7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:34.855836 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e256a-921d-40ee-8832-1c5ebc12da7e None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:34.865434 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 468/954] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Oct 20 14:31:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:34.871561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d133ebc-d68f-475e-b66a-5f4ecbb27180 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:34.986863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:34.990383 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d133ebc-d68f-475e-b66a-5f4ecbb27180 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:35.030068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f288b-28bb-48eb-af6c-9600ca939bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:35.030763 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f288b-28bb-48eb-af6c-9600ca939bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:35.031075 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f288b-28bb-48eb-af6c-9600ca939bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:35.031343 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f288b-28bb-48eb-af6c-9600ca939bb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:35.042875 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f288b-28bb-48eb-af6c-9600ca939bb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:35.044331 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f288b-28bb-48eb-af6c-9600ca939bb2 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:35.059335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-dc7f288b-28bb-48eb-af6c-9600ca939bb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:31:35.059335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:35.059335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:35.059335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:35.059335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:35.059335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:35.059335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:35.059335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:35.059335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:35.059335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:35.059335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:35.059335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:35.059335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:31:35.059335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:31:35.059335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:31:35.059335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:31:35.060362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:35.060362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:35.060362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:35.060362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:35.060362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:35.060362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:35.060362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:35.060362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:35.060362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:35.060362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:35.060362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:35.060362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:35.060362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:35.060362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:35.060362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:35.060362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:35.060362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:31:35.061620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:31:35.061620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:31:35.061620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:31:35.061620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 487/955] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:31:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:35.066487 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e256a-921d-40ee-8832-1c5ebc12da7e None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:35.139477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:35.177639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e256a-921d-40ee-8832-1c5ebc12da7e None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:35.216133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f978b-6c14-4f68-91e3-a6a102d2ddfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:35.216813 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f978b-6c14-4f68-91e3-a6a102d2ddfe None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:35.217103 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f978b-6c14-4f68-91e3-a6a102d2ddfe None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:35.217429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f978b-6c14-4f68-91e3-a6a102d2ddfe None admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:35.218169 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f978b-6c14-4f68-91e3-a6a102d2ddfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:35.218509 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f978b-6c14-4f68-91e3-a6a102d2ddfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:35.220164 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f978b-6c14-4f68-91e3-a6a102d2ddfe None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:35.233056 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 469/956] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:35.239506 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f288b-28bb-48eb-af6c-9600ca939bb2 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:35.354151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f288b-28bb-48eb-af6c-9600ca939bb2 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:35.393768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f338a11-e45b-47e0-812c-7a36f2f3130c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:35.394460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f338a11-e45b-47e0-812c-7a36f2f3130c None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:35.394740 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f338a11-e45b-47e0-812c-7a36f2f3130c None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:35.395012 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f338a11-e45b-47e0-812c-7a36f2f3130c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:35.403530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f338a11-e45b-47e0-812c-7a36f2f3130c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:35.405027 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f338a11-e45b-47e0-812c-7a36f2f3130c None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:35.418308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-5f338a11-e45b-47e0-812c-7a36f2f3130c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 20 14:31:35.418308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:35.418308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:35.418308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:35.418308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:35.418308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:35.418308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:35.418308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:35.418308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:35.418308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:35.418308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:35.418308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:35.418308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 14:31:35.418308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 14:31:35.418308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 14:31:35.418308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 14:31:35.419520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:35.419520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:35.419520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 14:31:35.419520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:31:35.419520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 14:31:35.419520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 14:31:35.419520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:35.419520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:35.419520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:35.419520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:35.419520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:35.419520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:35.419520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:35.419520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:35.419520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:35.419520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:35.419520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:35.419520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:35.420690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:35.420690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:35.420690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 14:31:35.420690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 14:31:35.420690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 14:31:35.420690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 14:31:35.420690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 14:31:35.420690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 14:31:35.420690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 20 14:31:35.420690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:31:35.420690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 488/957] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:31:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:35.428985 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f978b-6c14-4f68-91e3-a6a102d2ddfe None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:35.537538 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f978b-6c14-4f68-91e3-a6a102d2ddfe None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:35.564480 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:35.573430 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5bfcb-b859-4826-b7b8-83ab007e6e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:35.574067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5bfcb-b859-4826-b7b8-83ab007e6e72 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:35.574342 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5bfcb-b859-4826-b7b8-83ab007e6e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:35.574606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5bfcb-b859-4826-b7b8-83ab007e6e72 None admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:35.575334 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5bfcb-b859-4826-b7b8-83ab007e6e72 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:35.575633 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5bfcb-b859-4826-b7b8-83ab007e6e72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:35.577048 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5bfcb-b859-4826-b7b8-83ab007e6e72 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:35.595916 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 470/958] 10.222.0.17 () {56 vars in 1143 bytes} [Thu Oct 20 14:31:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:35.601942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f338a11-e45b-47e0-812c-7a36f2f3130c None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:35.617880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:35.705875 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f338a11-e45b-47e0-812c-7a36f2f3130c None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:35.740816 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3491d7-a25f-4255-8d1f-5dd3496fef31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:35.741434 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3491d7-a25f-4255-8d1f-5dd3496fef31 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:35.741711 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3491d7-a25f-4255-8d1f-5dd3496fef31 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:35.742007 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3491d7-a25f-4255-8d1f-5dd3496fef31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:35.809721 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3491d7-a25f-4255-8d1f-5dd3496fef31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:35.811205 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3491d7-a25f-4255-8d1f-5dd3496fef31 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:35.824723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:35.934298 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 489/959] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Oct 20 14:31:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 20 14:31:35.940672 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5bfcb-b859-4826-b7b8-83ab007e6e72 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:36.039043 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5bfcb-b859-4826-b7b8-83ab007e6e72 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:36.071954 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72232d3-6051-4550-be3c-881dde9f7cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:36.072573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72232d3-6051-4550-be3c-881dde9f7cef None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:36.072851 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72232d3-6051-4550-be3c-881dde9f7cef None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:36.073118 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72232d3-6051-4550-be3c-881dde9f7cef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:36.083496 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72232d3-6051-4550-be3c-881dde9f7cef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:36.084923 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72232d3-6051-4550-be3c-881dde9f7cef None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:36.099092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-c72232d3-6051-4550-be3c-881dde9f7cef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:31:36.099092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:36.099092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:36.099092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:36.099092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:36.099092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:36.099092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:36.099092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:36.099092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:36.099092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:36.099092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:36.099092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:36.099092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 14:31:36.099092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 14:31:36.099092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 14:31:36.099092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 14:31:36.100145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:36.100145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:36.100145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:36.100145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:36.100145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:36.100145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:36.100145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:36.100145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:36.100145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:36.100145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:36.100145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:36.100145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:36.100145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:36.100145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:36.100145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:36.100145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:36.100145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 14:31:36.101164 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 14:31:36.101164 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 14:31:36.101164 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:31:36.101164 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 471/960] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:31:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:36.105873 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3491d7-a25f-4255-8d1f-5dd3496fef31 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:36.201705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3491d7-a25f-4255-8d1f-5dd3496fef31 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:36.214886 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:36.235553 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b8ac4-1837-46dc-83a8-cecc15194894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:36.236657 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b8ac4-1837-46dc-83a8-cecc15194894 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:36.236932 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b8ac4-1837-46dc-83a8-cecc15194894 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:36.237198 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b8ac4-1837-46dc-83a8-cecc15194894 None admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:36.237821 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b8ac4-1837-46dc-83a8-cecc15194894 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:36.238151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b8ac4-1837-46dc-83a8-cecc15194894 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:36.239511 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b8ac4-1837-46dc-83a8-cecc15194894 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:36.250226 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 490/961] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Oct 20 14:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:36.255935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72232d3-6051-4550-be3c-881dde9f7cef None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:36.290864 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:36.352228 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72232d3-6051-4550-be3c-881dde9f7cef None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:36.383532 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beac1bf-33f0-46c7-920a-4becaa264255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:36.384136 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beac1bf-33f0-46c7-920a-4becaa264255 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:36.384411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beac1bf-33f0-46c7-920a-4becaa264255 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:36.384679 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beac1bf-33f0-46c7-920a-4becaa264255 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:36.390941 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beac1bf-33f0-46c7-920a-4becaa264255 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:36.392880 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beac1bf-33f0-46c7-920a-4becaa264255 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:36.403615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application [None req-0beac1bf-33f0-46c7-920a-4becaa264255 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:31:36.403615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:36.403615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:36.403615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:36.403615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:36.403615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:36.403615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:36.403615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:36.403615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:36.403615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:36.403615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:36.403615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:36.403615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 14:31:36.403615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 14:31:36.403615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 14:31:36.404641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 14:31:36.404641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:36.404641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:36.404641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:36.404641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:36.404641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:36.404641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:36.404641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:36.404641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:36.404641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:36.404641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:36.404641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:36.404641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:36.404641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:36.404641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:36.404641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:36.404641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:36.405813 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 14:31:36.405813 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 14:31:36.405813 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 14:31:36.405813 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 14:31:36.405813 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 14:31:36.405813 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 14:31:36.405813 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 14:31:36.405813 dv-cinder-779233-7-smb devstack@keystone.service[81802]: ERROR keystone.server.flask.application Oct 20 14:31:36.405813 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 472/962] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Oct 20 14:31:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:36.411129 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b8ac4-1837-46dc-83a8-cecc15194894 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:36.505450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b8ac4-1837-46dc-83a8-cecc15194894 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:36.537537 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b94339-b4a1-4240-b029-6d3022df1201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:36.538153 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b94339-b4a1-4240-b029-6d3022df1201 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:36.538428 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b94339-b4a1-4240-b029-6d3022df1201 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:36.538693 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b94339-b4a1-4240-b029-6d3022df1201 None admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:36.539366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b94339-b4a1-4240-b029-6d3022df1201 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:36.539663 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b94339-b4a1-4240-b029-6d3022df1201 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:36.541066 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b94339-b4a1-4240-b029-6d3022df1201 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:36.553064 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 491/963] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Oct 20 14:31:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:36.559012 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beac1bf-33f0-46c7-920a-4becaa264255 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:36.650238 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:36.656252 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beac1bf-33f0-46c7-920a-4becaa264255 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:36.689501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea849664-7e96-4a54-99b9-2ca9eff76fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:36.690111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea849664-7e96-4a54-99b9-2ca9eff76fec None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:36.690394 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea849664-7e96-4a54-99b9-2ca9eff76fec None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:36.690670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea849664-7e96-4a54-99b9-2ca9eff76fec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:36.691388 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea849664-7e96-4a54-99b9-2ca9eff76fec None admin] RBAC: Adding query filter params (role.id=fe3ee5741c6143adb5459b5de54450c8, scope.project.id=88613722e7dc4950b5e47a1d92331575, user.id=1e94a60e43914cf38a5f2f88b182083f) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:36.691692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea849664-7e96-4a54-99b9-2ca9eff76fec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:36.693103 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea849664-7e96-4a54-99b9-2ca9eff76fec None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:36.698712 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 473/964] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Oct 20 14:31:36 2022] GET /identity/v3/role_assignments?user.id=1e94a60e43914cf38a5f2f88b182083f&scope.project.id=88613722e7dc4950b5e47a1d92331575&role.id=fe3ee5741c6143adb5459b5de54450c8 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:38.823569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29370075-6573-4f0f-a833-d7a6a1775081 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:38.824088 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29370075-6573-4f0f-a833-d7a6a1775081 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:38.824088 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29370075-6573-4f0f-a833-d7a6a1775081 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:38.825427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 492/965] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:31:38.831157 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61550771-dd7a-4d3e-a86f-9d1321c8f762 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:38.831518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61550771-dd7a-4d3e-a86f-9d1321c8f762 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:38.831704 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61550771-dd7a-4d3e-a86f-9d1321c8f762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:38.851297 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-61550771-dd7a-4d3e-a86f-9d1321c8f762 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:31:38.852722 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-61550771-dd7a-4d3e-a86f-9d1321c8f762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:31:38.929104 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 474/966] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:31:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:31:39.193078 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29370075-6573-4f0f-a833-d7a6a1775081 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:39.223806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:39.292224 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29370075-6573-4f0f-a833-d7a6a1775081 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:39.324460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91d015-afa3-4fee-abf2-469a62da6fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:39.325072 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91d015-afa3-4fee-abf2-469a62da6fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:39.325349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91d015-afa3-4fee-abf2-469a62da6fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:39.325618 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91d015-afa3-4fee-abf2-469a62da6fa3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:39.326212 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91d015-afa3-4fee-abf2-469a62da6fa3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:39.327578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91d015-afa3-4fee-abf2-469a62da6fa3 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:39.336673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-bc91d015-afa3-4fee-abf2-469a62da6fa3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 14:31:39.336673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:39.336673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:31:39.336673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:31:39.336673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:31:39.336673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:31:39.336673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:31:39.336673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:31:39.336673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 14:31:39.336673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:31:39.336673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:31:39.336673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:31:39.336673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:39.336673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:39.336673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:39.336673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:39.336673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:39.337917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:39.337917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:39.337917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:39.337917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:39.337917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:39.337917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:39.337917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:31:39.337917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:31:39.337917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:31:39.337917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:31:39.337917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:39.337917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:39.337917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:39.337917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:39.337917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:39.337917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:39.338975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:39.338975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:39.338975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:39.338975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:39.338975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:39.338975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:39.338975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:39.338975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:39.338975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:39.338975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:39.338975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:31:39.338975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:31:39.338975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 14:31:39.338975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:31:39.338975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 493/967] 10.222.0.17 () {56 vars in 1117 bytes} [Thu Oct 20 14:31:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:39.343723 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61550771-dd7a-4d3e-a86f-9d1321c8f762 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:39.429184 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:39.438544 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61550771-dd7a-4d3e-a86f-9d1321c8f762 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:39.470998 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76396e84-698e-40d5-aa2e-035caca8d106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:39.471580 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76396e84-698e-40d5-aa2e-035caca8d106 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:39.471854 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76396e84-698e-40d5-aa2e-035caca8d106 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:39.472117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76396e84-698e-40d5-aa2e-035caca8d106 None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:39.472732 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76396e84-698e-40d5-aa2e-035caca8d106 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:39.473026 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76396e84-698e-40d5-aa2e-035caca8d106 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:39.474394 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76396e84-698e-40d5-aa2e-035caca8d106 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:39.478910 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 475/968] 10.222.0.17 () {56 vars in 1116 bytes} [Thu Oct 20 14:31:39 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:39.484637 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91d015-afa3-4fee-abf2-469a62da6fa3 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:39.575716 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:39.582690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91d015-afa3-4fee-abf2-469a62da6fa3 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:39.615132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202f655-348d-41f7-b334-c461ed94800a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:39.615728 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202f655-348d-41f7-b334-c461ed94800a None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:39.616009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202f655-348d-41f7-b334-c461ed94800a None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:39.616278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202f655-348d-41f7-b334-c461ed94800a None admin] PATH_INFO: `/v3/services` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:39.616902 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202f655-348d-41f7-b334-c461ed94800a None admin] RBAC: Adding query filter params (type=placement) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:39.617201 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202f655-348d-41f7-b334-c461ed94800a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:39.618594 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202f655-348d-41f7-b334-c461ed94800a None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:39.622838 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 494/969] 10.222.0.17 () {56 vars in 1116 bytes} [Thu Oct 20 14:31:39 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:41.720158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2900088-dd10-4afc-a851-64ab394a9d0f None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:41.720738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2900088-dd10-4afc-a851-64ab394a9d0f None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:41.720835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2900088-dd10-4afc-a851-64ab394a9d0f None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:41.722150 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 476/970] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:31:41.727248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e4419-daa7-4c0e-b155-a75f61faa485 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:41.727643 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e4419-daa7-4c0e-b155-a75f61faa485 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:41.727800 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e4419-daa7-4c0e-b155-a75f61faa485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:41.746210 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-964e4419-daa7-4c0e-b155-a75f61faa485 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:31:41.747376 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-964e4419-daa7-4c0e-b155-a75f61faa485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:31:41.810896 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 495/971] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:31:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:31:42.100196 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2900088-dd10-4afc-a851-64ab394a9d0f None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:42.198790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2900088-dd10-4afc-a851-64ab394a9d0f None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:42.231711 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448e965-f964-4444-918b-e373242e03dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:42.232304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448e965-f964-4444-918b-e373242e03dd None admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:42.232580 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448e965-f964-4444-918b-e373242e03dd None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:42.232848 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448e965-f964-4444-918b-e373242e03dd None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:42.233489 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448e965-f964-4444-918b-e373242e03dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:42.234894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448e965-f964-4444-918b-e373242e03dd None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:42.248551 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 477/972] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Oct 20 14:31:42 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:31:44.385184 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094612af-ba66-469a-879e-4d6d4299cecd None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:44.385724 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094612af-ba66-469a-879e-4d6d4299cecd None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:44.385724 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094612af-ba66-469a-879e-4d6d4299cecd None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:44.387192 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 496/973] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:31:44.392508 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2461a0f-823c-4c12-ab6a-0eadd7ff12c2 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:44.392942 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2461a0f-823c-4c12-ab6a-0eadd7ff12c2 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:44.393042 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2461a0f-823c-4c12-ab6a-0eadd7ff12c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:44.411490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-d2461a0f-823c-4c12-ab6a-0eadd7ff12c2 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:31:44.412682 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d2461a0f-823c-4c12-ab6a-0eadd7ff12c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:31:44.421904 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:44.484757 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 478/974] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:31:44 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:31:44.749785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094612af-ba66-469a-879e-4d6d4299cecd None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:44.836495 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:44.848809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094612af-ba66-469a-879e-4d6d4299cecd None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:44.893536 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f499e0-a469-4fcf-96f6-7097dec9ea95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:44.894333 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f499e0-a469-4fcf-96f6-7097dec9ea95 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:44.894768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f499e0-a469-4fcf-96f6-7097dec9ea95 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:44.895053 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f499e0-a469-4fcf-96f6-7097dec9ea95 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:44.895792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f499e0-a469-4fcf-96f6-7097dec9ea95 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:44.897509 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f499e0-a469-4fcf-96f6-7097dec9ea95 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:44.908096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-87f499e0-a469-4fcf-96f6-7097dec9ea95 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 14:31:44.908096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:44.908096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:31:44.908096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:31:44.908096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:31:44.908096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:31:44.908096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:31:44.908096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:31:44.908096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 14:31:44.908096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:31:44.908096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:31:44.908096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:31:44.908096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:44.908096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:44.908096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:44.908096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:44.908096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:44.909412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:44.909412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:44.909412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:44.909412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:44.909412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:44.909412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:44.909412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:31:44.909412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:31:44.909412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:31:44.909412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:31:44.909412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:44.909412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:44.909412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:44.909412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:44.909412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:44.909412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:44.910576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:44.910576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:44.910576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:44.910576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:44.910576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:44.910576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:44.910576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:44.910576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:44.910576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:44.910576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:44.910576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:31:44.910576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:31:44.910576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 14:31:44.910576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:31:44.910576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 497/975] 10.222.0.17 () {56 vars in 1117 bytes} [Thu Oct 20 14:31:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:44.915520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2461a0f-823c-4c12-ab6a-0eadd7ff12c2 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:45.009646 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2461a0f-823c-4c12-ab6a-0eadd7ff12c2 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:45.045100 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78044776-bd94-4932-a118-f374d10b78a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:45.045698 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78044776-bd94-4932-a118-f374d10b78a5 None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:45.046003 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78044776-bd94-4932-a118-f374d10b78a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:45.046272 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78044776-bd94-4932-a118-f374d10b78a5 None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:45.047173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78044776-bd94-4932-a118-f374d10b78a5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:45.047468 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78044776-bd94-4932-a118-f374d10b78a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:45.049147 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78044776-bd94-4932-a118-f374d10b78a5 None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:45.054150 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 479/976] 10.222.0.17 () {56 vars in 1116 bytes} [Thu Oct 20 14:31:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:45.060219 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f499e0-a469-4fcf-96f6-7097dec9ea95 None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:45.157241 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f499e0-a469-4fcf-96f6-7097dec9ea95 None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:45.190108 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b73bb6-0dce-43a2-8e94-d82f63b34212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:45.190708 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b73bb6-0dce-43a2-8e94-d82f63b34212 None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:45.190987 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b73bb6-0dce-43a2-8e94-d82f63b34212 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:45.191256 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b73bb6-0dce-43a2-8e94-d82f63b34212 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:45.191940 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b73bb6-0dce-43a2-8e94-d82f63b34212 None admin] RBAC: Adding query filter params (interface=public, service_id=3b775adaba1142938a27f311fb7a284e, region_id=RegionOne) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:45.192242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b73bb6-0dce-43a2-8e94-d82f63b34212 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:45.193615 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b73bb6-0dce-43a2-8e94-d82f63b34212 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:45.198495 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 498/977] 10.222.0.17 () {56 vars in 1251 bytes} [Thu Oct 20 14:31:45 2022] GET /identity/v3/endpoints?service_id=3b775adaba1142938a27f311fb7a284e&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:31:45.204816 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78044776-bd94-4932-a118-f374d10b78a5 None admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:45.208529 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:45.301254 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78044776-bd94-4932-a118-f374d10b78a5 None admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:45.333946 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6a602-e8d8-484a-bc18-c84edd21d55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:45.334535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6a602-e8d8-484a-bc18-c84edd21d55f None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:45.334814 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6a602-e8d8-484a-bc18-c84edd21d55f None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:45.335084 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6a602-e8d8-484a-bc18-c84edd21d55f None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:45.335679 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6a602-e8d8-484a-bc18-c84edd21d55f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:45.337030 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6a602-e8d8-484a-bc18-c84edd21d55f None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:45.343529 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 480/978] 10.222.0.17 () {56 vars in 1087 bytes} [Thu Oct 20 14:31:45 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:31:47.459794 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c9feb-e4cd-4e33-acc4-4babb06279a7 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:47.460304 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c9feb-e4cd-4e33-acc4-4babb06279a7 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:47.460304 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c9feb-e4cd-4e33-acc4-4babb06279a7 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:47.461592 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 499/979] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:31:47.466880 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41eb66f-20ce-4634-8033-f22c69120f01 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:47.467304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41eb66f-20ce-4634-8033-f22c69120f01 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:47.467430 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41eb66f-20ce-4634-8033-f22c69120f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:47.485459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-e41eb66f-20ce-4634-8033-f22c69120f01 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:31:47.486689 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e41eb66f-20ce-4634-8033-f22c69120f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:31:47.548967 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:47.554668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 481/980] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:31:47 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 14:31:47.824103 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c9feb-e4cd-4e33-acc4-4babb06279a7 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:47.843724 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:47.933340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c9feb-e4cd-4e33-acc4-4babb06279a7 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:47.966658 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fc641-8668-4b93-ae0f-66edfd8d700e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:47.967281 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fc641-8668-4b93-ae0f-66edfd8d700e None admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:47.967562 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fc641-8668-4b93-ae0f-66edfd8d700e None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:47.967838 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fc641-8668-4b93-ae0f-66edfd8d700e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:47.968410 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8fc641-8668-4b93-ae0f-66edfd8d700e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:47.969821 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8fc641-8668-4b93-ae0f-66edfd8d700e None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:47.978444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application [None req-cd8fc641-8668-4b93-ae0f-66edfd8d700e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 14:31:47.978444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:47.978444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 14:31:47.978444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 14:31:47.978444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 14:31:47.978444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 14:31:47.978444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 14:31:47.978444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:31:47.978444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 14:31:47.978444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:31:47.978444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 14:31:47.978444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:31:47.978444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 14:31:47.978444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 14:31:47.978444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 14:31:47.978444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 14:31:47.978444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 14:31:47.979561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 14:31:47.979561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 14:31:47.979561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 14:31:47.979561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 14:31:47.979561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 14:31:47.979561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 14:31:47.979561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 14:31:47.979561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 14:31:47.979561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 14:31:47.979561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 14:31:47.979561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 14:31:47.979561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 14:31:47.979561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 14:31:47.979561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 14:31:47.979561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 14:31:47.979561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 14:31:47.980775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 14:31:47.980775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application with Lock( Oct 20 14:31:47.980775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 14:31:47.980775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self._enter() Oct 20 14:31:47.980775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 14:31:47.980775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 14:31:47.980775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 14:31:47.980775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application return self.creator() Oct 20 14:31:47.980775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 14:31:47.980775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application created_value = creator( Oct 20 14:31:47.980775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 14:31:47.980775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 14:31:47.980775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 14:31:47.980775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: ERROR keystone.server.flask.application Oct 20 14:31:47.980775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 500/981] 10.222.0.17 () {56 vars in 1117 bytes} [Thu Oct 20 14:31:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 14:31:47.985674 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41eb66f-20ce-4634-8033-f22c69120f01 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:48.079147 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41eb66f-20ce-4634-8033-f22c69120f01 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:48.111150 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d1a34-031f-4067-8ec1-d38292bd6ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:48.111743 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d1a34-031f-4067-8ec1-d38292bd6ebe None admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:48.112015 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d1a34-031f-4067-8ec1-d38292bd6ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:48.112284 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d1a34-031f-4067-8ec1-d38292bd6ebe None admin] PATH_INFO: `/v3/services` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:48.112902 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d1a34-031f-4067-8ec1-d38292bd6ebe None admin] RBAC: Adding query filter params (name=placement) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:31:48.113197 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d1a34-031f-4067-8ec1-d38292bd6ebe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:48.114568 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d1a34-031f-4067-8ec1-d38292bd6ebe None admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:48.119386 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 482/982] 10.222.0.17 () {56 vars in 1116 bytes} [Thu Oct 20 14:31:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:31:48.125040 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fc641-8668-4b93-ae0f-66edfd8d700e None admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:31:48.208440 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:48.226298 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fc641-8668-4b93-ae0f-66edfd8d700e None admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:31:48.259444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd72e23-8029-4ffc-a340-0e6152e59eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:31:48.260043 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd72e23-8029-4ffc-a340-0e6152e59eb7 None admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:31:48.260326 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd72e23-8029-4ffc-a340-0e6152e59eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:31:48.260606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd72e23-8029-4ffc-a340-0e6152e59eb7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:31:48.261276 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd72e23-8029-4ffc-a340-0e6152e59eb7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:31:48.262681 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd72e23-8029-4ffc-a340-0e6152e59eb7 None admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:31:48.281086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 501/983] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:31:48 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:31:58.116543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=69 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:31:58.276882 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:32:51.736430 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade26f9d-2dba-4261-96ec-9633bc48c460 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:32:51.736430 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade26f9d-2dba-4261-96ec-9633bc48c460 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:32:51.736916 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade26f9d-2dba-4261-96ec-9633bc48c460 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:32:51.738037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 483/984] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:32:51.743083 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47c456-f7d9-4aa9-a571-963e601dbcd5 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:32:51.743526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47c456-f7d9-4aa9-a571-963e601dbcd5 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:32:51.743627 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47c456-f7d9-4aa9-a571-963e601dbcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:32:51.836732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-fe47c456-f7d9-4aa9-a571-963e601dbcd5 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:32:51.838298 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-fe47c456-f7d9-4aa9-a571-963e601dbcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:32:52.026522 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 502/985] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:32:52.337800 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df512e62-d7b6-4d0b-a7a7-c1ec01848c08 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:32:52.338196 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df512e62-d7b6-4d0b-a7a7-c1ec01848c08 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:32:52.338389 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df512e62-d7b6-4d0b-a7a7-c1ec01848c08 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:32:52.340510 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 484/986] 10.222.0.17 () {54 vars in 964 bytes} [Thu Oct 20 14:32:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:32:52.346733 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec70b3-3821-45dd-8022-1f9fb6eb9b53 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:32:52.347091 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec70b3-3821-45dd-8022-1f9fb6eb9b53 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:32:52.347439 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec70b3-3821-45dd-8022-1f9fb6eb9b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:32:52.427343 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-abec70b3-3821-45dd-8022-1f9fb6eb9b53 None None] MFA Rules not processed for user `359e9d904b0d43acae86337c1eb6a71d`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:32:52.428649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-abec70b3-3821-45dd-8022-1f9fb6eb9b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:32:52.451459 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:32:52.511124 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 503/987] 10.222.0.17 () {58 vars in 1061 bytes} [Thu Oct 20 14:32:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:32:52.520191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df512e62-d7b6-4d0b-a7a7-c1ec01848c08 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:32:52.522183 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-df512e62-d7b6-4d0b-a7a7-c1ec01848c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:32:52.650633 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df512e62-d7b6-4d0b-a7a7-c1ec01848c08 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:32:52.737589 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7213b5-e495-4044-8af9-0fcf26bb1aa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:32:52.738251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7213b5-e495-4044-8af9-0fcf26bb1aa2 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:32:52.738548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7213b5-e495-4044-8af9-0fcf26bb1aa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:32:52.738767 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7213b5-e495-4044-8af9-0fcf26bb1aa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:32:52.740374 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-ca7213b5-e495-4044-8af9-0fcf26bb1aa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:32:52.800958 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:32:52.865020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7213b5-e495-4044-8af9-0fcf26bb1aa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:32:52.866894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7213b5-e495-4044-8af9-0fcf26bb1aa2 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:32:52.918552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 485/988] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:32:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:32:55.440692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e82ed-3fd9-4e7c-8c47-9f56fee191e4 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:32:55.441188 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e82ed-3fd9-4e7c-8c47-9f56fee191e4 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:32:55.441305 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e82ed-3fd9-4e7c-8c47-9f56fee191e4 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:32:55.442653 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 504/989] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:32:55.447737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a575f6-b8e2-4861-b3de-8c64c66efb42 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:32:55.448159 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a575f6-b8e2-4861-b3de-8c64c66efb42 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:32:55.448312 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a575f6-b8e2-4861-b3de-8c64c66efb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:32:55.528633 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-63a575f6-b8e2-4861-b3de-8c64c66efb42 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:32:55.529827 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-63a575f6-b8e2-4861-b3de-8c64c66efb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:32:55.623142 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 486/990] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:32:55.912745 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e82ed-3fd9-4e7c-8c47-9f56fee191e4 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:32:55.914308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-335e82ed-3fd9-4e7c-8c47-9f56fee191e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:32:56.017037 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e82ed-3fd9-4e7c-8c47-9f56fee191e4 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:32:56.086931 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:32:56.089910 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590eab5-f50e-4320-99b1-5b7d109f1eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:32:56.090721 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590eab5-f50e-4320-99b1-5b7d109f1eeb service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:32:56.091019 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590eab5-f50e-4320-99b1-5b7d109f1eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:32:56.091460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590eab5-f50e-4320-99b1-5b7d109f1eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:32:56.093264 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-6590eab5-f50e-4320-99b1-5b7d109f1eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:32:56.198888 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590eab5-f50e-4320-99b1-5b7d109f1eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:32:56.200322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590eab5-f50e-4320-99b1-5b7d109f1eeb service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:32:56.218555 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 505/991] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:32:58.661406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63b0d7-09df-49d0-a1d4-db1ff7dd9333 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:32:58.661959 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63b0d7-09df-49d0-a1d4-db1ff7dd9333 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:32:58.661959 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63b0d7-09df-49d0-a1d4-db1ff7dd9333 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:32:58.663328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 487/992] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:32:58.669746 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d0e46-6533-44ac-b475-004a730d0226 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:32:58.670188 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d0e46-6533-44ac-b475-004a730d0226 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:32:58.670317 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d0e46-6533-44ac-b475-004a730d0226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:32:58.734154 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-356d0e46-6533-44ac-b475-004a730d0226 None None] MFA Rules not processed for user `b2cb9e39aae44ad29f4b41f3797d7ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:32:58.735337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-356d0e46-6533-44ac-b475-004a730d0226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:32:58.785342 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:32:58.828626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 506/993] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:32:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:32:59.114065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63b0d7-09df-49d0-a1d4-db1ff7dd9333 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:32:59.115610 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-1e63b0d7-09df-49d0-a1d4-db1ff7dd9333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:32:59.125915 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:32:59.219661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63b0d7-09df-49d0-a1d4-db1ff7dd9333 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:32:59.291366 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65d6eb-1ae7-4103-b87f-4faa250d3a6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:32:59.291987 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65d6eb-1ae7-4103-b87f-4faa250d3a6b service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:32:59.292266 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65d6eb-1ae7-4103-b87f-4faa250d3a6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:32:59.292540 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65d6eb-1ae7-4103-b87f-4faa250d3a6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:32:59.294424 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-6a65d6eb-1ae7-4103-b87f-4faa250d3a6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:32:59.356875 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:32:59.403578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65d6eb-1ae7-4103-b87f-4faa250d3a6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:32:59.404953 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65d6eb-1ae7-4103-b87f-4faa250d3a6b service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:32:59.424845 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 488/994] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:32:59 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:33:02.148719 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659a7f8-7e92-4983-a02d-a56c8edd5ef6 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:02.149273 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659a7f8-7e92-4983-a02d-a56c8edd5ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:02.149273 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659a7f8-7e92-4983-a02d-a56c8edd5ef6 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:02.151152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 507/995] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:33:02.156647 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6214122-1c74-47a9-a496-c169850a23dc None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:02.157085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6214122-1c74-47a9-a496-c169850a23dc None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:02.157177 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6214122-1c74-47a9-a496-c169850a23dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:02.222571 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-e6214122-1c74-47a9-a496-c169850a23dc None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:33:02.223787 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e6214122-1c74-47a9-a496-c169850a23dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:02.318425 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 489/996] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:33:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:33:02.607109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659a7f8-7e92-4983-a02d-a56c8edd5ef6 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:33:02.608634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2659a7f8-7e92-4983-a02d-a56c8edd5ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:02.710506 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659a7f8-7e92-4983-a02d-a56c8edd5ef6 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:33:02.782198 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ebac6-cf1c-47ff-a457-ae9a22bcae14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:33:02.782800 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ebac6-cf1c-47ff-a457-ae9a22bcae14 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:02.783074 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ebac6-cf1c-47ff-a457-ae9a22bcae14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:02.783339 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ebac6-cf1c-47ff-a457-ae9a22bcae14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:02.784905 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-1c1ebac6-cf1c-47ff-a457-ae9a22bcae14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:02.792185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:02.894686 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ebac6-cf1c-47ff-a457-ae9a22bcae14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:33:02.896060 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ebac6-cf1c-47ff-a457-ae9a22bcae14 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:33:02.914650 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 508/997] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:33:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:33:05.698865 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09827a19-105a-47ed-baf5-fe7da5888188 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:05.699391 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09827a19-105a-47ed-baf5-fe7da5888188 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:05.699391 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09827a19-105a-47ed-baf5-fe7da5888188 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:05.700764 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 490/998] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:33:05.706263 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3538ee-6f62-4e1b-8fea-fd291935707a None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:05.706697 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3538ee-6f62-4e1b-8fea-fd291935707a None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:05.706935 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3538ee-6f62-4e1b-8fea-fd291935707a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:05.779514 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-fe3538ee-6f62-4e1b-8fea-fd291935707a None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:33:05.780747 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-fe3538ee-6f62-4e1b-8fea-fd291935707a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:05.845774 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:05.891298 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 509/999] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:33:06.190512 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f091b-7a3c-40fe-bdb2-a8978340061d None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:06.190795 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f091b-7a3c-40fe-bdb2-a8978340061d None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:06.191066 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f091b-7a3c-40fe-bdb2-a8978340061d None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:06.192393 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 491/1000] 10.222.0.17 () {54 vars in 964 bytes} [Thu Oct 20 14:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:33:06.199287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3060f86-aae2-4d73-9d67-50de3385be9e None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:06.199575 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3060f86-aae2-4d73-9d67-50de3385be9e None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:06.199848 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3060f86-aae2-4d73-9d67-50de3385be9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:06.275512 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-a3060f86-aae2-4d73-9d67-50de3385be9e None None] MFA Rules not processed for user `359e9d904b0d43acae86337c1eb6a71d`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:33:06.276719 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a3060f86-aae2-4d73-9d67-50de3385be9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:06.350863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 510/1001] 10.222.0.17 () {58 vars in 1061 bytes} [Thu Oct 20 14:33:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:33:06.360437 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f091b-7a3c-40fe-bdb2-a8978340061d None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:33:06.362034 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e58f091b-7a3c-40fe-bdb2-a8978340061d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:06.382202 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:06.466387 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f091b-7a3c-40fe-bdb2-a8978340061d None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:33:06.539096 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb488e-3cd3-40ee-afe4-121d52d04cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:33:06.539705 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb488e-3cd3-40ee-afe4-121d52d04cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:06.539990 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb488e-3cd3-40ee-afe4-121d52d04cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:06.540262 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb488e-3cd3-40ee-afe4-121d52d04cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:06.542423 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-61cb488e-3cd3-40ee-afe4-121d52d04cb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:06.611419 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:06.648988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb488e-3cd3-40ee-afe4-121d52d04cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:33:06.650573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb488e-3cd3-40ee-afe4-121d52d04cb6 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:33:06.668442 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 492/1002] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:33:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:33:09.117095 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67657e-773b-4380-947d-a3ecd1abac7d None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:09.117616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67657e-773b-4380-947d-a3ecd1abac7d None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:09.117616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67657e-773b-4380-947d-a3ecd1abac7d None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:09.119458 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 511/1003] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:33:09.124810 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d91b2-3bb1-4951-a50b-e2885a45d19b None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:09.125228 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d91b2-3bb1-4951-a50b-e2885a45d19b None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:09.125366 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d91b2-3bb1-4951-a50b-e2885a45d19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:09.195123 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-481d91b2-3bb1-4951-a50b-e2885a45d19b None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:33:09.196344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-481d91b2-3bb1-4951-a50b-e2885a45d19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:09.293749 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 493/1004] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:33:09.579470 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67657e-773b-4380-947d-a3ecd1abac7d None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:33:09.581018 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ac67657e-773b-4380-947d-a3ecd1abac7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:09.644822 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:09.689470 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67657e-773b-4380-947d-a3ecd1abac7d None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:33:09.763399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921907a-b557-461d-8ab0-96c89bf7d0ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:33:09.764011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921907a-b557-461d-8ab0-96c89bf7d0ad service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:09.764293 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921907a-b557-461d-8ab0-96c89bf7d0ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:09.764560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921907a-b557-461d-8ab0-96c89bf7d0ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:09.766190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e921907a-b557-461d-8ab0-96c89bf7d0ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:09.876811 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:09.879410 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921907a-b557-461d-8ab0-96c89bf7d0ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:33:09.881492 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921907a-b557-461d-8ab0-96c89bf7d0ad service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:33:09.900623 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 512/1005] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:33:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:33:12.121064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca2e4c-5672-481b-95db-8f21c08a7145 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:12.121570 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca2e4c-5672-481b-95db-8f21c08a7145 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:12.121654 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca2e4c-5672-481b-95db-8f21c08a7145 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:12.123026 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 494/1006] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:33:12.128291 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99719e00-1bbc-47dd-80f3-5e7ac319319d None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:12.128694 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99719e00-1bbc-47dd-80f3-5e7ac319319d None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:12.128843 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99719e00-1bbc-47dd-80f3-5e7ac319319d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:12.201861 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-99719e00-1bbc-47dd-80f3-5e7ac319319d None None] MFA Rules not processed for user `b2cb9e39aae44ad29f4b41f3797d7ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:33:12.203089 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-99719e00-1bbc-47dd-80f3-5e7ac319319d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:12.304405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 513/1007] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:33:12 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:33:12.583770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca2e4c-5672-481b-95db-8f21c08a7145 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:33:12.585319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-0aca2e4c-5672-481b-95db-8f21c08a7145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:12.617236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:12.691287 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca2e4c-5672-481b-95db-8f21c08a7145 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:33:12.764779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b8ec3-4a63-4056-aab8-088974198e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:33:12.765384 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b8ec3-4a63-4056-aab8-088974198e62 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:12.765663 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b8ec3-4a63-4056-aab8-088974198e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:12.765967 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b8ec3-4a63-4056-aab8-088974198e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:12.767599 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e24b8ec3-4a63-4056-aab8-088974198e62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:12.847264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:12.880644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b8ec3-4a63-4056-aab8-088974198e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:33:12.882148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b8ec3-4a63-4056-aab8-088974198e62 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:33:12.900476 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 495/1008] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:33:12 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:33:15.276592 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ebd76-d659-470d-80c1-cc28c555949b None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:15.277156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ebd76-d659-470d-80c1-cc28c555949b None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:15.277156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ebd76-d659-470d-80c1-cc28c555949b None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:15.278532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 514/1009] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:33:15.283634 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76807fc4-b898-40fd-85d0-b665e4ee4f6c None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:15.284071 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76807fc4-b898-40fd-85d0-b665e4ee4f6c None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:15.284174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76807fc4-b898-40fd-85d0-b665e4ee4f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:15.350237 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-76807fc4-b898-40fd-85d0-b665e4ee4f6c None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:33:15.351446 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-76807fc4-b898-40fd-85d0-b665e4ee4f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:15.447908 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 496/1010] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:33:15.730143 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ebd76-d659-470d-80c1-cc28c555949b None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:33:15.731663 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-f75ebd76-d659-470d-80c1-cc28c555949b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:15.799899 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:15.832688 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ebd76-d659-470d-80c1-cc28c555949b None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:33:15.908506 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4335a18-7b89-46ce-be9f-0816caf82011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:33:15.909107 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4335a18-7b89-46ce-be9f-0816caf82011 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:15.909381 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4335a18-7b89-46ce-be9f-0816caf82011 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:15.909646 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4335a18-7b89-46ce-be9f-0816caf82011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:15.911251 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-f4335a18-7b89-46ce-be9f-0816caf82011 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:16.018004 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4335a18-7b89-46ce-be9f-0816caf82011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:33:16.019362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4335a18-7b89-46ce-be9f-0816caf82011 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:33:16.029601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:16.037648 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 515/1011] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:33:18.232551 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98856f38-ec71-4f9f-9a87-60ea787a0379 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:18.233080 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98856f38-ec71-4f9f-9a87-60ea787a0379 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:18.233080 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98856f38-ec71-4f9f-9a87-60ea787a0379 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:18.234515 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 497/1012] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:33:18.239958 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07210a0d-d6c3-4461-8e98-2e38fb3d1c68 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:18.240386 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07210a0d-d6c3-4461-8e98-2e38fb3d1c68 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:18.240490 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07210a0d-d6c3-4461-8e98-2e38fb3d1c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:18.306522 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-07210a0d-d6c3-4461-8e98-2e38fb3d1c68 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:33:18.307724 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-07210a0d-d6c3-4461-8e98-2e38fb3d1c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:18.402471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 516/1013] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:33:18.688037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98856f38-ec71-4f9f-9a87-60ea787a0379 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:33:18.689610 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-98856f38-ec71-4f9f-9a87-60ea787a0379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:18.729539 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:18.790877 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98856f38-ec71-4f9f-9a87-60ea787a0379 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:33:18.862965 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef48a6-d55c-428a-b94d-75f6a361b57a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:33:18.863568 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef48a6-d55c-428a-b94d-75f6a361b57a service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:18.863844 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef48a6-d55c-428a-b94d-75f6a361b57a service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:18.864110 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef48a6-d55c-428a-b94d-75f6a361b57a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:18.865683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-21ef48a6-d55c-428a-b94d-75f6a361b57a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:18.946068 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:18.971126 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef48a6-d55c-428a-b94d-75f6a361b57a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:33:18.972546 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef48a6-d55c-428a-b94d-75f6a361b57a service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:33:18.990601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 498/1014] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:33:21.438498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccdc99-e5f8-4256-ac14-62b73a2a2c68 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:21.438993 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccdc99-e5f8-4256-ac14-62b73a2a2c68 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:21.438993 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccdc99-e5f8-4256-ac14-62b73a2a2c68 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:21.440306 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 517/1015] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:33:21.445369 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06936920-8c14-464c-b253-3b7c19536bcf None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:21.445787 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06936920-8c14-464c-b253-3b7c19536bcf None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:21.446440 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06936920-8c14-464c-b253-3b7c19536bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:21.511759 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-06936920-8c14-464c-b253-3b7c19536bcf None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:33:21.512957 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-06936920-8c14-464c-b253-3b7c19536bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:21.607597 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 499/1016] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:33:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:33:21.896090 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccdc99-e5f8-4256-ac14-62b73a2a2c68 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:33:21.897651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b8ccdc99-e5f8-4256-ac14-62b73a2a2c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:21.973194 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:21.999873 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccdc99-e5f8-4256-ac14-62b73a2a2c68 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:33:22.074789 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbfe45-9dfa-46a6-ab5c-a608f5496ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:33:22.075400 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbfe45-9dfa-46a6-ab5c-a608f5496ddc service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:22.075678 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbfe45-9dfa-46a6-ab5c-a608f5496ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:22.075943 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbfe45-9dfa-46a6-ab5c-a608f5496ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:22.077522 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-31cbfe45-9dfa-46a6-ab5c-a608f5496ddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:22.187039 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbfe45-9dfa-46a6-ab5c-a608f5496ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:33:22.188479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbfe45-9dfa-46a6-ab5c-a608f5496ddc service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:33:22.206839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 518/1017] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:33:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:33:26.265429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297b586-8025-41ba-adee-c9125896bff0 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:26.265941 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297b586-8025-41ba-adee-c9125896bff0 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:26.265941 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297b586-8025-41ba-adee-c9125896bff0 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:26.267337 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 500/1018] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:33:26.272488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caaf58d-00d0-4768-b6b6-720af43553bc None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:26.272879 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caaf58d-00d0-4768-b6b6-720af43553bc None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:26.273036 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caaf58d-00d0-4768-b6b6-720af43553bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:26.278894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:26.340831 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-7caaf58d-00d0-4768-b6b6-720af43553bc None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:33:26.342058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-7caaf58d-00d0-4768-b6b6-720af43553bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:26.438978 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 519/1019] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:33:26.718680 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297b586-8025-41ba-adee-c9125896bff0 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:33:26.720198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-7297b586-8025-41ba-adee-c9125896bff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:26.768144 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:26.824154 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297b586-8025-41ba-adee-c9125896bff0 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:33:26.898938 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b3965-1d48-4dff-918f-6907273f05f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:33:26.899631 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b3965-1d48-4dff-918f-6907273f05f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:26.899904 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b3965-1d48-4dff-918f-6907273f05f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:26.900171 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b3965-1d48-4dff-918f-6907273f05f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:26.901758 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-8e1b3965-1d48-4dff-918f-6907273f05f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:26.991780 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:27.010244 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b3965-1d48-4dff-918f-6907273f05f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:33:27.011682 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b3965-1d48-4dff-918f-6907273f05f5 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:33:27.029978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 501/1020] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:33:29.907911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08766ba4-617e-48a5-ad63-d914315e2846 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:29.908440 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08766ba4-617e-48a5-ad63-d914315e2846 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:29.908440 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08766ba4-617e-48a5-ad63-d914315e2846 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:29.909863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 520/1021] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:33:29.916107 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d255a72-4c54-4f01-866c-a750a82aa601 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:29.916517 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d255a72-4c54-4f01-866c-a750a82aa601 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:29.916658 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d255a72-4c54-4f01-866c-a750a82aa601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:29.985185 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-2d255a72-4c54-4f01-866c-a750a82aa601 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:33:29.986429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-2d255a72-4c54-4f01-866c-a750a82aa601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:30.086385 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 502/1022] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:33:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:33:30.374565 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08766ba4-617e-48a5-ad63-d914315e2846 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:33:30.376123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-08766ba4-617e-48a5-ad63-d914315e2846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:30.469052 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:30.485945 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08766ba4-617e-48a5-ad63-d914315e2846 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:33:30.559849 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c188af-9054-4dca-a698-97b403f02f86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:33:30.560451 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c188af-9054-4dca-a698-97b403f02f86 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:30.560722 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c188af-9054-4dca-a698-97b403f02f86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:30.561003 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c188af-9054-4dca-a698-97b403f02f86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:30.562589 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-88c188af-9054-4dca-a698-97b403f02f86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:30.674626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c188af-9054-4dca-a698-97b403f02f86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:33:30.676064 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c188af-9054-4dca-a698-97b403f02f86 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:33:30.693839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 521/1023] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:33:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:33:34.798294 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dc07f-f70c-4e29-8bbf-eaf13a1e55da None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:34.798765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dc07f-f70c-4e29-8bbf-eaf13a1e55da None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:34.798856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dc07f-f70c-4e29-8bbf-eaf13a1e55da None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:34.800187 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 503/1024] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:33:34.806070 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9246b-b283-4c8d-9fdf-6a19be2b88c8 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:34.806454 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9246b-b283-4c8d-9fdf-6a19be2b88c8 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:34.806618 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9246b-b283-4c8d-9fdf-6a19be2b88c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:34.825496 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:34.878493 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-73f9246b-b283-4c8d-9fdf-6a19be2b88c8 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:33:34.879708 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-73f9246b-b283-4c8d-9fdf-6a19be2b88c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:34.978356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 522/1025] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:33:35.262861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3dc07f-f70c-4e29-8bbf-eaf13a1e55da None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:33:35.264399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-3d3dc07f-f70c-4e29-8bbf-eaf13a1e55da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:35.322065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:35.368006 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3dc07f-f70c-4e29-8bbf-eaf13a1e55da None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:33:35.449948 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce4a1f-a01e-40fd-9c87-95f49caec282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:33:35.450638 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce4a1f-a01e-40fd-9c87-95f49caec282 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:35.450943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce4a1f-a01e-40fd-9c87-95f49caec282 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:35.451193 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce4a1f-a01e-40fd-9c87-95f49caec282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:35.452787 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-74ce4a1f-a01e-40fd-9c87-95f49caec282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:35.562676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:35.566333 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce4a1f-a01e-40fd-9c87-95f49caec282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:33:35.567805 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce4a1f-a01e-40fd-9c87-95f49caec282 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:33:35.588120 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 504/1026] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:33:40.471366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3917b-8643-4ba7-91f9-0e916452b24e None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:40.471837 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3917b-8643-4ba7-91f9-0e916452b24e None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:40.472123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3917b-8643-4ba7-91f9-0e916452b24e None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:40.473688 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 523/1027] 10.222.0.17 () {54 vars in 921 bytes} [Thu Oct 20 14:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:33:40.480104 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee5307-2130-499f-a970-e6102e1bb628 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:40.480842 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee5307-2130-499f-a970-e6102e1bb628 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:40.481124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee5307-2130-499f-a970-e6102e1bb628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:40.593526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-ebee5307-2130-499f-a970-e6102e1bb628 None None] MFA Rules not processed for user `1e94a60e43914cf38a5f2f88b182083f`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:33:40.594897 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-ebee5307-2130-499f-a970-e6102e1bb628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:40.726482 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 505/1028] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Oct 20 14:33:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:33:44.908114 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1516e9-b49a-4789-95eb-ecd590943d2c None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:44.908705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1516e9-b49a-4789-95eb-ecd590943d2c None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:44.908705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1516e9-b49a-4789-95eb-ecd590943d2c None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:44.910173 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 524/1029] 10.222.0.17 () {54 vars in 921 bytes} [Thu Oct 20 14:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:33:44.915405 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9b96d-802e-4888-bb07-f8a13be71d19 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:44.916529 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9b96d-802e-4888-bb07-f8a13be71d19 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:44.917047 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9b96d-802e-4888-bb07-f8a13be71d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:44.976547 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=59 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:44.980080 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:45.008402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-22b9b96d-802e-4888-bb07-f8a13be71d19 None None] MFA Rules not processed for user `1e94a60e43914cf38a5f2f88b182083f`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:33:45.010177 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-22b9b96d-802e-4888-bb07-f8a13be71d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:45.121333 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 506/1030] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Oct 20 14:33:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:33:46.437703 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de62d9b-5ae0-44b2-8010-d05e44578a77 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:46.438275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de62d9b-5ae0-44b2-8010-d05e44578a77 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:46.438275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de62d9b-5ae0-44b2-8010-d05e44578a77 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:46.439677 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 525/1031] 10.222.0.17 () {54 vars in 921 bytes} [Thu Oct 20 14:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:33:46.445594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a793ad-e7af-490a-b603-ca7b15b62002 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:46.446070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a793ad-e7af-490a-b603-ca7b15b62002 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:46.446327 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a793ad-e7af-490a-b603-ca7b15b62002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:46.522738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-05a793ad-e7af-490a-b603-ca7b15b62002 None None] MFA Rules not processed for user `1e94a60e43914cf38a5f2f88b182083f`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:33:46.523922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-05a793ad-e7af-490a-b603-ca7b15b62002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:46.565158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:46.631120 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 507/1032] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Oct 20 14:33:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:33:50.232394 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1da46d-fd20-4169-a974-a0a57d3c2c15 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:50.232899 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1da46d-fd20-4169-a974-a0a57d3c2c15 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:50.232899 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1da46d-fd20-4169-a974-a0a57d3c2c15 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:50.234206 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 526/1033] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:33:50.239405 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93739933-55fd-4f4b-9d44-727d770b7dd0 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:50.239837 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93739933-55fd-4f4b-9d44-727d770b7dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:50.239952 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93739933-55fd-4f4b-9d44-727d770b7dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:50.309035 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-93739933-55fd-4f4b-9d44-727d770b7dd0 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:33:50.310251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-93739933-55fd-4f4b-9d44-727d770b7dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:50.413987 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 508/1034] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:33:50.713586 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47c8d9-e7e6-4cf2-a6ec-244341da4ffa None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:50.714205 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47c8d9-e7e6-4cf2-a6ec-244341da4ffa None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:50.714686 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47c8d9-e7e6-4cf2-a6ec-244341da4ffa None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:50.716194 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 527/1035] 10.222.0.17 () {54 vars in 961 bytes} [Thu Oct 20 14:33:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:33:50.725662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce5f4e-02c7-4a03-ae4e-7bdbb47c0481 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:50.725971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce5f4e-02c7-4a03-ae4e-7bdbb47c0481 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:50.726242 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce5f4e-02c7-4a03-ae4e-7bdbb47c0481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:50.759645 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:50.837224 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-40ce5f4e-02c7-4a03-ae4e-7bdbb47c0481 None None] MFA Rules not processed for user `172b859c0d774c8f8a98ce23bdc237d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:33:50.838431 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-40ce5f4e-02c7-4a03-ae4e-7bdbb47c0481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:50.975824 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 509/1036] 10.222.0.17 () {58 vars in 1058 bytes} [Thu Oct 20 14:33:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:33:50.983509 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47c8d9-e7e6-4cf2-a6ec-244341da4ffa None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:33:50.985241 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-db47c8d9-e7e6-4cf2-a6ec-244341da4ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:51.148077 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47c8d9-e7e6-4cf2-a6ec-244341da4ffa None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:33:51.235561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:51.284201 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c471bb-1ef7-4907-9a1a-4d0b6dd8543d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:33:51.284809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c471bb-1ef7-4907-9a1a-4d0b6dd8543d service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:51.285082 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c471bb-1ef7-4907-9a1a-4d0b6dd8543d service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:51.285348 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c471bb-1ef7-4907-9a1a-4d0b6dd8543d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:51.286923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-38c471bb-1ef7-4907-9a1a-4d0b6dd8543d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:51.384199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c471bb-1ef7-4907-9a1a-4d0b6dd8543d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:33:51.385799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c471bb-1ef7-4907-9a1a-4d0b6dd8543d service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:33:51.404687 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 528/1037] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:33:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:33:53.789649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7f64f-b23a-42de-9033-221eb691e5c0 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:53.790227 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7f64f-b23a-42de-9033-221eb691e5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:53.790506 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7f64f-b23a-42de-9033-221eb691e5c0 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:53.792293 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 510/1038] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:33:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:33:53.797731 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f42a6c-4ed2-40d9-8c6a-e0fc9142733c None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:53.798227 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f42a6c-4ed2-40d9-8c6a-e0fc9142733c None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:53.798327 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f42a6c-4ed2-40d9-8c6a-e0fc9142733c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:53.871135 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-56f42a6c-4ed2-40d9-8c6a-e0fc9142733c None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:33:53.872443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-56f42a6c-4ed2-40d9-8c6a-e0fc9142733c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:53.913794 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:53.978390 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 529/1039] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:33:54.269025 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7f64f-b23a-42de-9033-221eb691e5c0 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:33:54.270725 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-adf7f64f-b23a-42de-9033-221eb691e5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:54.362534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:54.459570 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7f64f-b23a-42de-9033-221eb691e5c0 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:33:54.592531 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2c15a-e893-467c-8b01-66bea1f130cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:33:54.593225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2c15a-e893-467c-8b01-66bea1f130cb service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:54.593500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2c15a-e893-467c-8b01-66bea1f130cb service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:54.593761 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2c15a-e893-467c-8b01-66bea1f130cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:54.595384 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-32b2c15a-e893-467c-8b01-66bea1f130cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:54.618504 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:54.687813 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2c15a-e893-467c-8b01-66bea1f130cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:33:54.689398 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2c15a-e893-467c-8b01-66bea1f130cb service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:33:54.707498 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 511/1040] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:33:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:33:57.188788 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce6e70-9349-40da-84af-882d3e45e23a None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:57.189231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce6e70-9349-40da-84af-882d3e45e23a None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:57.189442 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce6e70-9349-40da-84af-882d3e45e23a None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:57.195317 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 530/1041] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:33:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:33:57.196910 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f0b68-1b46-4478-b71a-6600c9755a0e None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:57.197333 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f0b68-1b46-4478-b71a-6600c9755a0e None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:57.197497 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f0b68-1b46-4478-b71a-6600c9755a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:57.270427 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-1c8f0b68-1b46-4478-b71a-6600c9755a0e None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:33:57.271847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-1c8f0b68-1b46-4478-b71a-6600c9755a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:57.378613 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:57.384918 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 512/1042] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:33:57.671272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697bcd6-5857-40ac-89d1-f6e74919f5bd None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:57.671553 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697bcd6-5857-40ac-89d1-f6e74919f5bd None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:57.672020 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697bcd6-5857-40ac-89d1-f6e74919f5bd None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:57.673327 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 531/1043] 10.222.0.17 () {54 vars in 961 bytes} [Thu Oct 20 14:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:33:57.679444 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfbf00-6236-4184-9c85-d40256b03a38 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:57.679910 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfbf00-6236-4184-9c85-d40256b03a38 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:57.680360 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfbf00-6236-4184-9c85-d40256b03a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:57.760845 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-5bbfbf00-6236-4184-9c85-d40256b03a38 None None] MFA Rules not processed for user `172b859c0d774c8f8a98ce23bdc237d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:33:57.762247 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-5bbfbf00-6236-4184-9c85-d40256b03a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:57.890737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 513/1044] 10.222.0.17 () {58 vars in 1058 bytes} [Thu Oct 20 14:33:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:33:57.899119 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697bcd6-5857-40ac-89d1-f6e74919f5bd None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:33:57.901000 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b697bcd6-5857-40ac-89d1-f6e74919f5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:58.057582 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697bcd6-5857-40ac-89d1-f6e74919f5bd None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:33:58.078063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:58.188508 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6211ff4-a053-47b1-bb87-5ee62beafa7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:33:58.189154 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6211ff4-a053-47b1-bb87-5ee62beafa7b service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:58.189743 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6211ff4-a053-47b1-bb87-5ee62beafa7b service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:58.189743 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6211ff4-a053-47b1-bb87-5ee62beafa7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:58.191685 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e6211ff4-a053-47b1-bb87-5ee62beafa7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:58.291338 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6211ff4-a053-47b1-bb87-5ee62beafa7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:33:58.293042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6211ff4-a053-47b1-bb87-5ee62beafa7b service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:33:58.298442 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d58aa-b5e7-422b-a756-3ad28dcf379b None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:58.298908 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d58aa-b5e7-422b-a756-3ad28dcf379b None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:58.298998 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d58aa-b5e7-422b-a756-3ad28dcf379b None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:58.300323 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 514/1045] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:33:58.305446 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a570ec-c234-4a2d-94e3-a064f3c46e8b None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:58.305733 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a570ec-c234-4a2d-94e3-a064f3c46e8b None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:58.306038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a570ec-c234-4a2d-94e3-a064f3c46e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:58.313658 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 532/1046] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:33:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:33:58.372608 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:58.381410 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-e0a570ec-c234-4a2d-94e3-a064f3c46e8b None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:33:58.382706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e0a570ec-c234-4a2d-94e3-a064f3c46e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:58.503868 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 515/1047] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:33:58.839568 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca85cb-e414-4641-9108-82dc6719635d None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:58.839926 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca85cb-e414-4641-9108-82dc6719635d None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:58.840276 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca85cb-e414-4641-9108-82dc6719635d None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:58.841960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 533/1048] 10.222.0.17 () {54 vars in 963 bytes} [Thu Oct 20 14:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:33:58.846730 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee225eb-0c9a-4854-982e-3ce26aa72d3f None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:58.847124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee225eb-0c9a-4854-982e-3ce26aa72d3f None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:58.847542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee225eb-0c9a-4854-982e-3ce26aa72d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:58.937242 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-1ee225eb-0c9a-4854-982e-3ce26aa72d3f None None] MFA Rules not processed for user `c1f0806ae4544d7b99d4d6e3b5069b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:33:58.938644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-1ee225eb-0c9a-4854-982e-3ce26aa72d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:59.016306 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:59.025153 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 516/1049] 10.222.0.17 () {58 vars in 1060 bytes} [Thu Oct 20 14:33:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:33:59.033569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca85cb-e414-4641-9108-82dc6719635d None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:33:59.035101 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-9cca85cb-e414-4641-9108-82dc6719635d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:59.066745 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:59.148584 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca85cb-e414-4641-9108-82dc6719635d None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:33:59.240701 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638b51e-8127-4c0f-b034-ed7414d27b85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:33:59.241326 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638b51e-8127-4c0f-b034-ed7414d27b85 service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:33:59.241412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638b51e-8127-4c0f-b034-ed7414d27b85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:33:59.241664 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638b51e-8127-4c0f-b034-ed7414d27b85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:33:59.243307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-3638b51e-8127-4c0f-b034-ed7414d27b85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:33:59.378814 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:59.427134 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638b51e-8127-4c0f-b034-ed7414d27b85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:33:59.428709 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638b51e-8127-4c0f-b034-ed7414d27b85 service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:33:59.449452 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 534/1050] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:33:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:34:00.534908 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b95305-ec74-42af-acbf-b6856cb7031b None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:00.535416 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b95305-ec74-42af-acbf-b6856cb7031b None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:00.535416 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b95305-ec74-42af-acbf-b6856cb7031b None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:00.537757 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 517/1051] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:34:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:34:00.543496 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0123e-6310-49ea-9bbd-909f47788066 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:00.543896 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0123e-6310-49ea-9bbd-909f47788066 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:00.544054 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0123e-6310-49ea-9bbd-909f47788066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:00.610786 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-13d0123e-6310-49ea-9bbd-909f47788066 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:00.612015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-13d0123e-6310-49ea-9bbd-909f47788066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:00.711972 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 535/1052] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:01.004622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b95305-ec74-42af-acbf-b6856cb7031b None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:34:01.006384 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-35b95305-ec74-42af-acbf-b6856cb7031b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:01.161004 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b95305-ec74-42af-acbf-b6856cb7031b None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:34:01.231319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:01.279633 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80af1db-5483-4f49-8d17-861e5372204d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:34:01.280243 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80af1db-5483-4f49-8d17-861e5372204d service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:01.280522 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80af1db-5483-4f49-8d17-861e5372204d service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:01.280790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80af1db-5483-4f49-8d17-861e5372204d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:01.282535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d80af1db-5483-4f49-8d17-861e5372204d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:01.376408 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80af1db-5483-4f49-8d17-861e5372204d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:34:01.377793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80af1db-5483-4f49-8d17-861e5372204d service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:34:01.398361 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 518/1053] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:34:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:34:03.648015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3449066-c5e9-47e5-ba63-e603cd315274 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:03.648561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3449066-c5e9-47e5-ba63-e603cd315274 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:03.648561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3449066-c5e9-47e5-ba63-e603cd315274 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:03.650030 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 536/1054] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:34:03.655200 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6970e61-9e01-43a6-86a2-cfcb257b16fa None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:03.655619 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6970e61-9e01-43a6-86a2-cfcb257b16fa None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:03.655814 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6970e61-9e01-43a6-86a2-cfcb257b16fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:03.728227 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-d6970e61-9e01-43a6-86a2-cfcb257b16fa None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:03.729454 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d6970e61-9e01-43a6-86a2-cfcb257b16fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:03.761471 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:03.832294 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 519/1055] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:04.124409 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3449066-c5e9-47e5-ba63-e603cd315274 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:34:04.125990 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-f3449066-c5e9-47e5-ba63-e603cd315274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:04.164011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:04.282497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3449066-c5e9-47e5-ba63-e603cd315274 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:34:04.394180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:04.400537 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb520e-2419-4b55-9d68-f2837637d5fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:34:04.401421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb520e-2419-4b55-9d68-f2837637d5fc service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:04.401791 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb520e-2419-4b55-9d68-f2837637d5fc service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:04.402406 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb520e-2419-4b55-9d68-f2837637d5fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:04.404092 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-1cbb520e-2419-4b55-9d68-f2837637d5fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:04.497596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb520e-2419-4b55-9d68-f2837637d5fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:34:04.499393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb520e-2419-4b55-9d68-f2837637d5fc service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:34:04.520989 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 537/1056] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:34:06.736308 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e49e53-a625-4f02-9241-eb4ac3c07b63 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:06.736740 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e49e53-a625-4f02-9241-eb4ac3c07b63 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:06.736873 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e49e53-a625-4f02-9241-eb4ac3c07b63 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:06.741951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 520/1057] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:34:06.743856 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95104704-fe45-4adf-90eb-10f1658da31b None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:06.744268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95104704-fe45-4adf-90eb-10f1658da31b None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:06.744452 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95104704-fe45-4adf-90eb-10f1658da31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:06.822668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-95104704-fe45-4adf-90eb-10f1658da31b None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:06.825163 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-95104704-fe45-4adf-90eb-10f1658da31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:06.915725 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:06.956245 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 538/1058] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:07.309561 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e49e53-a625-4f02-9241-eb4ac3c07b63 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:34:07.311107 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-85e49e53-a625-4f02-9241-eb4ac3c07b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:07.464225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e49e53-a625-4f02-9241-eb4ac3c07b63 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:34:07.478254 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:07.581051 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c5fab-89a8-4346-b545-5a313617104e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:34:07.581654 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c5fab-89a8-4346-b545-5a313617104e service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:07.581954 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c5fab-89a8-4346-b545-5a313617104e service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:07.582220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c5fab-89a8-4346-b545-5a313617104e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:07.584599 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-bb1c5fab-89a8-4346-b545-5a313617104e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:07.675126 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c5fab-89a8-4346-b545-5a313617104e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:34:07.676952 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c5fab-89a8-4346-b545-5a313617104e service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:34:07.696502 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 521/1059] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:34:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:34:09.878062 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8551e9-43cb-4f5c-8e17-bb3bf946c9c9 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:09.878715 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8551e9-43cb-4f5c-8e17-bb3bf946c9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:09.878715 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8551e9-43cb-4f5c-8e17-bb3bf946c9c9 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:09.880432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 539/1060] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:34:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:34:09.885821 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c867a2e-373a-40bc-a09c-3ce28803e42c None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:09.886256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c867a2e-373a-40bc-a09c-3ce28803e42c None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:09.886469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c867a2e-373a-40bc-a09c-3ce28803e42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:09.907686 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:09.955041 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-7c867a2e-373a-40bc-a09c-3ce28803e42c None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:09.956252 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-7c867a2e-373a-40bc-a09c-3ce28803e42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:10.059477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 522/1061] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:10.376147 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8551e9-43cb-4f5c-8e17-bb3bf946c9c9 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:34:10.377677 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ff8551e9-43cb-4f5c-8e17-bb3bf946c9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:10.520920 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8551e9-43cb-4f5c-8e17-bb3bf946c9c9 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:34:10.575048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:10.638651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0f133-869d-4cdc-b3df-9fe33ec29016 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:34:10.639293 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0f133-869d-4cdc-b3df-9fe33ec29016 service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:10.639577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0f133-869d-4cdc-b3df-9fe33ec29016 service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:10.639849 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0f133-869d-4cdc-b3df-9fe33ec29016 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:10.641442 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2bb0f133-869d-4cdc-b3df-9fe33ec29016 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:10.736138 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0f133-869d-4cdc-b3df-9fe33ec29016 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:34:10.737738 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0f133-869d-4cdc-b3df-9fe33ec29016 service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:34:10.756618 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 540/1062] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:34:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:34:12.950861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8937ab8-5262-49dd-8816-33f4b6211b09 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:12.951546 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8937ab8-5262-49dd-8816-33f4b6211b09 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:12.951546 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8937ab8-5262-49dd-8816-33f4b6211b09 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:12.952746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 523/1063] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:34:12.958464 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957f36a-5644-4224-b8cd-0357cedbd41a None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:12.958926 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957f36a-5644-4224-b8cd-0357cedbd41a None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:12.959142 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957f36a-5644-4224-b8cd-0357cedbd41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:13.036429 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-8957f36a-5644-4224-b8cd-0357cedbd41a None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:13.037645 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-8957f36a-5644-4224-b8cd-0357cedbd41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:13.046270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:13.135191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 541/1064] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:13.424262 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8937ab8-5262-49dd-8816-33f4b6211b09 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:34:13.425773 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a8937ab8-5262-49dd-8816-33f4b6211b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:13.517461 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:13.577721 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8937ab8-5262-49dd-8816-33f4b6211b09 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:34:13.698468 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e69b3e-a690-4f74-97f8-915c25f4eab8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:34:13.698985 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e69b3e-a690-4f74-97f8-915c25f4eab8 service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:13.699261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e69b3e-a690-4f74-97f8-915c25f4eab8 service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:13.699527 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e69b3e-a690-4f74-97f8-915c25f4eab8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:13.701129 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-56e69b3e-a690-4f74-97f8-915c25f4eab8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:13.771439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:13.802186 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e69b3e-a690-4f74-97f8-915c25f4eab8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:34:13.803779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e69b3e-a690-4f74-97f8-915c25f4eab8 service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:34:13.822175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 524/1065] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:34:15.395363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5a1f8-6e63-4b99-8d81-58ffdfb6ead7 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:15.395836 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5a1f8-6e63-4b99-8d81-58ffdfb6ead7 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:15.395942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5a1f8-6e63-4b99-8d81-58ffdfb6ead7 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:15.397242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 542/1066] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:34:15.402625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca9394-9413-4d08-be87-c43cb91b98b3 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:15.403067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca9394-9413-4d08-be87-c43cb91b98b3 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:15.403250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca9394-9413-4d08-be87-c43cb91b98b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:15.470980 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-d0ca9394-9413-4d08-be87-c43cb91b98b3 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:15.472228 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d0ca9394-9413-4d08-be87-c43cb91b98b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:15.569465 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 525/1067] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:15.870199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468a025-7561-42de-bad3-4ee7c3280d5a None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:15.870563 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468a025-7561-42de-bad3-4ee7c3280d5a None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:15.870911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468a025-7561-42de-bad3-4ee7c3280d5a None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:15.872350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 543/1068] 10.222.0.17 () {54 vars in 962 bytes} [Thu Oct 20 14:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:34:15.877709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27caaf-7c79-4479-b7cf-11b8e7e7109a None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:15.878043 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27caaf-7c79-4479-b7cf-11b8e7e7109a None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:15.878322 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27caaf-7c79-4479-b7cf-11b8e7e7109a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:15.929654 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:15.964198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-bb27caaf-7c79-4479-b7cf-11b8e7e7109a None None] MFA Rules not processed for user `077f50ca034b4d12817543377815393b`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:15.965416 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-bb27caaf-7c79-4479-b7cf-11b8e7e7109a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:16.013367 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eab03f-7307-470b-b8f2-09a9c39dcf53 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:16.013655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eab03f-7307-470b-b8f2-09a9c39dcf53 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:16.013986 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eab03f-7307-470b-b8f2-09a9c39dcf53 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:16.015325 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 544/1069] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:34:16.020895 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3a188-214d-4f02-9630-4934902b20ec None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:16.021182 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3a188-214d-4f02-9630-4934902b20ec None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:16.021457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3a188-214d-4f02-9630-4934902b20ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:16.041299 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 526/1070] 10.222.0.17 () {58 vars in 1059 bytes} [Thu Oct 20 14:34:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:16.050188 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27caaf-7c79-4479-b7cf-11b8e7e7109a None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:34:16.057725 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27caaf-7c79-4479-b7cf-11b8e7e7109a None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:34:16.090561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-61d3a188-214d-4f02-9630-4934902b20ec None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:16.091686 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-61d3a188-214d-4f02-9630-4934902b20ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:16.139287 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191148a-88d4-4d98-93ab-b7601d16e074 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '077f50ca034b4d12817543377815393b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:34:16.139926 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191148a-88d4-4d98-93ab-b7601d16e074 service glance] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:16.140207 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191148a-88d4-4d98-93ab-b7601d16e074 service glance] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:16.140486 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191148a-88d4-4d98-93ab-b7601d16e074 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:16.142137 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-4191148a-88d4-4d98-93ab-b7601d16e074 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:16.188603 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:16.201747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:16.203118 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 545/1071] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:34:16.275961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191148a-88d4-4d98-93ab-b7601d16e074 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:34:16.277389 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191148a-88d4-4d98-93ab-b7601d16e074 service glance] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:34:16.295897 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 527/1072] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:34:16.491722 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3a188-214d-4f02-9630-4934902b20ec None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:34:16.493065 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-61d3a188-214d-4f02-9630-4934902b20ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:16.612240 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3a188-214d-4f02-9630-4934902b20ec None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:34:16.726948 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:16.739356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4d7f0-a2a9-4039-a395-58795f8bf2dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:34:16.740067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4d7f0-a2a9-4039-a395-58795f8bf2dd service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:16.740358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4d7f0-a2a9-4039-a395-58795f8bf2dd service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:16.740683 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4d7f0-a2a9-4039-a395-58795f8bf2dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:16.742303 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-0ec4d7f0-a2a9-4039-a395-58795f8bf2dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:16.834723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4d7f0-a2a9-4039-a395-58795f8bf2dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:34:16.836422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4d7f0-a2a9-4039-a395-58795f8bf2dd service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:34:16.855016 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 546/1073] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:34:17.050031 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb0c96-a042-4547-a653-ec80a5295334 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:17.050638 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb0c96-a042-4547-a653-ec80a5295334 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:17.050638 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb0c96-a042-4547-a653-ec80a5295334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:17.122610 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-3ceb0c96-a042-4547-a653-ec80a5295334 None None] MFA Rules not processed for user `a1bdbce1b3d047cfa5ddf72f902ecd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:17.123814 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-3ceb0c96-a042-4547-a653-ec80a5295334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:17.221612 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 528/1074] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Oct 20 14:34:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:17.267366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798495d-a191-4b10-a8c2-a955e709881b None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:17.267656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798495d-a191-4b10-a8c2-a955e709881b None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:17.267935 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798495d-a191-4b10-a8c2-a955e709881b None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:17.270031 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 547/1075] 10.222.0.17 () {54 vars in 943 bytes} [Thu Oct 20 14:34:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:34:17.276690 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa5ec0-d04f-4a0e-8bfd-f41b76d62b4a None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:17.277078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa5ec0-d04f-4a0e-8bfd-f41b76d62b4a None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:17.277351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa5ec0-d04f-4a0e-8bfd-f41b76d62b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:17.301816 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:17.355586 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-d0fa5ec0-d04f-4a0e-8bfd-f41b76d62b4a None None] MFA Rules not processed for user `8d60d62d14cd4042ab1bff5509e30f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:17.356846 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d0fa5ec0-d04f-4a0e-8bfd-f41b76d62b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:17.464725 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 529/1076] 10.222.0.17 () {58 vars in 1040 bytes} [Thu Oct 20 14:34:17 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:17.474219 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798495d-a191-4b10-a8c2-a955e709881b None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:34:17.475737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-8798495d-a191-4b10-a8c2-a955e709881b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:17.584434 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:17.613298 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798495d-a191-4b10-a8c2-a955e709881b None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:34:17.719465 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecbc18-e543-4c2e-a86c-908de9771184 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60d62d14cd4042ab1bff5509e30f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:34:17.720074 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecbc18-e543-4c2e-a86c-908de9771184 service swift] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:17.720353 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecbc18-e543-4c2e-a86c-908de9771184 service swift] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:17.720621 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecbc18-e543-4c2e-a86c-908de9771184 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:17.722275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-11ecbc18-e543-4c2e-a86c-908de9771184 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:17.808879 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecbc18-e543-4c2e-a86c-908de9771184 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:34:17.810511 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecbc18-e543-4c2e-a86c-908de9771184 service swift] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:34:17.819123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 548/1077] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Oct 20 14:34:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 14:34:19.127184 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c347d-915e-4ef8-82fa-8744575e6a78 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:19.127837 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c347d-915e-4ef8-82fa-8744575e6a78 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:19.127837 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c347d-915e-4ef8-82fa-8744575e6a78 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:19.129297 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 530/1078] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:34:19.134611 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee83089-b1c3-441a-8dc8-4a9c62603e3b None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:19.135067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee83089-b1c3-441a-8dc8-4a9c62603e3b None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:19.135166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee83089-b1c3-441a-8dc8-4a9c62603e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:19.148008 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:19.214150 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-bee83089-b1c3-441a-8dc8-4a9c62603e3b None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:19.215352 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-bee83089-b1c3-441a-8dc8-4a9c62603e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:19.319945 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 549/1079] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:19.608485 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c347d-915e-4ef8-82fa-8744575e6a78 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:34:19.610374 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-3d0c347d-915e-4ef8-82fa-8744575e6a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:19.697657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:19.772906 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c347d-915e-4ef8-82fa-8744575e6a78 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:34:19.897337 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4539a8-3d09-43b4-81e9-fe5494837f56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:34:19.897974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4539a8-3d09-43b4-81e9-fe5494837f56 service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:19.898252 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4539a8-3d09-43b4-81e9-fe5494837f56 service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:19.898523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4539a8-3d09-43b4-81e9-fe5494837f56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:19.900137 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-fc4539a8-3d09-43b4-81e9-fe5494837f56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:19.945461 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:19.999794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4539a8-3d09-43b4-81e9-fe5494837f56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:34:20.001287 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4539a8-3d09-43b4-81e9-fe5494837f56 service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:34:20.024177 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 531/1080] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:34:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:34:22.259616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52f5ac-8c64-470e-9ab8-d2cd59a77a5c None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:22.260158 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52f5ac-8c64-470e-9ab8-d2cd59a77a5c None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:22.260158 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52f5ac-8c64-470e-9ab8-d2cd59a77a5c None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:22.261385 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 550/1081] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:34:22.266724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb90bd0-a72f-4f2b-8d93-a090159769ba None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:22.267114 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb90bd0-a72f-4f2b-8d93-a090159769ba None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:22.267305 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb90bd0-a72f-4f2b-8d93-a090159769ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:22.340259 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-2eb90bd0-a72f-4f2b-8d93-a090159769ba None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:22.341608 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-2eb90bd0-a72f-4f2b-8d93-a090159769ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:22.450440 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 532/1082] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:22.741445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52f5ac-8c64-470e-9ab8-d2cd59a77a5c None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:34:22.743004 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-1c52f5ac-8c64-470e-9ab8-d2cd59a77a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:22.884055 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:22.982679 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52f5ac-8c64-470e-9ab8-d2cd59a77a5c None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:34:23.115043 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320dba4-8ccc-4b6b-a5b7-671cb1398d16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:34:23.116302 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320dba4-8ccc-4b6b-a5b7-671cb1398d16 service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:23.116592 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320dba4-8ccc-4b6b-a5b7-671cb1398d16 service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:23.116866 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320dba4-8ccc-4b6b-a5b7-671cb1398d16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:23.118499 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-1320dba4-8ccc-4b6b-a5b7-671cb1398d16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:23.190255 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:23.239064 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320dba4-8ccc-4b6b-a5b7-671cb1398d16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:34:23.240605 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320dba4-8ccc-4b6b-a5b7-671cb1398d16 service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:34:23.261289 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 551/1083] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:34:25.535859 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2d16a-ca86-45d7-a6ff-5c73b871bcf8 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:25.536385 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2d16a-ca86-45d7-a6ff-5c73b871bcf8 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:25.536385 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2d16a-ca86-45d7-a6ff-5c73b871bcf8 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:25.537894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 533/1084] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:34:25.543234 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d254f9-1a97-48ee-9993-4ef3b9a3a7a5 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:25.543679 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d254f9-1a97-48ee-9993-4ef3b9a3a7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:25.543787 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d254f9-1a97-48ee-9993-4ef3b9a3a7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:25.617367 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-98d254f9-1a97-48ee-9993-4ef3b9a3a7a5 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:25.618703 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-98d254f9-1a97-48ee-9993-4ef3b9a3a7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:25.724691 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 552/1085] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:34:26.012175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2d16a-ca86-45d7-a6ff-5c73b871bcf8 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:34:26.015967 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-faa2d16a-ca86-45d7-a6ff-5c73b871bcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:26.033315 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:26.181053 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2d16a-ca86-45d7-a6ff-5c73b871bcf8 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:34:26.289894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:26.318433 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5518fa4-b27d-46cb-b649-f7d36d4d177a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:34:26.319046 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5518fa4-b27d-46cb-b649-f7d36d4d177a service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:26.319324 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5518fa4-b27d-46cb-b649-f7d36d4d177a service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:26.319596 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5518fa4-b27d-46cb-b649-f7d36d4d177a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:26.321314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e5518fa4-b27d-46cb-b649-f7d36d4d177a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:26.419239 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5518fa4-b27d-46cb-b649-f7d36d4d177a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:34:26.420887 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5518fa4-b27d-46cb-b649-f7d36d4d177a service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:34:26.441661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 534/1086] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:34:35.723097 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=88 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:36.438892 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=55 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:40.350119 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a5707-54a0-49ba-96ba-0bc38b256708 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:40.350676 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a5707-54a0-49ba-96ba-0bc38b256708 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:40.350676 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a5707-54a0-49ba-96ba-0bc38b256708 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:40.352004 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 553/1087] 10.222.0.17 () {54 vars in 918 bytes} [Thu Oct 20 14:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:34:40.357015 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c183cc8-be05-4f12-b07e-58758f480467 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:40.357446 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c183cc8-be05-4f12-b07e-58758f480467 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:40.357551 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c183cc8-be05-4f12-b07e-58758f480467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:40.434208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-8c183cc8-be05-4f12-b07e-58758f480467 None None] MFA Rules not processed for user `1e94a60e43914cf38a5f2f88b182083f`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:40.435340 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-8c183cc8-be05-4f12-b07e-58758f480467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:40.540551 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 535/1088] 10.222.0.17 () {58 vars in 1015 bytes} [Thu Oct 20 14:34:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:40.554588 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3950003-0bbb-466d-bea4-d49fb36410d3 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:40.554873 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3950003-0bbb-466d-bea4-d49fb36410d3 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:40.555144 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3950003-0bbb-466d-bea4-d49fb36410d3 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:40.556446 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 554/1089] 10.222.0.17 () {54 vars in 918 bytes} [Thu Oct 20 14:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:34:40.560781 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5a756-af17-4ce0-be31-292b9ef7db75 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:40.561069 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5a756-af17-4ce0-be31-292b9ef7db75 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:40.561346 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5a756-af17-4ce0-be31-292b9ef7db75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:40.632210 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:40.635253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-5ef5a756-af17-4ce0-be31-292b9ef7db75 None None] MFA Rules not processed for user `172b859c0d774c8f8a98ce23bdc237d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:40.637002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-5ef5a756-af17-4ce0-be31-292b9ef7db75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:40.751085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 536/1090] 10.222.0.17 () {58 vars in 1015 bytes} [Thu Oct 20 14:34:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:43.312960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78aabf-2635-48a0-8a92-cbaf30d45f8f None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:43.313535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78aabf-2635-48a0-8a92-cbaf30d45f8f None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:43.313535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78aabf-2635-48a0-8a92-cbaf30d45f8f None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:43.315672 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 555/1091] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 14:34:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:34:43.320998 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe45e2-b42b-4502-bfc2-1086fed1dd19 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:43.321417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe45e2-b42b-4502-bfc2-1086fed1dd19 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:43.321545 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe45e2-b42b-4502-bfc2-1086fed1dd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:43.388056 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-81fe45e2-b42b-4502-bfc2-1086fed1dd19 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:43.389252 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-81fe45e2-b42b-4502-bfc2-1086fed1dd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:43.445601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:43.487448 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 537/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 14:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:43.778150 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78aabf-2635-48a0-8a92-cbaf30d45f8f None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:34:43.779843 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-fe78aabf-2635-48a0-8a92-cbaf30d45f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:43.923184 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78aabf-2635-48a0-8a92-cbaf30d45f8f None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:34:43.994508 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:44.035420 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17344659-c1c7-4117-8cef-6f055d0788d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:34:44.035956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17344659-c1c7-4117-8cef-6f055d0788d4 service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:44.036233 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17344659-c1c7-4117-8cef-6f055d0788d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:44.036504 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17344659-c1c7-4117-8cef-6f055d0788d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:44.038123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-17344659-c1c7-4117-8cef-6f055d0788d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:44.124835 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17344659-c1c7-4117-8cef-6f055d0788d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:34:44.127153 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17344659-c1c7-4117-8cef-6f055d0788d4 service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:34:44.144946 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 556/1093] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:34:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:34:45.285553 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fb332-bc9d-4e31-af5d-394c4b4f7193 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:45.286118 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fb332-bc9d-4e31-af5d-394c4b4f7193 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:45.286118 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fb332-bc9d-4e31-af5d-394c4b4f7193 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:45.287524 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 538/1094] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 14:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:34:45.293980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb3fa1-7f1a-4785-b911-f107677a1e23 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:45.294456 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb3fa1-7f1a-4785-b911-f107677a1e23 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:45.294559 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb3fa1-7f1a-4785-b911-f107677a1e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:45.369750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-cfbb3fa1-7f1a-4785-b911-f107677a1e23 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:45.370979 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-cfbb3fa1-7f1a-4785-b911-f107677a1e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:45.397979 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:45.467309 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 557/1095] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 14:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:45.615444 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fb332-bc9d-4e31-af5d-394c4b4f7193 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:34:45.616995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d45fb332-bc9d-4e31-af5d-394c4b4f7193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:45.761616 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fb332-bc9d-4e31-af5d-394c4b4f7193 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:34:45.803075 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:45.876910 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ce0cd-ec97-4c8a-93aa-856a06418608 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:34:45.877682 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ce0cd-ec97-4c8a-93aa-856a06418608 service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:45.877997 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ce0cd-ec97-4c8a-93aa-856a06418608 service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:45.878275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ce0cd-ec97-4c8a-93aa-856a06418608 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:45.879885 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-cf8ce0cd-ec97-4c8a-93aa-856a06418608 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:45.966953 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ce0cd-ec97-4c8a-93aa-856a06418608 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:34:45.968523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ce0cd-ec97-4c8a-93aa-856a06418608 service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:34:45.986897 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 539/1096] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:34:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:34:47.136242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d1f19-c8ce-4d63-b4ec-dbfd741a1ebc None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:47.136839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d1f19-c8ce-4d63-b4ec-dbfd741a1ebc None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:47.136839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d1f19-c8ce-4d63-b4ec-dbfd741a1ebc None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:47.138167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 558/1097] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 14:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:34:47.144865 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a9484-d112-44b4-9c2a-3bedb74cc55d None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:47.145316 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a9484-d112-44b4-9c2a-3bedb74cc55d None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:47.145409 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a9484-d112-44b4-9c2a-3bedb74cc55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:47.200924 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:47.225543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-1c9a9484-d112-44b4-9c2a-3bedb74cc55d None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:47.226777 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-1c9a9484-d112-44b4-9c2a-3bedb74cc55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:47.319611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 540/1098] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 14:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:47.469302 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d1f19-c8ce-4d63-b4ec-dbfd741a1ebc None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:34:47.471388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-c37d1f19-c8ce-4d63-b4ec-dbfd741a1ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:47.614994 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d1f19-c8ce-4d63-b4ec-dbfd741a1ebc None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:34:47.627022 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:47.725360 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e39e0c-92ae-40c9-a421-adb9acadd0c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:34:47.725912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e39e0c-92ae-40c9-a421-adb9acadd0c5 service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:47.726196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e39e0c-92ae-40c9-a421-adb9acadd0c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:47.726468 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e39e0c-92ae-40c9-a421-adb9acadd0c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:47.728059 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-18e39e0c-92ae-40c9-a421-adb9acadd0c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:47.816015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e39e0c-92ae-40c9-a421-adb9acadd0c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:34:47.817601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e39e0c-92ae-40c9-a421-adb9acadd0c5 service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:34:47.835861 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 559/1099] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:34:48.958586 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83ca67-5f24-4249-84eb-d9dfbb0eb8cd None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:48.959149 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83ca67-5f24-4249-84eb-d9dfbb0eb8cd None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:48.959149 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83ca67-5f24-4249-84eb-d9dfbb0eb8cd None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:48.960549 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 541/1100] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 14:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:34:48.966735 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbe169-edd1-48f3-8adb-e29d9ee70dd2 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:48.967188 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbe169-edd1-48f3-8adb-e29d9ee70dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:48.967298 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbe169-edd1-48f3-8adb-e29d9ee70dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:48.986692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:49.044082 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-0ddbe169-edd1-48f3-8adb-e29d9ee70dd2 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:49.045292 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-0ddbe169-edd1-48f3-8adb-e29d9ee70dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:49.139543 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 560/1101] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 14:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:49.288314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83ca67-5f24-4249-84eb-d9dfbb0eb8cd None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:34:49.290057 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-0b83ca67-5f24-4249-84eb-d9dfbb0eb8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:49.395930 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:49.431701 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83ca67-5f24-4249-84eb-d9dfbb0eb8cd None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:34:49.541687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ae1be-5e36-420d-9445-fe2ab0842e22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:34:49.542241 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ae1be-5e36-420d-9445-fe2ab0842e22 service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:49.542516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ae1be-5e36-420d-9445-fe2ab0842e22 service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:49.542780 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ae1be-5e36-420d-9445-fe2ab0842e22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:49.544359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-5b9ae1be-5e36-420d-9445-fe2ab0842e22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:49.617665 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:49.631097 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ae1be-5e36-420d-9445-fe2ab0842e22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:34:49.632690 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ae1be-5e36-420d-9445-fe2ab0842e22 service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:34:49.650886 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 542/1102] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:34:50.769192 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7b061-ca5f-4f20-8131-22f7dd042359 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:50.769795 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7b061-ca5f-4f20-8131-22f7dd042359 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:50.769795 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7b061-ca5f-4f20-8131-22f7dd042359 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:50.771114 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 561/1103] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 14:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:34:50.777409 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e3787-6b51-438b-a205-2b570299a398 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:50.777819 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e3787-6b51-438b-a205-2b570299a398 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:50.777995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e3787-6b51-438b-a205-2b570299a398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:50.859545 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-0b5e3787-6b51-438b-a205-2b570299a398 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:50.861312 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-0b5e3787-6b51-438b-a205-2b570299a398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:50.958032 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 543/1104] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 14:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:51.106925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7b061-ca5f-4f20-8131-22f7dd042359 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:34:51.108421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-1ae7b061-ca5f-4f20-8131-22f7dd042359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:51.194542 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:51.256561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7b061-ca5f-4f20-8131-22f7dd042359 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:34:51.366920 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a6c5c-d83f-4779-b64d-bf88f84ca6da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:34:51.367446 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a6c5c-d83f-4779-b64d-bf88f84ca6da service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:51.367718 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a6c5c-d83f-4779-b64d-bf88f84ca6da service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:51.367985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a6c5c-d83f-4779-b64d-bf88f84ca6da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:51.369550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-4b1a6c5c-d83f-4779-b64d-bf88f84ca6da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:51.417140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:51.458255 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a6c5c-d83f-4779-b64d-bf88f84ca6da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:34:51.459856 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a6c5c-d83f-4779-b64d-bf88f84ca6da service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:34:51.477807 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 562/1105] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:34:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:34:52.531341 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7e77a-e495-4d55-9e97-4d5fa31852c5 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:52.531903 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7e77a-e495-4d55-9e97-4d5fa31852c5 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:52.531903 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7e77a-e495-4d55-9e97-4d5fa31852c5 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:52.533269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 544/1106] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 14:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:34:52.539569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d448b-8bf8-4ccb-bd5c-846fab9f1252 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:52.540004 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d448b-8bf8-4ccb-bd5c-846fab9f1252 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:52.540106 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d448b-8bf8-4ccb-bd5c-846fab9f1252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:52.617515 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-3a0d448b-8bf8-4ccb-bd5c-846fab9f1252 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:52.618739 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-3a0d448b-8bf8-4ccb-bd5c-846fab9f1252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:52.711808 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 563/1107] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 14:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:52.862004 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7e77a-e495-4d55-9e97-4d5fa31852c5 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:34:52.863557 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-efc7e77a-e495-4d55-9e97-4d5fa31852c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:52.911743 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:53.006392 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7e77a-e495-4d55-9e97-4d5fa31852c5 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:34:53.114899 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd719f-f42e-4386-bb5b-a7a6e0fd3e82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:34:53.115418 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd719f-f42e-4386-bb5b-a7a6e0fd3e82 service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:53.115696 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd719f-f42e-4386-bb5b-a7a6e0fd3e82 service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:53.115960 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd719f-f42e-4386-bb5b-a7a6e0fd3e82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:53.117532 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-71cd719f-f42e-4386-bb5b-a7a6e0fd3e82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:53.124276 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:53.207665 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd719f-f42e-4386-bb5b-a7a6e0fd3e82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:34:53.209271 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd719f-f42e-4386-bb5b-a7a6e0fd3e82 service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:34:53.226774 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 545/1108] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:34:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:34:54.279008 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f35424-a571-4481-8abf-51e7e94ee007 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:54.279548 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f35424-a571-4481-8abf-51e7e94ee007 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:54.279548 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f35424-a571-4481-8abf-51e7e94ee007 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:54.280896 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 564/1109] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 14:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:34:54.287678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd945802-f8f1-444b-b408-5acb7ba972c9 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:54.288103 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd945802-f8f1-444b-b408-5acb7ba972c9 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:54.288477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd945802-f8f1-444b-b408-5acb7ba972c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:54.364678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-fd945802-f8f1-444b-b408-5acb7ba972c9 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:54.365910 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-fd945802-f8f1-444b-b408-5acb7ba972c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:54.433167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:54.461510 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 546/1110] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 14:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:54.612688 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f35424-a571-4481-8abf-51e7e94ee007 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:34:54.614238 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b4f35424-a571-4481-8abf-51e7e94ee007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:54.631927 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:54.758360 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f35424-a571-4481-8abf-51e7e94ee007 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:34:54.843148 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:54.869460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d77ac8-19d6-46ca-9dcc-a8afb079667f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:34:54.870099 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d77ac8-19d6-46ca-9dcc-a8afb079667f service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:54.870376 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d77ac8-19d6-46ca-9dcc-a8afb079667f service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:54.870665 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d77ac8-19d6-46ca-9dcc-a8afb079667f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:54.872249 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-30d77ac8-19d6-46ca-9dcc-a8afb079667f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:54.962460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d77ac8-19d6-46ca-9dcc-a8afb079667f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:34:54.964086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d77ac8-19d6-46ca-9dcc-a8afb079667f service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:34:54.982231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 565/1111] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:34:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:34:56.025581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7e670-a421-463a-b646-90a56fd4fffd None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:56.026220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7e670-a421-463a-b646-90a56fd4fffd None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:56.026220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7e670-a421-463a-b646-90a56fd4fffd None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:56.027521 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 547/1112] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 14:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:34:56.034322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0ae5d-ab4d-4b5b-a176-24016c7563dd None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:56.034785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0ae5d-ab4d-4b5b-a176-24016c7563dd None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:56.034888 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0ae5d-ab4d-4b5b-a176-24016c7563dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:56.110062 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-5fa0ae5d-ab4d-4b5b-a176-24016c7563dd None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:56.111271 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-5fa0ae5d-ab4d-4b5b-a176-24016c7563dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:56.152463 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:56.211985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 566/1113] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 14:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:56.365860 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7e670-a421-463a-b646-90a56fd4fffd None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:34:56.367362 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-39c7e670-a421-463a-b646-90a56fd4fffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:56.510604 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7e670-a421-463a-b646-90a56fd4fffd None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:34:56.564669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:56.622959 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84594c27-d7c5-4f20-af39-9dc3a43c9066 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:34:56.623490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84594c27-d7c5-4f20-af39-9dc3a43c9066 service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:56.623787 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84594c27-d7c5-4f20-af39-9dc3a43c9066 service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:56.624041 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84594c27-d7c5-4f20-af39-9dc3a43c9066 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:56.625710 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-84594c27-d7c5-4f20-af39-9dc3a43c9066 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:56.713611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84594c27-d7c5-4f20-af39-9dc3a43c9066 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:34:56.715235 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84594c27-d7c5-4f20-af39-9dc3a43c9066 service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:34:56.733188 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 548/1114] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:34:57.779532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571eaa3-55d0-40d9-ba10-b044f14767d0 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:57.780105 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571eaa3-55d0-40d9-ba10-b044f14767d0 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:57.780105 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571eaa3-55d0-40d9-ba10-b044f14767d0 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:57.781423 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 567/1115] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 14:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:34:57.788304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580b46c-272e-4901-a5f7-6c94fa4e28f8 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:57.788758 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580b46c-272e-4901-a5f7-6c94fa4e28f8 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:57.788870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580b46c-272e-4901-a5f7-6c94fa4e28f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:57.866271 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-3580b46c-272e-4901-a5f7-6c94fa4e28f8 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:34:57.867889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-3580b46c-272e-4901-a5f7-6c94fa4e28f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:57.869946 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:57.964426 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 549/1116] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 14:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:34:58.112406 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571eaa3-55d0-40d9-ba10-b044f14767d0 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:34:58.114059 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-8571eaa3-55d0-40d9-ba10-b044f14767d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:58.259312 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571eaa3-55d0-40d9-ba10-b044f14767d0 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:34:58.286213 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:58.370095 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6a29b-d79f-4a0d-9a72-f06cdc9f75a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:34:58.370619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6a29b-d79f-4a0d-9a72-f06cdc9f75a7 service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:34:58.370893 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6a29b-d79f-4a0d-9a72-f06cdc9f75a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:34:58.371158 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6a29b-d79f-4a0d-9a72-f06cdc9f75a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:34:58.372721 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b8c6a29b-d79f-4a0d-9a72-f06cdc9f75a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:34:58.461568 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6a29b-d79f-4a0d-9a72-f06cdc9f75a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:34:58.463209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6a29b-d79f-4a0d-9a72-f06cdc9f75a7 service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:34:58.480541 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 568/1117] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:35:00.538711 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1b510-575f-4c76-ad92-b4f2784cc0ce None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:00.539242 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1b510-575f-4c76-ad92-b4f2784cc0ce None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:00.539242 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1b510-575f-4c76-ad92-b4f2784cc0ce None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:00.540509 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 550/1118] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 14:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:35:00.545704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633e615-2b78-484b-bbf7-4bd064705b65 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:00.546110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633e615-2b78-484b-bbf7-4bd064705b65 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:00.546373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633e615-2b78-484b-bbf7-4bd064705b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:00.587260 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:00.612715 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-4633e615-2b78-484b-bbf7-4bd064705b65 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:35:00.613931 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-4633e615-2b78-484b-bbf7-4bd064705b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:00.711625 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 569/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 14:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:35:00.997364 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1b510-575f-4c76-ad92-b4f2784cc0ce None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:35:00.998986 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-34b1b510-575f-4c76-ad92-b4f2784cc0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:01.100377 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1b510-575f-4c76-ad92-b4f2784cc0ce None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:35:01.132673 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:01.174630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5e0e1-06c3-4bf1-bdbb-4d21f3237229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:35:01.175238 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5e0e1-06c3-4bf1-bdbb-4d21f3237229 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:01.175514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5e0e1-06c3-4bf1-bdbb-4d21f3237229 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:01.175779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5e0e1-06c3-4bf1-bdbb-4d21f3237229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:01.177475 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-76d5e0e1-06c3-4bf1-bdbb-4d21f3237229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:01.285146 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5e0e1-06c3-4bf1-bdbb-4d21f3237229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:35:01.286524 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5e0e1-06c3-4bf1-bdbb-4d21f3237229 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:35:01.305256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 551/1120] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:35:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:35:03.583842 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706a737-566e-41c7-adfe-63e439988478 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:03.584402 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706a737-566e-41c7-adfe-63e439988478 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:03.584402 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706a737-566e-41c7-adfe-63e439988478 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:03.585746 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 570/1121] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 14:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:35:03.591007 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15c11a-a334-4ac3-899e-3c0033dc1c4e None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:03.591435 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15c11a-a334-4ac3-899e-3c0033dc1c4e None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:03.591553 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15c11a-a334-4ac3-899e-3c0033dc1c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:03.657252 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-1a15c11a-a334-4ac3-899e-3c0033dc1c4e None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:35:03.658470 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-1a15c11a-a334-4ac3-899e-3c0033dc1c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:03.671067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:03.755296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 552/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 14:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:35:04.042277 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706a737-566e-41c7-adfe-63e439988478 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:35:04.043843 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-6706a737-566e-41c7-adfe-63e439988478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:04.144568 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706a737-566e-41c7-adfe-63e439988478 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:35:04.157497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:04.218148 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78539186-5db8-4e51-b62a-ca61fae43b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:35:04.219747 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78539186-5db8-4e51-b62a-ca61fae43b66 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:04.220034 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78539186-5db8-4e51-b62a-ca61fae43b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:04.220307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78539186-5db8-4e51-b62a-ca61fae43b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:04.221962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-78539186-5db8-4e51-b62a-ca61fae43b66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:04.331103 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78539186-5db8-4e51-b62a-ca61fae43b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:35:04.332551 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78539186-5db8-4e51-b62a-ca61fae43b66 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:35:04.350659 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 571/1123] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:35:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:35:06.847037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e44da3-3d86-4257-a575-d3140aa22feb None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:06.847605 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e44da3-3d86-4257-a575-d3140aa22feb None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:06.847605 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e44da3-3d86-4257-a575-d3140aa22feb None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:06.848936 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 553/1124] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 14:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:35:06.854315 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89821ac2-9dbf-4de7-92c4-1b60d7644bcd None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:06.854759 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89821ac2-9dbf-4de7-92c4-1b60d7644bcd None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:06.854865 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89821ac2-9dbf-4de7-92c4-1b60d7644bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:06.903671 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:06.923316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-89821ac2-9dbf-4de7-92c4-1b60d7644bcd None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:35:06.924526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-89821ac2-9dbf-4de7-92c4-1b60d7644bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:07.020610 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 572/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 14:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:35:07.306137 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e44da3-3d86-4257-a575-d3140aa22feb None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:35:07.307737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-b4e44da3-3d86-4257-a575-d3140aa22feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:07.410548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e44da3-3d86-4257-a575-d3140aa22feb None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:35:07.450544 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:07.484210 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c6b52-ae17-434d-9229-46d61fc30ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:35:07.484800 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c6b52-ae17-434d-9229-46d61fc30ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:07.485072 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c6b52-ae17-434d-9229-46d61fc30ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:07.485340 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c6b52-ae17-434d-9229-46d61fc30ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:07.486957 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-5b2c6b52-ae17-434d-9229-46d61fc30ff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:07.594575 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c6b52-ae17-434d-9229-46d61fc30ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:35:07.596001 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c6b52-ae17-434d-9229-46d61fc30ff2 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:35:07.613450 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 554/1126] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:35:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:35:09.917224 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2585a5-47f8-4372-b84d-e2f63774061d None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:09.917786 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2585a5-47f8-4372-b84d-e2f63774061d None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:09.917786 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2585a5-47f8-4372-b84d-e2f63774061d None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:09.919187 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 573/1127] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 14:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:35:09.924705 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d085f-6c9f-44b5-8aca-1cd318fc88ad None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:09.925088 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d085f-6c9f-44b5-8aca-1cd318fc88ad None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:09.925284 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d085f-6c9f-44b5-8aca-1cd318fc88ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:09.991546 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-8d1d085f-6c9f-44b5-8aca-1cd318fc88ad None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:35:09.992739 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-8d1d085f-6c9f-44b5-8aca-1cd318fc88ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:10.013224 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:10.089678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 555/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 14:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:35:10.380826 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2585a5-47f8-4372-b84d-e2f63774061d None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:35:10.382393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-eb2585a5-47f8-4372-b84d-e2f63774061d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:10.484552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2585a5-47f8-4372-b84d-e2f63774061d None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:35:10.505857 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:10.558764 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ef8e2-8675-4061-bc72-0a8fc39f5ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:35:10.559350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ef8e2-8675-4061-bc72-0a8fc39f5ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:10.559627 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ef8e2-8675-4061-bc72-0a8fc39f5ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:10.559894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ef8e2-8675-4061-bc72-0a8fc39f5ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:10.561497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-959ef8e2-8675-4061-bc72-0a8fc39f5ec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:10.670157 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ef8e2-8675-4061-bc72-0a8fc39f5ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:35:10.672561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ef8e2-8675-4061-bc72-0a8fc39f5ec2 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:35:10.690992 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 574/1129] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:35:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:35:13.001215 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5165d0b-fc92-4936-90ae-d01c733f4fef None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:13.001782 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5165d0b-fc92-4936-90ae-d01c733f4fef None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:13.001782 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5165d0b-fc92-4936-90ae-d01c733f4fef None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:13.003147 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 556/1130] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 14:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:35:13.008412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de5df1-5572-4d22-b8f1-2628f815fa97 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:13.008874 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de5df1-5572-4d22-b8f1-2628f815fa97 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:13.008983 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de5df1-5572-4d22-b8f1-2628f815fa97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:13.072812 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:13.075910 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-a7de5df1-5572-4d22-b8f1-2628f815fa97 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:35:13.078349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a7de5df1-5572-4d22-b8f1-2628f815fa97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:13.174675 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 575/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 14:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:35:13.463218 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5165d0b-fc92-4936-90ae-d01c733f4fef None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:35:13.464752 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a5165d0b-fc92-4936-90ae-d01c733f4fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:13.567111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5165d0b-fc92-4936-90ae-d01c733f4fef None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:35:13.614810 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:13.638928 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e285952-d1fc-4497-aab4-1b9b18d52fce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:35:13.639526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e285952-d1fc-4497-aab4-1b9b18d52fce service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:13.639800 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e285952-d1fc-4497-aab4-1b9b18d52fce service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:13.640067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e285952-d1fc-4497-aab4-1b9b18d52fce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:13.641653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-7e285952-d1fc-4497-aab4-1b9b18d52fce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:13.748127 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e285952-d1fc-4497-aab4-1b9b18d52fce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:35:13.749531 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e285952-d1fc-4497-aab4-1b9b18d52fce service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:35:13.767165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 557/1132] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:35:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:35:15.960760 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10f228-2f90-4052-a6e4-4993517529e9 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:15.961317 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10f228-2f90-4052-a6e4-4993517529e9 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:15.961317 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10f228-2f90-4052-a6e4-4993517529e9 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:15.962671 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 576/1133] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 14:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:35:15.968621 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1531e-7998-4492-96ca-f399d57884a8 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:15.969050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1531e-7998-4492-96ca-f399d57884a8 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:15.969141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1531e-7998-4492-96ca-f399d57884a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:16.035158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-82f1531e-7998-4492-96ca-f399d57884a8 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:35:16.036343 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-82f1531e-7998-4492-96ca-f399d57884a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:16.065058 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:16.133296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 558/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 14:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:35:16.426065 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10f228-2f90-4052-a6e4-4993517529e9 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:35:16.427587 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-9b10f228-2f90-4052-a6e4-4993517529e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:16.528788 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10f228-2f90-4052-a6e4-4993517529e9 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:35:16.557532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:16.602491 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c57c2-8d2f-495f-b13b-be246c7aada6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:35:16.603089 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c57c2-8d2f-495f-b13b-be246c7aada6 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:16.603366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c57c2-8d2f-495f-b13b-be246c7aada6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:16.603638 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c57c2-8d2f-495f-b13b-be246c7aada6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:16.605242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-6f1c57c2-8d2f-495f-b13b-be246c7aada6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:16.712847 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c57c2-8d2f-495f-b13b-be246c7aada6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:35:16.714258 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c57c2-8d2f-495f-b13b-be246c7aada6 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:35:16.732058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 577/1135] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:35:18.959503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87306c3-8a95-4cb4-bbe2-bd1045cbf8b0 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:18.960089 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87306c3-8a95-4cb4-bbe2-bd1045cbf8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:18.960089 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87306c3-8a95-4cb4-bbe2-bd1045cbf8b0 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:18.961431 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 559/1136] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 14:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:35:18.966850 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a1c94-5e6d-4f4e-84e6-62ba52f50a81 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:18.967273 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a1c94-5e6d-4f4e-84e6-62ba52f50a81 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:18.967381 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a1c94-5e6d-4f4e-84e6-62ba52f50a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:19.032289 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-bc3a1c94-5e6d-4f4e-84e6-62ba52f50a81 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:35:19.033476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-bc3a1c94-5e6d-4f4e-84e6-62ba52f50a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:19.041811 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:19.128354 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 578/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 14:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:35:19.419240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87306c3-8a95-4cb4-bbe2-bd1045cbf8b0 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:35:19.421372 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a87306c3-8a95-4cb4-bbe2-bd1045cbf8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:19.523463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87306c3-8a95-4cb4-bbe2-bd1045cbf8b0 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:35:19.579331 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:19.597610 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fd746-f4d0-4866-b4b5-b981ab8690ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:35:19.598253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fd746-f4d0-4866-b4b5-b981ab8690ac service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:19.598533 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fd746-f4d0-4866-b4b5-b981ab8690ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:19.598806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fd746-f4d0-4866-b4b5-b981ab8690ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:19.600473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-446fd746-f4d0-4866-b4b5-b981ab8690ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:19.707645 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fd746-f4d0-4866-b4b5-b981ab8690ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:35:19.709000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fd746-f4d0-4866-b4b5-b981ab8690ac service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:35:19.727045 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 560/1138] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:35:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:35:21.906110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0aa92-f12a-4740-b68f-796aca512796 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:21.906725 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0aa92-f12a-4740-b68f-796aca512796 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:21.906725 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0aa92-f12a-4740-b68f-796aca512796 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:21.908012 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 579/1139] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 14:35:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:35:21.913471 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff23bde-9c01-46ea-a065-721846852ac0 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:21.913960 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff23bde-9c01-46ea-a065-721846852ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:21.914073 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff23bde-9c01-46ea-a065-721846852ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:21.980886 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-dff23bde-9c01-46ea-a065-721846852ac0 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:35:21.982112 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-dff23bde-9c01-46ea-a065-721846852ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:22.022722 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:22.081906 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 561/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 14:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:35:22.368459 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0aa92-f12a-4740-b68f-796aca512796 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:35:22.370064 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-bce0aa92-f12a-4740-b68f-796aca512796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:22.471700 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0aa92-f12a-4740-b68f-796aca512796 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:35:22.508623 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:22.543769 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a9c6c-4f82-4f56-b17d-d777306e11ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:35:22.544368 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a9c6c-4f82-4f56-b17d-d777306e11ec service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:22.544642 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a9c6c-4f82-4f56-b17d-d777306e11ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:22.544909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a9c6c-4f82-4f56-b17d-d777306e11ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:22.547097 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-037a9c6c-4f82-4f56-b17d-d777306e11ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:22.653950 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a9c6c-4f82-4f56-b17d-d777306e11ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:35:22.656364 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a9c6c-4f82-4f56-b17d-d777306e11ec service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:35:22.675059 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 580/1141] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:35:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:35:24.814788 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533d7cd-1d2c-435b-a36b-4217b7f9022a None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:24.815349 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533d7cd-1d2c-435b-a36b-4217b7f9022a None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:24.815349 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533d7cd-1d2c-435b-a36b-4217b7f9022a None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:24.816654 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 562/1142] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 14:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:35:24.822290 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2797f29-ef65-43d5-9d07-b42310bf3dbc None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:24.822713 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2797f29-ef65-43d5-9d07-b42310bf3dbc None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:24.822829 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2797f29-ef65-43d5-9d07-b42310bf3dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:24.888638 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-b2797f29-ef65-43d5-9d07-b42310bf3dbc None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:35:24.889875 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b2797f29-ef65-43d5-9d07-b42310bf3dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:24.908201 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:24.986404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 581/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 14:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:35:25.271521 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533d7cd-1d2c-435b-a36b-4217b7f9022a None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:35:25.273064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-2533d7cd-1d2c-435b-a36b-4217b7f9022a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:25.374551 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533d7cd-1d2c-435b-a36b-4217b7f9022a None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:35:25.441738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:25.448975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3ad0d-eb75-4edd-bcb0-43e44272d132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:35:25.449582 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3ad0d-eb75-4edd-bcb0-43e44272d132 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:25.449891 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3ad0d-eb75-4edd-bcb0-43e44272d132 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:25.450166 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3ad0d-eb75-4edd-bcb0-43e44272d132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:25.451785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-70b3ad0d-eb75-4edd-bcb0-43e44272d132 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:25.558581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3ad0d-eb75-4edd-bcb0-43e44272d132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:35:25.560014 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3ad0d-eb75-4edd-bcb0-43e44272d132 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:35:25.578415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 563/1144] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:35:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:35:27.744391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd2813-eb04-4300-af75-386ed920094d None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:27.744908 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd2813-eb04-4300-af75-386ed920094d None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:27.744908 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd2813-eb04-4300-af75-386ed920094d None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:27.746244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 582/1145] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 14:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:35:27.752132 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b15b73-ba96-4dc0-83b8-8ba173002822 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:27.752582 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b15b73-ba96-4dc0-83b8-8ba173002822 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:27.752682 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b15b73-ba96-4dc0-83b8-8ba173002822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:27.817693 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-16b15b73-ba96-4dc0-83b8-8ba173002822 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:35:27.818914 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-16b15b73-ba96-4dc0-83b8-8ba173002822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:27.868883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:27.917751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 564/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 14:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:35:28.202336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd2813-eb04-4300-af75-386ed920094d None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:35:28.203878 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-fbcd2813-eb04-4300-af75-386ed920094d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:28.304398 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd2813-eb04-4300-af75-386ed920094d None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:35:28.355967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:28.382230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6972e1-b484-4496-b516-2e2fb219ef7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:35:28.382858 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6972e1-b484-4496-b516-2e2fb219ef7a service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:28.383131 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6972e1-b484-4496-b516-2e2fb219ef7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:28.383396 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6972e1-b484-4496-b516-2e2fb219ef7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:28.384973 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2c6972e1-b484-4496-b516-2e2fb219ef7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:28.491431 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6972e1-b484-4496-b516-2e2fb219ef7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:35:28.492802 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6972e1-b484-4496-b516-2e2fb219ef7a service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:35:28.510064 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 583/1147] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:35:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:35:37.916298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=22 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:38.507914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=66 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:48.487902 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78106dd8-70bf-4b43-9fdf-02069657ca3e None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:48.488427 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78106dd8-70bf-4b43-9fdf-02069657ca3e None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:48.488427 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78106dd8-70bf-4b43-9fdf-02069657ca3e None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:48.489725 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 565/1148] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:35:48.495044 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3af4c-24d4-495b-851a-08b9f56f5d13 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:48.495470 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3af4c-24d4-495b-851a-08b9f56f5d13 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:48.495593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3af4c-24d4-495b-851a-08b9f56f5d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:48.565119 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-69a3af4c-24d4-495b-851a-08b9f56f5d13 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:35:48.566367 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-69a3af4c-24d4-495b-851a-08b9f56f5d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:48.661090 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 584/1149] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:35:48.959552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfc188-0dc6-4e6a-97ca-ff05b415510a None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:48.959840 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfc188-0dc6-4e6a-97ca-ff05b415510a None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:48.960119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfc188-0dc6-4e6a-97ca-ff05b415510a None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:48.961485 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 566/1150] 10.222.0.17 () {54 vars in 962 bytes} [Thu Oct 20 14:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:35:48.966419 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dd689-7e6b-46ee-af5b-35aef156f865 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:48.966709 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dd689-7e6b-46ee-af5b-35aef156f865 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:48.966984 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dd689-7e6b-46ee-af5b-35aef156f865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:49.042496 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-2d1dd689-7e6b-46ee-af5b-35aef156f865 None None] MFA Rules not processed for user `077f50ca034b4d12817543377815393b`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:35:49.044274 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2d1dd689-7e6b-46ee-af5b-35aef156f865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:49.064467 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:49.119683 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 585/1151] 10.222.0.17 () {58 vars in 1059 bytes} [Thu Oct 20 14:35:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:35:49.127905 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfc188-0dc6-4e6a-97ca-ff05b415510a None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:35:49.129440 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a8bfc188-0dc6-4e6a-97ca-ff05b415510a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:49.231458 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfc188-0dc6-4e6a-97ca-ff05b415510a None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:35:49.302894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39395639-a4db-4465-9d25-ce9f6844d251 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '077f50ca034b4d12817543377815393b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:35:49.303527 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39395639-a4db-4465-9d25-ce9f6844d251 service glance] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:49.303805 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39395639-a4db-4465-9d25-ce9f6844d251 service glance] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:49.304079 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39395639-a4db-4465-9d25-ce9f6844d251 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:49.305695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-39395639-a4db-4465-9d25-ce9f6844d251 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:49.358687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:49.413073 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39395639-a4db-4465-9d25-ce9f6844d251 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:35:49.414529 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39395639-a4db-4465-9d25-ce9f6844d251 service glance] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:35:49.432380 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 567/1152] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:35:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:35:51.669477 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f5d6d-fcc4-4595-89e1-da21ebe69ef9 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:51.670123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f5d6d-fcc4-4595-89e1-da21ebe69ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:51.670123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f5d6d-fcc4-4595-89e1-da21ebe69ef9 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:51.671394 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 586/1153] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:35:51.676584 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1164c-5f82-4f0f-8460-d54317663a07 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:51.677076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1164c-5f82-4f0f-8460-d54317663a07 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:51.677207 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1164c-5f82-4f0f-8460-d54317663a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:51.742272 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-bcd1164c-5f82-4f0f-8460-d54317663a07 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:35:51.743377 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-bcd1164c-5f82-4f0f-8460-d54317663a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:51.838984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 568/1154] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:35:52.119924 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f5d6d-fcc4-4595-89e1-da21ebe69ef9 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:35:52.121778 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-756f5d6d-fcc4-4595-89e1-da21ebe69ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:52.245726 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f5d6d-fcc4-4595-89e1-da21ebe69ef9 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:35:52.295252 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:52.339236 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c012e31-d523-4f34-8019-915484c7ee09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:35:52.339897 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c012e31-d523-4f34-8019-915484c7ee09 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:52.340195 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c012e31-d523-4f34-8019-915484c7ee09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:52.340483 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c012e31-d523-4f34-8019-915484c7ee09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:52.341172 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c012e31-d523-4f34-8019-915484c7ee09 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:35:52.342314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: WARNING py.warnings [None req-4c012e31-d523-4f34-8019-915484c7ee09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 14:35:52.342314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: warnings.warn(msg) Oct 20 14:35:52.342314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: Oct 20 14:35:52.343452 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c012e31-d523-4f34-8019-915484c7ee09 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:35:52.363183 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 587/1155] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Oct 20 14:35:52 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:35:54.550427 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91c4e5-b1b6-4126-bfed-107bdcfa9982 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:54.550973 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91c4e5-b1b6-4126-bfed-107bdcfa9982 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:54.550973 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91c4e5-b1b6-4126-bfed-107bdcfa9982 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:54.552281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 569/1156] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:35:54.557717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b964b-3384-4a21-af4d-e632b3606df5 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:54.558162 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b964b-3384-4a21-af4d-e632b3606df5 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:54.558296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b964b-3384-4a21-af4d-e632b3606df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:54.623867 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-a36b964b-3384-4a21-af4d-e632b3606df5 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:35:54.625086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a36b964b-3384-4a21-af4d-e632b3606df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:54.719579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 588/1157] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:35:55.017030 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91c4e5-b1b6-4126-bfed-107bdcfa9982 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:35:55.018617 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-9d91c4e5-b1b6-4126-bfed-107bdcfa9982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:55.028572 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:55.162176 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91c4e5-b1b6-4126-bfed-107bdcfa9982 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:35:55.241820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:55.274784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132a085-8c64-4f07-b8f9-f2361a75bbef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:35:55.275316 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132a085-8c64-4f07-b8f9-f2361a75bbef service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:55.275590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132a085-8c64-4f07-b8f9-f2361a75bbef service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:55.275859 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132a085-8c64-4f07-b8f9-f2361a75bbef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:55.278055 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-f132a085-8c64-4f07-b8f9-f2361a75bbef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:55.365267 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132a085-8c64-4f07-b8f9-f2361a75bbef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:35:55.366900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132a085-8c64-4f07-b8f9-f2361a75bbef service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:35:55.384449 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 570/1158] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:35:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:35:57.715696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2de0d-6d78-4ed2-a473-2c19b324371f None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:57.716224 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2de0d-6d78-4ed2-a473-2c19b324371f None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:57.716224 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2de0d-6d78-4ed2-a473-2c19b324371f None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:57.717488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 589/1159] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:35:57.722932 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfe47f-b2a8-4bf4-8d7e-1355e1a6cf37 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:57.723348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfe47f-b2a8-4bf4-8d7e-1355e1a6cf37 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:57.723491 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfe47f-b2a8-4bf4-8d7e-1355e1a6cf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:57.789778 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-66cfe47f-b2a8-4bf4-8d7e-1355e1a6cf37 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:35:57.791089 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-66cfe47f-b2a8-4bf4-8d7e-1355e1a6cf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:57.838756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:57.890120 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 571/1160] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:35:58.177410 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2de0d-6d78-4ed2-a473-2c19b324371f None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:35:58.178984 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-c0b2de0d-6d78-4ed2-a473-2c19b324371f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:58.203328 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:58.282125 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2de0d-6d78-4ed2-a473-2c19b324371f None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:35:58.354412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791774e-2052-4da7-b5d3-4a1f6c7df2ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:35:58.355096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791774e-2052-4da7-b5d3-4a1f6c7df2ef service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:35:58.355478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791774e-2052-4da7-b5d3-4a1f6c7df2ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:35:58.355757 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791774e-2052-4da7-b5d3-4a1f6c7df2ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:35:58.357350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b791774e-2052-4da7-b5d3-4a1f6c7df2ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:35:58.430705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:35:58.466641 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791774e-2052-4da7-b5d3-4a1f6c7df2ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:35:58.468090 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791774e-2052-4da7-b5d3-4a1f6c7df2ef service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:35:58.486893 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 590/1161] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:35:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:36:00.678648 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c612a-07f6-4282-8819-813c057c6bd7 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:36:00.679217 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c612a-07f6-4282-8819-813c057c6bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:36:00.679217 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c612a-07f6-4282-8819-813c057c6bd7 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:36:00.680535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 572/1162] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:36:00.686482 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e4f40-7432-487e-9bb6-d235b4a33943 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:36:00.687080 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e4f40-7432-487e-9bb6-d235b4a33943 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:36:00.687242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e4f40-7432-487e-9bb6-d235b4a33943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:36:00.751995 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-022e4f40-7432-487e-9bb6-d235b4a33943 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:36:00.753211 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-022e4f40-7432-487e-9bb6-d235b4a33943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:36:00.849233 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 591/1163] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:36:01.140152 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c612a-07f6-4282-8819-813c057c6bd7 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:36:01.141677 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-637c612a-07f6-4282-8819-813c057c6bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:36:01.245013 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c612a-07f6-4282-8819-813c057c6bd7 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:36:01.316885 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:36:01.318481 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb342cf1-b779-49e7-82f0-d94b5a48f816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:36:01.319133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb342cf1-b779-49e7-82f0-d94b5a48f816 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:36:01.319637 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb342cf1-b779-49e7-82f0-d94b5a48f816 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:36:01.320091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb342cf1-b779-49e7-82f0-d94b5a48f816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:36:01.321959 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-fb342cf1-b779-49e7-82f0-d94b5a48f816 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:36:01.429148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb342cf1-b779-49e7-82f0-d94b5a48f816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:36:01.430518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb342cf1-b779-49e7-82f0-d94b5a48f816 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:36:01.449565 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 573/1164] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:36:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:36:03.658237 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e48e0-f339-49b0-9cd4-a553a24bb122 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:36:03.658788 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e48e0-f339-49b0-9cd4-a553a24bb122 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:36:03.658788 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e48e0-f339-49b0-9cd4-a553a24bb122 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:36:03.660358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 592/1165] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:36:03.665695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3b176-1c6d-47ad-ba41-225d9e4bd0e7 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:36:03.666146 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3b176-1c6d-47ad-ba41-225d9e4bd0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:36:03.666241 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3b176-1c6d-47ad-ba41-225d9e4bd0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:36:03.732152 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-65a3b176-1c6d-47ad-ba41-225d9e4bd0e7 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:36:03.733343 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-65a3b176-1c6d-47ad-ba41-225d9e4bd0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:36:03.784363 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:36:03.829027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 574/1166] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:36:04.117620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e48e0-f339-49b0-9cd4-a553a24bb122 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:36:04.119195 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-058e48e0-f339-49b0-9cd4-a553a24bb122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:36:04.157513 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:36:04.225518 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e48e0-f339-49b0-9cd4-a553a24bb122 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:36:04.297394 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c65883-f6a0-4122-ac0e-b6886cdc062d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:36:04.298031 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c65883-f6a0-4122-ac0e-b6886cdc062d service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:36:04.298349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c65883-f6a0-4122-ac0e-b6886cdc062d service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:36:04.298629 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c65883-f6a0-4122-ac0e-b6886cdc062d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:36:04.300338 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-d3c65883-f6a0-4122-ac0e-b6886cdc062d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:36:04.380322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:36:04.409234 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c65883-f6a0-4122-ac0e-b6886cdc062d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:36:04.410994 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c65883-f6a0-4122-ac0e-b6886cdc062d service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:36:04.429356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 593/1167] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:36:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:36:06.787525 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9294e-aec9-4006-a763-655f5a23654d None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:36:06.788077 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9294e-aec9-4006-a763-655f5a23654d None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:36:06.788077 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9294e-aec9-4006-a763-655f5a23654d None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:36:06.789461 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 575/1168] 10.222.0.17 () {54 vars in 927 bytes} [Thu Oct 20 14:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:36:06.795661 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402abfbc-e45e-4bc7-a278-f8c73fd47611 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:36:06.796055 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402abfbc-e45e-4bc7-a278-f8c73fd47611 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:36:06.796209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402abfbc-e45e-4bc7-a278-f8c73fd47611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:36:06.861768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-402abfbc-e45e-4bc7-a278-f8c73fd47611 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:36:06.862985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-402abfbc-e45e-4bc7-a278-f8c73fd47611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:36:06.959621 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 594/1169] 10.222.0.17 () {58 vars in 1024 bytes} [Thu Oct 20 14:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:36:07.249894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9294e-aec9-4006-a763-655f5a23654d None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:36:07.251441 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-5fe9294e-aec9-4006-a763-655f5a23654d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:36:07.355265 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9294e-aec9-4006-a763-655f5a23654d None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:36:07.425802 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d711f-9431-4224-b3e9-4d022e976661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:36:07.426429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d711f-9431-4224-b3e9-4d022e976661 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:36:07.426704 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d711f-9431-4224-b3e9-4d022e976661 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:36:07.426971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d711f-9431-4224-b3e9-4d022e976661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:36:07.428544 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-217d711f-9431-4224-b3e9-4d022e976661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:36:07.437891 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:36:07.536441 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d711f-9431-4224-b3e9-4d022e976661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:36:07.537887 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d711f-9431-4224-b3e9-4d022e976661 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:36:07.555102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 576/1170] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:36:16.958120 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=82 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:36:17.552867 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=50 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:37:20.508005 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cc45e-b86d-401f-9daa-d8b585d90424 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:37:20.508558 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cc45e-b86d-401f-9daa-d8b585d90424 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:37:20.508558 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cc45e-b86d-401f-9daa-d8b585d90424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:37:20.583620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-2c9cc45e-b86d-401f-9daa-d8b585d90424 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:37:20.585650 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2c9cc45e-b86d-401f-9daa-d8b585d90424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:37:20.682334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 595/1171] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:37:20.690267 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f445e37-0125-4590-b84a-4b880cfde803 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:37:20.690757 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f445e37-0125-4590-b84a-4b880cfde803 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:37:20.690870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f445e37-0125-4590-b84a-4b880cfde803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:37:20.766830 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-5f445e37-0125-4590-b84a-4b880cfde803 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:37:20.767952 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-5f445e37-0125-4590-b84a-4b880cfde803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:37:20.871679 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 577/1172] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:37:20.876371 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cc45e-b86d-401f-9daa-d8b585d90424 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:37:20.877739 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2c9cc45e-b86d-401f-9daa-d8b585d90424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:37:20.890007 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cc45e-b86d-401f-9daa-d8b585d90424 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:37:20.952024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:37:20.984428 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d4c13-7be8-4c6a-b18c-445b1f41c14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:37:20.985053 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d4c13-7be8-4c6a-b18c-445b1f41c14c admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:37:20.985327 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d4c13-7be8-4c6a-b18c-445b1f41c14c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:37:20.985592 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d4c13-7be8-4c6a-b18c-445b1f41c14c admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:37:20.986246 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d4c13-7be8-4c6a-b18c-445b1f41c14c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:37:20.986541 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d4c13-7be8-4c6a-b18c-445b1f41c14c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:37:20.987552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: WARNING py.warnings [None req-716d4c13-7be8-4c6a-b18c-445b1f41c14c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 20 14:37:20.987552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: warnings.warn(msg) Oct 20 14:37:20.987552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: Oct 20 14:37:20.988436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d4c13-7be8-4c6a-b18c-445b1f41c14c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:37:21.000513 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 596/1173] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:37:21.009970 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f445e37-0125-4590-b84a-4b880cfde803 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:37:21.018988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f445e37-0125-4590-b84a-4b880cfde803 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:37:21.079923 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:37:21.113043 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecb878-dedb-4b5c-a368-8298d267fec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:37:21.113641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecb878-dedb-4b5c-a368-8298d267fec9 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:37:21.113945 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecb878-dedb-4b5c-a368-8298d267fec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:37:21.114216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecb878-dedb-4b5c-a368-8298d267fec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:37:21.114843 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ecb878-dedb-4b5c-a368-8298d267fec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:37:21.116522 dv-cinder-779233-7-smb devstack@keystone.service[81802]: WARNING py.warnings [None req-35ecb878-dedb-4b5c-a368-8298d267fec9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 14:37:21.116522 dv-cinder-779233-7-smb devstack@keystone.service[81802]: warnings.warn(msg) Oct 20 14:37:21.116522 dv-cinder-779233-7-smb devstack@keystone.service[81802]: Oct 20 14:37:21.117706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ecb878-dedb-4b5c-a368-8298d267fec9 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:37:21.172424 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 578/1174] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:37:21 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:37:21.176566 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d4c13-7be8-4c6a-b18c-445b1f41c14c admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:37:21.178748 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-716d4c13-7be8-4c6a-b18c-445b1f41c14c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:37:21.211285 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d4c13-7be8-4c6a-b18c-445b1f41c14c admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:37:21.302855 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6569b1-1b29-4cb6-b34c-2f2c70f75d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:37:21.303443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6569b1-1b29-4cb6-b34c-2f2c70f75d42 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:37:21.303720 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6569b1-1b29-4cb6-b34c-2f2c70f75d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:37:21.303988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6569b1-1b29-4cb6-b34c-2f2c70f75d42 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:37:21.304618 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6569b1-1b29-4cb6-b34c-2f2c70f75d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:37:21.305634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: WARNING py.warnings [None req-8f6569b1-1b29-4cb6-b34c-2f2c70f75d42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 14:37:21.305634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: warnings.warn(msg) Oct 20 14:37:21.305634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: Oct 20 14:37:21.306856 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6569b1-1b29-4cb6-b34c-2f2c70f75d42 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:37:21.347662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 597/1175] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:37:21 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:37:21.352311 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecb878-dedb-4b5c-a368-8298d267fec9 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:37:21.353918 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-35ecb878-dedb-4b5c-a368-8298d267fec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:37:21.415951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecb878-dedb-4b5c-a368-8298d267fec9 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:37:21.497773 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:37:21.508715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e6937-901b-4d7a-a20e-35814ae7c156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:37:21.509312 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e6937-901b-4d7a-a20e-35814ae7c156 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:37:21.509582 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e6937-901b-4d7a-a20e-35814ae7c156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:37:21.509860 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e6937-901b-4d7a-a20e-35814ae7c156 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:37:21.510500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e6937-901b-4d7a-a20e-35814ae7c156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:37:21.512073 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e6937-901b-4d7a-a20e-35814ae7c156 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:37:21.524610 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 579/1176] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:37:21.528623 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6569b1-1b29-4cb6-b34c-2f2c70f75d42 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:37:21.530227 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-8f6569b1-1b29-4cb6-b34c-2f2c70f75d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:37:21.543390 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6569b1-1b29-4cb6-b34c-2f2c70f75d42 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:37:21.567959 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:37:21.638044 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c0f81-a4bd-4f82-babf-00d662e3c222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:37:21.638653 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c0f81-a4bd-4f82-babf-00d662e3c222 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:37:21.638934 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c0f81-a4bd-4f82-babf-00d662e3c222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:37:21.639210 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c0f81-a4bd-4f82-babf-00d662e3c222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:37:21.639848 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c0f81-a4bd-4f82-babf-00d662e3c222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:37:21.641452 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c0f81-a4bd-4f82-babf-00d662e3c222 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:37:21.653534 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 598/1177] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:37:21.657993 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e6937-901b-4d7a-a20e-35814ae7c156 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:37:21.659538 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-864e6937-901b-4d7a-a20e-35814ae7c156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:37:21.692587 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e6937-901b-4d7a-a20e-35814ae7c156 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:37:21.784433 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda4b6d-f392-4c71-a1af-44605c14d343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:37:21.785091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda4b6d-f392-4c71-a1af-44605c14d343 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:37:21.785369 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda4b6d-f392-4c71-a1af-44605c14d343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:37:21.785641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda4b6d-f392-4c71-a1af-44605c14d343 admin admin] PATH_INFO: `/v3/projects/a61e152176f84b2c8e9629b94474143a/users/800357fea7d24e1a9c89b9c7ee1e457a/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:37:21.807595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda4b6d-f392-4c71-a1af-44605c14d343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a61e152176f84b2c8e9629b94474143a, user_id=800357fea7d24e1a9c89b9c7ee1e457a, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:37:21.810257 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda4b6d-f392-4c71-a1af-44605c14d343 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:37:21.835327 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 580/1178] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:37:21 2022] PUT /identity/v3/projects/a61e152176f84b2c8e9629b94474143a/users/800357fea7d24e1a9c89b9c7ee1e457a/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:37:21.846312 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5da2f-df70-4406-a9d9-a91d79b68989 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:37:21.846594 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5da2f-df70-4406-a9d9-a91d79b68989 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:37:21.846866 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5da2f-df70-4406-a9d9-a91d79b68989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:37:21.903769 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-9ed5da2f-df70-4406-a9d9-a91d79b68989 None None] MFA Rules not processed for user `800357fea7d24e1a9c89b9c7ee1e457a`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:37:21.904913 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-9ed5da2f-df70-4406-a9d9-a91d79b68989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:37:21.981956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 599/1179] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:37:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:37:21.995962 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25429f-2401-4f92-bcb3-19e5d1c968d9 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:37:21.996276 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25429f-2401-4f92-bcb3-19e5d1c968d9 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:37:21.996625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25429f-2401-4f92-bcb3-19e5d1c968d9 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:37:21.997905 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 581/1180] 10.222.0.17 () {54 vars in 963 bytes} [Thu Oct 20 14:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:37:22.002711 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cfce2-033f-42ba-88a9-086f7b6abf47 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:37:22.002993 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cfce2-033f-42ba-88a9-086f7b6abf47 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:37:22.003266 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cfce2-033f-42ba-88a9-086f7b6abf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:37:22.035812 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:37:22.080266 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-363cfce2-033f-42ba-88a9-086f7b6abf47 None None] MFA Rules not processed for user `c1f0806ae4544d7b99d4d6e3b5069b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:37:22.081481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-363cfce2-033f-42ba-88a9-086f7b6abf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:37:22.158034 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 600/1181] 10.222.0.17 () {58 vars in 1060 bytes} [Thu Oct 20 14:37:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:37:22.166602 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25429f-2401-4f92-bcb3-19e5d1c968d9 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:37:22.168421 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-ab25429f-2401-4f92-bcb3-19e5d1c968d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:37:22.219251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:37:22.273310 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25429f-2401-4f92-bcb3-19e5d1c968d9 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:37:22.346310 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322f0af-b065-4d49-9b34-3c4b91938aaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:37:22.346911 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322f0af-b065-4d49-9b34-3c4b91938aaf service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:37:22.347191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322f0af-b065-4d49-9b34-3c4b91938aaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:37:22.347463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322f0af-b065-4d49-9b34-3c4b91938aaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:37:22.349060 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-2322f0af-b065-4d49-9b34-3c4b91938aaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:37:22.446961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322f0af-b065-4d49-9b34-3c4b91938aaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:37:22.448319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322f0af-b065-4d49-9b34-3c4b91938aaf service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:37:22.451829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:37:22.468076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 582/1182] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:37:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:37:22.513313 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f015fd-63dc-4827-9357-27beeecdba63 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:37:22.513603 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f015fd-63dc-4827-9357-27beeecdba63 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:37:22.513909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f015fd-63dc-4827-9357-27beeecdba63 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:37:22.515171 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 601/1183] 10.222.0.17 () {52 vars in 830 bytes} [Thu Oct 20 14:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:37:22.518760 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322f0af-b065-4d49-9b34-3c4b91938aaf service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:37:22.519962 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-2322f0af-b065-4d49-9b34-3c4b91938aaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:37:22.615729 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322f0af-b065-4d49-9b34-3c4b91938aaf service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:37:22.705987 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91243cb2-0332-42f9-a186-69b68e5accaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:37:22.706615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91243cb2-0332-42f9-a186-69b68e5accaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:37:22.706796 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91243cb2-0332-42f9-a186-69b68e5accaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:37:22.707059 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91243cb2-0332-42f9-a186-69b68e5accaa admin admin] PATH_INFO: `/v3/users/800357fea7d24e1a9c89b9c7ee1e457a` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:37:22.719671 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91243cb2-0332-42f9-a186-69b68e5accaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=800357fea7d24e1a9c89b9c7ee1e457a)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:37:22.720710 dv-cinder-779233-7-smb devstack@keystone.service[81802]: WARNING py.warnings [None req-91243cb2-0332-42f9-a186-69b68e5accaa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 14:37:22.720710 dv-cinder-779233-7-smb devstack@keystone.service[81802]: warnings.warn(msg) Oct 20 14:37:22.720710 dv-cinder-779233-7-smb devstack@keystone.service[81802]: Oct 20 14:37:22.721933 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91243cb2-0332-42f9-a186-69b68e5accaa admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:37:22.731839 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:37:22.790342 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-91243cb2-0332-42f9-a186-69b68e5accaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '800357fea7d24e1a9c89b9c7ee1e457a'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:37:22.804102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-91243cb2-0332-42f9-a186-69b68e5accaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '800357fea7d24e1a9c89b9c7ee1e457a'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:37:22.804676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-91243cb2-0332-42f9-a186-69b68e5accaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '800357fea7d24e1a9c89b9c7ee1e457a'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:37:22.805095 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-91243cb2-0332-42f9-a186-69b68e5accaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '800357fea7d24e1a9c89b9c7ee1e457a'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:37:22.813908 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-91243cb2-0332-42f9-a186-69b68e5accaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '800357fea7d24e1a9c89b9c7ee1e457a'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:37:22.842352 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 583/1184] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:37:22 2022] DELETE /identity/v3/users/800357fea7d24e1a9c89b9c7ee1e457a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:37:22.846750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d7223-2904-43c3-b5e4-28ee12511eb4 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:37:22.847228 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d7223-2904-43c3-b5e4-28ee12511eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:37:22.847326 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d7223-2904-43c3-b5e4-28ee12511eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:37:22.904801 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-747d7223-2904-43c3-b5e4-28ee12511eb4 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:37:22.906126 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-747d7223-2904-43c3-b5e4-28ee12511eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:37:22.980087 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:37:22.993058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 602/1185] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:37:23.002784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91243cb2-0332-42f9-a186-69b68e5accaa admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:37:23.004003 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-91243cb2-0332-42f9-a186-69b68e5accaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:37:23.104235 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91243cb2-0332-42f9-a186-69b68e5accaa admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:37:23.160005 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:37:23.181940 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee02dda-fe10-4273-bebb-3f922bd6d302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:37:23.182556 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee02dda-fe10-4273-bebb-3f922bd6d302 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:37:23.182835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee02dda-fe10-4273-bebb-3f922bd6d302 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:37:23.183105 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee02dda-fe10-4273-bebb-3f922bd6d302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:37:23.184698 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-2ee02dda-fe10-4273-bebb-3f922bd6d302 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:37:23.293372 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee02dda-fe10-4273-bebb-3f922bd6d302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:37:23.294759 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee02dda-fe10-4273-bebb-3f922bd6d302 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:37:23.312565 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 584/1186] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:37:23.820083 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d7223-2904-43c3-b5e4-28ee12511eb4 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:37:23.821346 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-747d7223-2904-43c3-b5e4-28ee12511eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:37:23.832704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d7223-2904-43c3-b5e4-28ee12511eb4 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:37:23.934570 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068d881-ccff-46ef-8c6b-101b0794b1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:37:23.935203 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068d881-ccff-46ef-8c6b-101b0794b1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:37:23.935456 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068d881-ccff-46ef-8c6b-101b0794b1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:37:23.935722 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068d881-ccff-46ef-8c6b-101b0794b1c9 admin admin] PATH_INFO: `/v3/projects/a61e152176f84b2c8e9629b94474143a` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:37:23.945426 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068d881-ccff-46ef-8c6b-101b0794b1c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a61e152176f84b2c8e9629b94474143a)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:37:23.946469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: WARNING py.warnings [None req-b068d881-ccff-46ef-8c6b-101b0794b1c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 14:37:23.946469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: warnings.warn(msg) Oct 20 14:37:23.946469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: Oct 20 14:37:23.947680 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068d881-ccff-46ef-8c6b-101b0794b1c9 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:37:24.005019 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b068d881-ccff-46ef-8c6b-101b0794b1c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a61e152176f84b2c8e9629b94474143a', 'request_id': 'req-b068d881-ccff-46ef-8c6b-101b0794b1c9'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:37:24.010970 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b068d881-ccff-46ef-8c6b-101b0794b1c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a61e152176f84b2c8e9629b94474143a', 'request_id': 'req-b068d881-ccff-46ef-8c6b-101b0794b1c9'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:37:24.021557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b068d881-ccff-46ef-8c6b-101b0794b1c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a61e152176f84b2c8e9629b94474143a', 'request_id': 'req-b068d881-ccff-46ef-8c6b-101b0794b1c9'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:37:24.051490 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b068d881-ccff-46ef-8c6b-101b0794b1c9 admin admin] The token cache is being invalidate because project a61e152176f84b2c8e9629b94474143a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:37:24.051776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b068d881-ccff-46ef-8c6b-101b0794b1c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:37:24.052800 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b068d881-ccff-46ef-8c6b-101b0794b1c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:37:24.054238 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 603/1187] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:37:23 2022] DELETE /identity/v3/projects/a61e152176f84b2c8e9629b94474143a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:37:33.310300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=62 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:37:34.049541 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:38:58.234016 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f497d30-2d6b-4bf9-b305-07bef180e061 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:38:58.234611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f497d30-2d6b-4bf9-b305-07bef180e061 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:38:58.234611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f497d30-2d6b-4bf9-b305-07bef180e061 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:38:58.235921 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 585/1188] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 14:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:38:58.241245 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317964f-08a2-49e6-9062-78a40cd8a8cd None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:38:58.241649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317964f-08a2-49e6-9062-78a40cd8a8cd None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:38:58.241798 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317964f-08a2-49e6-9062-78a40cd8a8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:38:58.322191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-b317964f-08a2-49e6-9062-78a40cd8a8cd None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:38:58.323388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b317964f-08a2-49e6-9062-78a40cd8a8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:38:58.422442 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 604/1189] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 14:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:38:58.581062 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f497d30-2d6b-4bf9-b305-07bef180e061 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:38:58.583243 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-0f497d30-2d6b-4bf9-b305-07bef180e061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:38:58.706253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f497d30-2d6b-4bf9-b305-07bef180e061 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:38:58.711387 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ebd75-15b1-4f30-bba2-c366959179d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:38:58.711994 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ebd75-15b1-4f30-bba2-c366959179d0 service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:38:58.712275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ebd75-15b1-4f30-bba2-c366959179d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:38:58.712549 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ebd75-15b1-4f30-bba2-c366959179d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:38:58.720484 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ebd75-15b1-4f30-bba2-c366959179d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:38:58.722670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ebd75-15b1-4f30-bba2-c366959179d0 service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:38:58.732160 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 586/1190] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:38:59.822942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82602a-fe24-4974-b61f-2690d5165694 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:38:59.823469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82602a-fe24-4974-b61f-2690d5165694 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:38:59.823570 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82602a-fe24-4974-b61f-2690d5165694 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:38:59.825149 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 605/1191] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 14:38:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:38:59.831899 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc76a9-fc81-4db1-984d-c88c4fd3d120 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:38:59.832351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc76a9-fc81-4db1-984d-c88c4fd3d120 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:38:59.832452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc76a9-fc81-4db1-984d-c88c4fd3d120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:38:59.854645 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-70bc76a9-fc81-4db1-984d-c88c4fd3d120 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:38:59.855867 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-70bc76a9-fc81-4db1-984d-c88c4fd3d120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:38:59.864494 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 587/1192] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 14:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:38:59.889317 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7114f-b65a-4e1a-8a44-be8c60e3ab66 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:38:59.889605 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7114f-b65a-4e1a-8a44-be8c60e3ab66 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:38:59.889912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7114f-b65a-4e1a-8a44-be8c60e3ab66 None None] PATH_INFO: `/v3` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:38:59.891207 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 606/1193] 10.222.0.16 () {54 vars in 925 bytes} [Thu Oct 20 14:38:59 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:38:59.904164 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be06e28-089d-44c5-9897-6dcb929d11d3 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:38:59.904460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be06e28-089d-44c5-9897-6dcb929d11d3 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:38:59.904713 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be06e28-089d-44c5-9897-6dcb929d11d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:38:59.964107 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-5be06e28-089d-44c5-9897-6dcb929d11d3 None None] MFA Rules not processed for user `1e94a60e43914cf38a5f2f88b182083f`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:38:59.965319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-5be06e28-089d-44c5-9897-6dcb929d11d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:39:00.018044 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7114f-b65a-4e1a-8a44-be8c60e3ab66 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:39:00.019302 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:39:00.032980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7114f-b65a-4e1a-8a44-be8c60e3ab66 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:39:00.038494 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4492b5-d17c-43eb-9ae7-45faf8be637f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:39:00.038979 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 588/1194] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Oct 20 14:38:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:39:00.039112 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4492b5-d17c-43eb-9ae7-45faf8be637f service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:00.039356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4492b5-d17c-43eb-9ae7-45faf8be637f service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:00.039623 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4492b5-d17c-43eb-9ae7-45faf8be637f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:00.047649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4492b5-d17c-43eb-9ae7-45faf8be637f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:39:00.049291 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4492b5-d17c-43eb-9ae7-45faf8be637f service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:39:00.058815 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 607/1195] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:39:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:39:03.589144 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47ebd1-9c89-4aca-ab80-14a2d7b888eb None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:03.589604 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47ebd1-9c89-4aca-ab80-14a2d7b888eb None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:03.589735 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47ebd1-9c89-4aca-ab80-14a2d7b888eb None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:03.591120 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 589/1196] 10.222.0.17 () {54 vars in 961 bytes} [Thu Oct 20 14:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:39:03.596006 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceaf68-7f1a-4342-a121-24d032580252 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:03.596456 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceaf68-7f1a-4342-a121-24d032580252 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:03.596569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceaf68-7f1a-4342-a121-24d032580252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:03.617111 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-9bceaf68-7f1a-4342-a121-24d032580252 None None] MFA Rules not processed for user `1e94a60e43914cf38a5f2f88b182083f`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:39:03.618333 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-9bceaf68-7f1a-4342-a121-24d032580252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:39:03.626668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 608/1197] 10.222.0.17 () {58 vars in 1058 bytes} [Thu Oct 20 14:39:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:39:03.634794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47ebd1-9c89-4aca-ab80-14a2d7b888eb None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:39:03.648915 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47ebd1-9c89-4aca-ab80-14a2d7b888eb None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:39:03.654451 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc7d2e-0c6b-4fcc-afb0-0a9b9b991aca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e94a60e43914cf38a5f2f88b182083f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:39:03.655047 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc7d2e-0c6b-4fcc-afb0-0a9b9b991aca service placement] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:03.655327 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc7d2e-0c6b-4fcc-afb0-0a9b9b991aca service placement] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:03.655626 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc7d2e-0c6b-4fcc-afb0-0a9b9b991aca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:03.664358 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc7d2e-0c6b-4fcc-afb0-0a9b9b991aca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:39:03.665967 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc7d2e-0c6b-4fcc-afb0-0a9b9b991aca service placement] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:39:03.676328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 590/1198] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:39:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:39:11.529643 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d18fe-9299-4783-b1ac-d4095bed484d None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:11.530196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d18fe-9299-4783-b1ac-d4095bed484d None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:11.530196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d18fe-9299-4783-b1ac-d4095bed484d None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:11.531483 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 609/1199] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 14:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:39:11.538104 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4fac4-acac-477b-9166-daf8eb7abcbb None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:11.538522 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4fac4-acac-477b-9166-daf8eb7abcbb None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:11.538661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4fac4-acac-477b-9166-daf8eb7abcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:11.558605 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-2cd4fac4-acac-477b-9166-daf8eb7abcbb None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:39:11.559787 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-2cd4fac4-acac-477b-9166-daf8eb7abcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:39:11.567650 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 591/1200] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 14:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:39:11.721401 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d18fe-9299-4783-b1ac-d4095bed484d None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:39:11.735385 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d18fe-9299-4783-b1ac-d4095bed484d None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:39:11.741260 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9215a-0af0-40e4-9315-3e707230b727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:39:11.741869 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9215a-0af0-40e4-9315-3e707230b727 service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:11.742144 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9215a-0af0-40e4-9315-3e707230b727 service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:11.742413 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9215a-0af0-40e4-9315-3e707230b727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:11.750241 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a9215a-0af0-40e4-9315-3e707230b727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:39:11.751924 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a9215a-0af0-40e4-9315-3e707230b727 service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:39:11.761272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 610/1201] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:39:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:39:12.834364 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6888001-c695-42b6-9c43-11178a7c5a5c None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:12.834902 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6888001-c695-42b6-9c43-11178a7c5a5c None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:12.834902 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6888001-c695-42b6-9c43-11178a7c5a5c None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:12.836326 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 592/1202] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 14:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:39:12.842614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee11e44-2c77-4b05-ba76-ecc8aa80d5f5 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:12.843049 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee11e44-2c77-4b05-ba76-ecc8aa80d5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:12.843153 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee11e44-2c77-4b05-ba76-ecc8aa80d5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:12.862816 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-3ee11e44-2c77-4b05-ba76-ecc8aa80d5f5 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:39:12.864017 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-3ee11e44-2c77-4b05-ba76-ecc8aa80d5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:39:12.871699 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 611/1203] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 14:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:39:13.025647 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6888001-c695-42b6-9c43-11178a7c5a5c None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:39:13.040835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6888001-c695-42b6-9c43-11178a7c5a5c None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:39:13.046258 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd0f8c-ca47-40d2-a8f9-cefb8f6333a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:39:13.046849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd0f8c-ca47-40d2-a8f9-cefb8f6333a6 service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:13.047123 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd0f8c-ca47-40d2-a8f9-cefb8f6333a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:13.047391 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd0f8c-ca47-40d2-a8f9-cefb8f6333a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:13.056531 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd0f8c-ca47-40d2-a8f9-cefb8f6333a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:39:13.058231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd0f8c-ca47-40d2-a8f9-cefb8f6333a6 service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:39:13.070803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 593/1204] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:39:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:39:17.109578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b485b5-a9a0-40d2-bc8c-a6f2d857beed None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:17.110141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b485b5-a9a0-40d2-bc8c-a6f2d857beed None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:17.110141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b485b5-a9a0-40d2-bc8c-a6f2d857beed None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:17.112081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 612/1205] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 14:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:39:17.117473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac32b86-0bb9-46a3-8c61-273ce09435c0 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:17.117925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac32b86-0bb9-46a3-8c61-273ce09435c0 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:17.118068 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac32b86-0bb9-46a3-8c61-273ce09435c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:17.137755 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-6ac32b86-0bb9-46a3-8c61-273ce09435c0 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:39:17.138978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-6ac32b86-0bb9-46a3-8c61-273ce09435c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:39:17.146837 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 594/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 14:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:39:17.438350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b485b5-a9a0-40d2-bc8c-a6f2d857beed None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:39:17.440588 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-33b485b5-a9a0-40d2-bc8c-a6f2d857beed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:39:17.474358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:39:17.520691 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b485b5-a9a0-40d2-bc8c-a6f2d857beed None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:39:17.524181 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f85cd1-3ed4-4900-8d32-52130b46a360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:39:17.524782 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f85cd1-3ed4-4900-8d32-52130b46a360 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:17.525055 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f85cd1-3ed4-4900-8d32-52130b46a360 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:17.525323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f85cd1-3ed4-4900-8d32-52130b46a360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:17.534394 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f85cd1-3ed4-4900-8d32-52130b46a360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:39:17.535844 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f85cd1-3ed4-4900-8d32-52130b46a360 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:39:17.545127 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 613/1207] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:39:19.695345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e43d3-3ba1-4a82-b8a6-4f1dbd4b0828 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:19.695866 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e43d3-3ba1-4a82-b8a6-4f1dbd4b0828 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:19.695866 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e43d3-3ba1-4a82-b8a6-4f1dbd4b0828 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:19.697269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 595/1208] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 14:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:39:19.702676 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afe04f-fe7a-4a56-9c5d-673d75fa888a None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:19.703072 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afe04f-fe7a-4a56-9c5d-673d75fa888a None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:19.703258 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afe04f-fe7a-4a56-9c5d-673d75fa888a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:19.722772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-f8afe04f-fe7a-4a56-9c5d-673d75fa888a None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:39:19.723973 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-f8afe04f-fe7a-4a56-9c5d-673d75fa888a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:39:19.731740 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 614/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 14:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:39:20.023868 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e43d3-3ba1-4a82-b8a6-4f1dbd4b0828 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:39:20.035622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e43d3-3ba1-4a82-b8a6-4f1dbd4b0828 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:39:20.039111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3bd0f-9629-4740-8829-cc122d53ec83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:39:20.039696 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3bd0f-9629-4740-8829-cc122d53ec83 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:20.039971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3bd0f-9629-4740-8829-cc122d53ec83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:20.040238 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3bd0f-9629-4740-8829-cc122d53ec83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:20.049027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3bd0f-9629-4740-8829-cc122d53ec83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:39:20.050482 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3bd0f-9629-4740-8829-cc122d53ec83 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:39:20.059579 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 596/1210] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:39:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:39:23.749797 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eeaa42-e297-48d4-8e1c-3de6dfdd109a None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:23.750371 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eeaa42-e297-48d4-8e1c-3de6dfdd109a None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:23.750371 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eeaa42-e297-48d4-8e1c-3de6dfdd109a None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:23.752127 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 615/1211] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 14:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:39:23.757594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43129e05-0d99-41cb-a944-93fc8d2310ca None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:23.758076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43129e05-0d99-41cb-a944-93fc8d2310ca None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:23.758186 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43129e05-0d99-41cb-a944-93fc8d2310ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:23.778135 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-43129e05-0d99-41cb-a944-93fc8d2310ca None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:39:23.779249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-43129e05-0d99-41cb-a944-93fc8d2310ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:39:23.787725 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 597/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 14:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:39:24.086529 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eeaa42-e297-48d4-8e1c-3de6dfdd109a None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:39:24.088283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-72eeaa42-e297-48d4-8e1c-3de6dfdd109a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:39:24.164619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eeaa42-e297-48d4-8e1c-3de6dfdd109a None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:39:24.168220 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99d031-cbcb-44cd-a676-e4f6ca5f95cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:39:24.168840 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99d031-cbcb-44cd-a676-e4f6ca5f95cc service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:24.169121 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99d031-cbcb-44cd-a676-e4f6ca5f95cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:24.169392 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99d031-cbcb-44cd-a676-e4f6ca5f95cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:24.180150 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99d031-cbcb-44cd-a676-e4f6ca5f95cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:39:24.181128 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99d031-cbcb-44cd-a676-e4f6ca5f95cc service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:39:24.190558 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 616/1213] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:39:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:39:26.318360 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086671a4-f5e5-4ae1-be83-df7b9474c3d0 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:26.318993 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086671a4-f5e5-4ae1-be83-df7b9474c3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:26.318993 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086671a4-f5e5-4ae1-be83-df7b9474c3d0 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:26.320230 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 598/1214] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 14:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:39:26.325520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f61704-3360-427e-b6f2-f3bb24fa21a4 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:26.325992 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f61704-3360-427e-b6f2-f3bb24fa21a4 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:26.326096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f61704-3360-427e-b6f2-f3bb24fa21a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:26.345303 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-73f61704-3360-427e-b6f2-f3bb24fa21a4 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:39:26.346533 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-73f61704-3360-427e-b6f2-f3bb24fa21a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:39:26.354354 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 617/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 14:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:39:26.659745 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086671a4-f5e5-4ae1-be83-df7b9474c3d0 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:39:26.661415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-086671a4-f5e5-4ae1-be83-df7b9474c3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:39:26.674005 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086671a4-f5e5-4ae1-be83-df7b9474c3d0 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:39:26.677369 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d393a65-4058-4f10-9259-b69f245fd65a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:39:26.677992 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d393a65-4058-4f10-9259-b69f245fd65a service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:39:26.678268 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d393a65-4058-4f10-9259-b69f245fd65a service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:39:26.678535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d393a65-4058-4f10-9259-b69f245fd65a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:39:26.687491 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d393a65-4058-4f10-9259-b69f245fd65a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:39:26.689696 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d393a65-4058-4f10-9259-b69f245fd65a service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:39:26.698876 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 599/1216] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:39:36.340555 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=63 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:39:36.694805 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=37 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:56.267011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e01819-7c49-4007-8ba9-835fa208f5a6 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.267659 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e01819-7c49-4007-8ba9-835fa208f5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.267659 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e01819-7c49-4007-8ba9-835fa208f5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.294398 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-94e01819-7c49-4007-8ba9-835fa208f5a6 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:56.295704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-94e01819-7c49-4007-8ba9-835fa208f5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:56.313381 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 618/1217] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:40:56.325110 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2e755-3261-4343-8657-b01752a0cb40 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.325710 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2e755-3261-4343-8657-b01752a0cb40 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.325710 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2e755-3261-4343-8657-b01752a0cb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.351146 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-daa2e755-3261-4343-8657-b01752a0cb40 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:56.352611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-daa2e755-3261-4343-8657-b01752a0cb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:56.367329 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb80d4-f97a-429d-b99a-c3f52ff522d7 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.367661 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb80d4-f97a-429d-b99a-c3f52ff522d7 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.367967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb80d4-f97a-429d-b99a-c3f52ff522d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.371416 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 600/1218] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:56.373061 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4161bd2-6b97-44cf-8a73-6fdd73f2feeb None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.373351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4161bd2-6b97-44cf-8a73-6fdd73f2feeb None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.373625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4161bd2-6b97-44cf-8a73-6fdd73f2feeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.404241 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-c4161bd2-6b97-44cf-8a73-6fdd73f2feeb None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:56.405625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-c4161bd2-6b97-44cf-8a73-6fdd73f2feeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:56.408804 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-beeb80d4-f97a-429d-b99a-c3f52ff522d7 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:56.414772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-beeb80d4-f97a-429d-b99a-c3f52ff522d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:56.418657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 601/1219] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:56.419891 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fc21f-8412-4556-8be8-af42fb8d7f9b None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.420174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fc21f-8412-4556-8be8-af42fb8d7f9b None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.420446 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fc21f-8412-4556-8be8-af42fb8d7f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.435596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 619/1220] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:40:56.436797 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb80d4-f97a-429d-b99a-c3f52ff522d7 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:56.448445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-808fc21f-8412-4556-8be8-af42fb8d7f9b None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:56.449746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-808fc21f-8412-4556-8be8-af42fb8d7f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:56.457752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb80d4-f97a-429d-b99a-c3f52ff522d7 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:56.467265 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 602/1221] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:56.469977 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fac01c-bcc2-4b5b-8dff-785db64052f7 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.470812 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85e114-a1b5-49b5-b905-d0c787dc0134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:56.471673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85e114-a1b5-49b5-b905-d0c787dc0134 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.472163 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85e114-a1b5-49b5-b905-d0c787dc0134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.472644 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85e114-a1b5-49b5-b905-d0c787dc0134 admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.473129 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fac01c-bcc2-4b5b-8dff-785db64052f7 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.474023 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85e114-a1b5-49b5-b905-d0c787dc0134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:40:56.474497 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fac01c-bcc2-4b5b-8dff-785db64052f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.475552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85e114-a1b5-49b5-b905-d0c787dc0134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:56.480351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85e114-a1b5-49b5-b905-d0c787dc0134 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:56.499294 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 620/1222] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:40:56.500839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcaec1-c958-4c3e-b717-d3c269adf7ed None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.501125 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcaec1-c958-4c3e-b717-d3c269adf7ed None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.501397 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcaec1-c958-4c3e-b717-d3c269adf7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.507221 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-57fac01c-bcc2-4b5b-8dff-785db64052f7 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:56.508692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-57fac01c-bcc2-4b5b-8dff-785db64052f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:56.524877 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 603/1223] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:56.526505 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f4067-4eca-4635-8431-377602e47dce None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.526947 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f4067-4eca-4635-8431-377602e47dce None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.527375 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f4067-4eca-4635-8431-377602e47dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.533075 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-6dfcaec1-c958-4c3e-b717-d3c269adf7ed None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:56.534255 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-6dfcaec1-c958-4c3e-b717-d3c269adf7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:56.547395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 621/1224] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:56.548638 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e4566-dad5-45a6-b4c2-695d76787baf None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.548922 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e4566-dad5-45a6-b4c2-695d76787baf None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.549194 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e4566-dad5-45a6-b4c2-695d76787baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.554996 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-e48f4067-4eca-4635-8431-377602e47dce None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:56.556187 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e48f4067-4eca-4635-8431-377602e47dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:56.564774 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 604/1225] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:56.565996 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7863e43-f01d-4f15-b85d-209ea574c462 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.566281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7863e43-f01d-4f15-b85d-209ea574c462 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.566549 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7863e43-f01d-4f15-b85d-209ea574c462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.569212 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-483e4566-dad5-45a6-b4c2-695d76787baf None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:56.570572 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-483e4566-dad5-45a6-b4c2-695d76787baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:56.578545 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 622/1226] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:56.579387 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e4566-dad5-45a6-b4c2-695d76787baf None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:56.589485 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-e7863e43-f01d-4f15-b85d-209ea574c462 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:56.590826 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e7863e43-f01d-4f15-b85d-209ea574c462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:56.592202 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e4566-dad5-45a6-b4c2-695d76787baf None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:56.596804 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3f22b-3f57-4145-aff9-0a01b7f67e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:56.597403 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3f22b-3f57-4145-aff9-0a01b7f67e46 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.597678 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3f22b-3f57-4145-aff9-0a01b7f67e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.597974 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3f22b-3f57-4145-aff9-0a01b7f67e46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.598603 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3f22b-3f57-4145-aff9-0a01b7f67e46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:56.598777 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 605/1227] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:56.599751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: WARNING py.warnings [None req-85c3f22b-3f57-4145-aff9-0a01b7f67e46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 14:40:56.599751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: warnings.warn(msg) Oct 20 14:40:56.599751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: Oct 20 14:40:56.600014 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6a489-d774-4851-92c6-1de20686d290 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.600218 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6a489-d774-4851-92c6-1de20686d290 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.600489 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6a489-d774-4851-92c6-1de20686d290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.600943 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3f22b-3f57-4145-aff9-0a01b7f67e46 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:56.622139 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-01e6a489-d774-4851-92c6-1de20686d290 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:56.623335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-01e6a489-d774-4851-92c6-1de20686d290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:56.631507 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 606/1228] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:56.632791 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dce6d2-89ec-4aee-97fe-9c7d7143d1b9 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.633084 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dce6d2-89ec-4aee-97fe-9c7d7143d1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.633429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dce6d2-89ec-4aee-97fe-9c7d7143d1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.641370 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 623/1229] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:40:56 2022] POST /identity/v3/projects => generated 389 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:40:56.642220 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3f22b-3f57-4145-aff9-0a01b7f67e46 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:56.657016 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-69dce6d2-89ec-4aee-97fe-9c7d7143d1b9 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:56.658247 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-69dce6d2-89ec-4aee-97fe-9c7d7143d1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:56.704233 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3f22b-3f57-4145-aff9-0a01b7f67e46 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:56.709211 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbf45a-4bf7-40b7-a8a2-f22c91d3fd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:56.709816 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbf45a-4bf7-40b7-a8a2-f22c91d3fd8b admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.710111 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbf45a-4bf7-40b7-a8a2-f22c91d3fd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.710380 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbf45a-4bf7-40b7-a8a2-f22c91d3fd8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.711010 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbf45a-4bf7-40b7-a8a2-f22c91d3fd8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:40:56.711311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbf45a-4bf7-40b7-a8a2-f22c91d3fd8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:56.712959 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbf45a-4bf7-40b7-a8a2-f22c91d3fd8b admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:56.718025 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 607/1230] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:56.718933 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dce6d2-89ec-4aee-97fe-9c7d7143d1b9 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:56.724727 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 624/1231] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:40:56.725379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbf45a-4bf7-40b7-a8a2-f22c91d3fd8b admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:56.733590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dce6d2-89ec-4aee-97fe-9c7d7143d1b9 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:56.736707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbf45a-4bf7-40b7-a8a2-f22c91d3fd8b admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:56.738577 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093dce9e-b24b-484f-a516-5ebfa0ee73a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:56.739188 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dce9e-b24b-484f-a516-5ebfa0ee73a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.739589 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dce9e-b24b-484f-a516-5ebfa0ee73a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.739870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dce9e-b24b-484f-a516-5ebfa0ee73a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.740517 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093dce9e-b24b-484f-a516-5ebfa0ee73a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:40:56.740820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093dce9e-b24b-484f-a516-5ebfa0ee73a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:56.741332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7cee9-3d84-493a-9b71-79fbe958d067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:56.741825 dv-cinder-779233-7-smb devstack@keystone.service[81802]: WARNING py.warnings [None req-093dce9e-b24b-484f-a516-5ebfa0ee73a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 20 14:40:56.741825 dv-cinder-779233-7-smb devstack@keystone.service[81802]: warnings.warn(msg) Oct 20 14:40:56.741825 dv-cinder-779233-7-smb devstack@keystone.service[81802]: Oct 20 14:40:56.742109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7cee9-3d84-493a-9b71-79fbe958d067 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.742234 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7cee9-3d84-493a-9b71-79fbe958d067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.742506 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7cee9-3d84-493a-9b71-79fbe958d067 admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.743133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7cee9-3d84-493a-9b71-79fbe958d067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:40:56.743431 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7cee9-3d84-493a-9b71-79fbe958d067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:56.744174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093dce9e-b24b-484f-a516-5ebfa0ee73a0 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:56.745106 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7cee9-3d84-493a-9b71-79fbe958d067 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:56.757581 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 625/1232] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:40:56.758129 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 608/1233] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:40:56.766460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad544d31-8cb2-4a6a-978a-a2ab27697738 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.766602 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4265719-0abf-48cf-8059-cb32a515c734 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.766828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4265719-0abf-48cf-8059-cb32a515c734 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.766951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad544d31-8cb2-4a6a-978a-a2ab27697738 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.767099 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4265719-0abf-48cf-8059-cb32a515c734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.767205 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad544d31-8cb2-4a6a-978a-a2ab27697738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.787103 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-ad544d31-8cb2-4a6a-978a-a2ab27697738 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:56.787625 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-c4265719-0abf-48cf-8059-cb32a515c734 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:56.788312 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-ad544d31-8cb2-4a6a-978a-a2ab27697738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:56.789055 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-c4265719-0abf-48cf-8059-cb32a515c734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:56.797027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 609/1234] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:56.797681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad544d31-8cb2-4a6a-978a-a2ab27697738 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:56.798281 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 626/1235] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:56.799123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4265719-0abf-48cf-8059-cb32a515c734 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:56.810103 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad544d31-8cb2-4a6a-978a-a2ab27697738 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:56.810556 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4265719-0abf-48cf-8059-cb32a515c734 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:56.814654 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da0da9-a220-4aba-bd93-d327337f7ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:56.815100 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd16e7b-c01b-4aab-b1a9-93fbd404a15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:56.815250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da0da9-a220-4aba-bd93-d327337f7ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.815529 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da0da9-a220-4aba-bd93-d327337f7ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.815694 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd16e7b-c01b-4aab-b1a9-93fbd404a15c admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.815788 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da0da9-a220-4aba-bd93-d327337f7ec2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.815973 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd16e7b-c01b-4aab-b1a9-93fbd404a15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.816243 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd16e7b-c01b-4aab-b1a9-93fbd404a15c admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.816425 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da0da9-a220-4aba-bd93-d327337f7ec2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:40:56.816725 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da0da9-a220-4aba-bd93-d327337f7ec2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:56.816871 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd16e7b-c01b-4aab-b1a9-93fbd404a15c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:56.818338 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da0da9-a220-4aba-bd93-d327337f7ec2 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:56.818825 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd16e7b-c01b-4aab-b1a9-93fbd404a15c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:56.830398 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 610/1236] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:40:56.831593 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283ab9e-691f-49ba-90b1-852fcb1adff9 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.831880 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283ab9e-691f-49ba-90b1-852fcb1adff9 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.832169 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283ab9e-691f-49ba-90b1-852fcb1adff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.849880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 627/1237] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:40:56 2022] POST /identity/v3/users => generated 295 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:40:56.849880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd16e7b-c01b-4aab-b1a9-93fbd404a15c admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:56.855139 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-0283ab9e-691f-49ba-90b1-852fcb1adff9 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:56.856332 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-0283ab9e-691f-49ba-90b1-852fcb1adff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:56.859656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd16e7b-c01b-4aab-b1a9-93fbd404a15c admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:56.864302 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93928c1c-0cbd-461f-96a6-3c7062383491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:56.864679 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 611/1238] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:56.864897 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93928c1c-0cbd-461f-96a6-3c7062383491 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.865172 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93928c1c-0cbd-461f-96a6-3c7062383491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.865319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283ab9e-691f-49ba-90b1-852fcb1adff9 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:56.865430 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93928c1c-0cbd-461f-96a6-3c7062383491 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.866081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93928c1c-0cbd-461f-96a6-3c7062383491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:56.868028 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93928c1c-0cbd-461f-96a6-3c7062383491 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:56.875112 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283ab9e-691f-49ba-90b1-852fcb1adff9 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:56.879672 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d2c88-e993-4be8-b452-5a3f060baeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:56.880259 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d2c88-e993-4be8-b452-5a3f060baeac admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.880539 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d2c88-e993-4be8-b452-5a3f060baeac admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.880811 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d2c88-e993-4be8-b452-5a3f060baeac admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.881436 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d2c88-e993-4be8-b452-5a3f060baeac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:56.883354 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d2c88-e993-4be8-b452-5a3f060baeac admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:56.897817 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 628/1239] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:40:56 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:40:56.898657 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93928c1c-0cbd-461f-96a6-3c7062383491 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:56.917440 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 612/1240] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:40:56 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:40:56.918280 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d2c88-e993-4be8-b452-5a3f060baeac admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:56.928889 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:56.964823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93928c1c-0cbd-461f-96a6-3c7062383491 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:56.972072 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:56.984685 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d2c88-e993-4be8-b452-5a3f060baeac admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:56.989484 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6573e7-a7e4-4240-8b4b-a05d76f038a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:56.990121 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6573e7-a7e4-4240-8b4b-a05d76f038a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:56.990401 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6573e7-a7e4-4240-8b4b-a05d76f038a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:56.990669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6573e7-a7e4-4240-8b4b-a05d76f038a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:56.991307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6573e7-a7e4-4240-8b4b-a05d76f038a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:40:56.991609 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6573e7-a7e4-4240-8b4b-a05d76f038a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:56.993232 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6573e7-a7e4-4240-8b4b-a05d76f038a2 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.004629 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 613/1241] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:40:57.005926 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5317351-c5be-44b8-823b-0b60d81f83ab None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.006210 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5317351-c5be-44b8-823b-0b60d81f83ab None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.006485 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5317351-c5be-44b8-823b-0b60d81f83ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.023702 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd4243-06e1-4f84-829e-e2920b5d5147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.024316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd4243-06e1-4f84-829e-e2920b5d5147 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.024598 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd4243-06e1-4f84-829e-e2920b5d5147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.024872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd4243-06e1-4f84-829e-e2920b5d5147 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.025506 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd4243-06e1-4f84-829e-e2920b5d5147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.026594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-c5317351-c5be-44b8-823b-0b60d81f83ab None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:57.027616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd4243-06e1-4f84-829e-e2920b5d5147 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.027776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-c5317351-c5be-44b8-823b-0b60d81f83ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:57.035656 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 614/1242] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:57.039323 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5317351-c5be-44b8-823b-0b60d81f83ab None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.046415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5317351-c5be-44b8-823b-0b60d81f83ab None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.051480 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820e96b-1a6e-4560-bcd2-22ca54a17a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.052092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820e96b-1a6e-4560-bcd2-22ca54a17a8b admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.052364 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820e96b-1a6e-4560-bcd2-22ca54a17a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.052640 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820e96b-1a6e-4560-bcd2-22ca54a17a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.053314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820e96b-1a6e-4560-bcd2-22ca54a17a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.055228 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820e96b-1a6e-4560-bcd2-22ca54a17a8b admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.061032 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 629/1243] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:40:56 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:40:57.061032 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd4243-06e1-4f84-829e-e2920b5d5147 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.086503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 615/1244] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:40:57 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:40:57.086503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820e96b-1a6e-4560-bcd2-22ca54a17a8b admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.123653 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd4243-06e1-4f84-829e-e2920b5d5147 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.145076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820e96b-1a6e-4560-bcd2-22ca54a17a8b admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.150072 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903a882-f43c-4c67-8271-2bb23b5aeccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.151244 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903a882-f43c-4c67-8271-2bb23b5aeccf admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.151610 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903a882-f43c-4c67-8271-2bb23b5aeccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.151786 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903a882-f43c-4c67-8271-2bb23b5aeccf admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.152578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903a882-f43c-4c67-8271-2bb23b5aeccf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:40:57.152880 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903a882-f43c-4c67-8271-2bb23b5aeccf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.154595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903a882-f43c-4c67-8271-2bb23b5aeccf admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.166940 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 616/1245] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:40:57.167559 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903a882-f43c-4c67-8271-2bb23b5aeccf admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.177109 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903a882-f43c-4c67-8271-2bb23b5aeccf admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.181771 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7331535-8559-4e0a-8eef-82a2b22d423c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.183819 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7331535-8559-4e0a-8eef-82a2b22d423c admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.183819 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7331535-8559-4e0a-8eef-82a2b22d423c admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.183819 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7331535-8559-4e0a-8eef-82a2b22d423c admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.184706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7331535-8559-4e0a-8eef-82a2b22d423c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.185718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: WARNING py.warnings [None req-c7331535-8559-4e0a-8eef-82a2b22d423c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 14:40:57.185718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: warnings.warn(msg) Oct 20 14:40:57.185718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: Oct 20 14:40:57.186628 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7331535-8559-4e0a-8eef-82a2b22d423c admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.193204 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02995f80-4ebd-4669-9f16-a8870966c413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.193821 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02995f80-4ebd-4669-9f16-a8870966c413 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.194122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02995f80-4ebd-4669-9f16-a8870966c413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.194390 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02995f80-4ebd-4669-9f16-a8870966c413 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.195029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02995f80-4ebd-4669-9f16-a8870966c413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.196629 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02995f80-4ebd-4669-9f16-a8870966c413 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.203757 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:57.209820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 617/1246] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:40:57 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:40:57.210867 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7331535-8559-4e0a-8eef-82a2b22d423c admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.213561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 630/1247] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:40:57.214689 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02995f80-4ebd-4669-9f16-a8870966c413 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.220622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7331535-8559-4e0a-8eef-82a2b22d423c admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.224269 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02995f80-4ebd-4669-9f16-a8870966c413 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.225594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356153d-1daf-4421-9279-0a5db18b24cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.226207 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356153d-1daf-4421-9279-0a5db18b24cd admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.226486 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356153d-1daf-4421-9279-0a5db18b24cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.226757 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356153d-1daf-4421-9279-0a5db18b24cd admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.227372 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356153d-1daf-4421-9279-0a5db18b24cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.228878 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bb514-56b5-4425-928f-370908448ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.229460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bb514-56b5-4425-928f-370908448ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.229578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356153d-1daf-4421-9279-0a5db18b24cd admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.229739 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bb514-56b5-4425-928f-370908448ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.230047 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bb514-56b5-4425-928f-370908448ca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.230666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bb514-56b5-4425-928f-370908448ca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.232579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bb514-56b5-4425-928f-370908448ca9 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.252422 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 618/1248] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:40:57 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:40:57.253741 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356153d-1daf-4421-9279-0a5db18b24cd admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.265913 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 631/1249] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:40:57 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:40:57.265913 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bb514-56b5-4425-928f-370908448ca9 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.266282 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356153d-1daf-4421-9279-0a5db18b24cd admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.322274 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b3471-7c46-42f7-94a7-3842ba4d240a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.323456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b3471-7c46-42f7-94a7-3842ba4d240a admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.323756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b3471-7c46-42f7-94a7-3842ba4d240a admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.324032 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b3471-7c46-42f7-94a7-3842ba4d240a admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.324680 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b3471-7c46-42f7-94a7-3842ba4d240a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:40:57.324979 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b3471-7c46-42f7-94a7-3842ba4d240a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.325281 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bb514-56b5-4425-928f-370908448ca9 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.326619 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b3471-7c46-42f7-94a7-3842ba4d240a admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.329871 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1108b-396b-4af8-ac29-79006c76da8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.330483 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1108b-396b-4af8-ac29-79006c76da8c admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.330760 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1108b-396b-4af8-ac29-79006c76da8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.331029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1108b-396b-4af8-ac29-79006c76da8c admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.331657 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1108b-396b-4af8-ac29-79006c76da8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.333617 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1108b-396b-4af8-ac29-79006c76da8c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.345027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 619/1250] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:40:57.345027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b3471-7c46-42f7-94a7-3842ba4d240a admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.356022 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b3471-7c46-42f7-94a7-3842ba4d240a admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.359233 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 632/1251] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:40:57 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:40:57.359233 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1108b-396b-4af8-ac29-79006c76da8c admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.361296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfda77-b7bd-4188-b502-62d9aa8059b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.361938 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfda77-b7bd-4188-b502-62d9aa8059b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.362222 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfda77-b7bd-4188-b502-62d9aa8059b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.362496 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfda77-b7bd-4188-b502-62d9aa8059b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.363137 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dfda77-b7bd-4188-b502-62d9aa8059b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.365054 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dfda77-b7bd-4188-b502-62d9aa8059b1 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.366555 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1108b-396b-4af8-ac29-79006c76da8c admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.371614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ded8d0-37d9-42cf-947a-7babfc1bbccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.372203 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ded8d0-37d9-42cf-947a-7babfc1bbccc admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.372481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ded8d0-37d9-42cf-947a-7babfc1bbccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.372748 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ded8d0-37d9-42cf-947a-7babfc1bbccc admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.373369 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ded8d0-37d9-42cf-947a-7babfc1bbccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.375419 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ded8d0-37d9-42cf-947a-7babfc1bbccc admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.376085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:57.391409 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 620/1252] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:40:57 2022] POST /identity/v3/users => generated 287 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:40:57.391409 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfda77-b7bd-4188-b502-62d9aa8059b1 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.399976 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfda77-b7bd-4188-b502-62d9aa8059b1 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.404695 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 633/1253] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:40:57 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:40:57.405410 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e955b-9b93-4479-97e8-453667fa5568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.405570 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ded8d0-37d9-42cf-947a-7babfc1bbccc admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.406229 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e955b-9b93-4479-97e8-453667fa5568 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.406599 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e955b-9b93-4479-97e8-453667fa5568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.406976 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e955b-9b93-4479-97e8-453667fa5568 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.408178 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e955b-9b93-4479-97e8-453667fa5568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.409885 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e955b-9b93-4479-97e8-453667fa5568 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.421397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 621/1254] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:40:57.422474 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e955b-9b93-4479-97e8-453667fa5568 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.432441 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e955b-9b93-4479-97e8-453667fa5568 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.470325 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ded8d0-37d9-42cf-947a-7babfc1bbccc admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.475010 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea094a13-27dd-4632-9995-e9c5b1b10287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.475586 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea094a13-27dd-4632-9995-e9c5b1b10287 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.475864 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea094a13-27dd-4632-9995-e9c5b1b10287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.476140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea094a13-27dd-4632-9995-e9c5b1b10287 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.476774 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea094a13-27dd-4632-9995-e9c5b1b10287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.478420 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea094a13-27dd-4632-9995-e9c5b1b10287 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.489142 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 634/1255] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:40:57.490121 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea094a13-27dd-4632-9995-e9c5b1b10287 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.490992 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494b41b-82d3-439c-bd18-3d29826c6068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.491757 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494b41b-82d3-439c-bd18-3d29826c6068 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.492042 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494b41b-82d3-439c-bd18-3d29826c6068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.492311 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494b41b-82d3-439c-bd18-3d29826c6068 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.493025 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494b41b-82d3-439c-bd18-3d29826c6068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.495386 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494b41b-82d3-439c-bd18-3d29826c6068 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.500903 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea094a13-27dd-4632-9995-e9c5b1b10287 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.505596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554a88b-0069-4847-b030-32224a2a1e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.505757 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 622/1256] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:40:57.506212 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554a88b-0069-4847-b030-32224a2a1e58 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.506487 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494b41b-82d3-439c-bd18-3d29826c6068 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.506578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554a88b-0069-4847-b030-32224a2a1e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.506754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554a88b-0069-4847-b030-32224a2a1e58 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.507374 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554a88b-0069-4847-b030-32224a2a1e58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.509471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554a88b-0069-4847-b030-32224a2a1e58 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.517834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494b41b-82d3-439c-bd18-3d29826c6068 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.522769 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e076a-311d-40df-9140-b54f1366fdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.523361 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e076a-311d-40df-9140-b54f1366fdea admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.523642 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e076a-311d-40df-9140-b54f1366fdea admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.523909 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e076a-311d-40df-9140-b54f1366fdea admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.524532 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e076a-311d-40df-9140-b54f1366fdea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.526684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e076a-311d-40df-9140-b54f1366fdea admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.534013 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 635/1257] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:40:57 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:40:57.534843 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554a88b-0069-4847-b030-32224a2a1e58 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.544738 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554a88b-0069-4847-b030-32224a2a1e58 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.550293 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30622825-89d9-4db3-bb26-a716cb49febf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.551047 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30622825-89d9-4db3-bb26-a716cb49febf admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.551466 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30622825-89d9-4db3-bb26-a716cb49febf admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.551747 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30622825-89d9-4db3-bb26-a716cb49febf admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.552604 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30622825-89d9-4db3-bb26-a716cb49febf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.554289 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30622825-89d9-4db3-bb26-a716cb49febf admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.558758 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 623/1258] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:40:57 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:40:57.559596 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e076a-311d-40df-9140-b54f1366fdea admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.566633 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 636/1259] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:40:57.567427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30622825-89d9-4db3-bb26-a716cb49febf admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.577308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30622825-89d9-4db3-bb26-a716cb49febf admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.585768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:57.632725 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e076a-311d-40df-9140-b54f1366fdea admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.637116 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76698c-c137-48a5-85a1-6416bdde0200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.637517 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0962b1-54e2-46ba-b6c3-7e233f0b65fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.637724 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76698c-c137-48a5-85a1-6416bdde0200 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.638054 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76698c-c137-48a5-85a1-6416bdde0200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.638167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0962b1-54e2-46ba-b6c3-7e233f0b65fb admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.638312 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76698c-c137-48a5-85a1-6416bdde0200 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.638416 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0962b1-54e2-46ba-b6c3-7e233f0b65fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.638686 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0962b1-54e2-46ba-b6c3-7e233f0b65fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.638937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76698c-c137-48a5-85a1-6416bdde0200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.639321 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0962b1-54e2-46ba-b6c3-7e233f0b65fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.640850 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76698c-c137-48a5-85a1-6416bdde0200 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.640956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0962b1-54e2-46ba-b6c3-7e233f0b65fb admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.651299 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 624/1260] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:40:57.651299 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0962b1-54e2-46ba-b6c3-7e233f0b65fb admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.661947 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0962b1-54e2-46ba-b6c3-7e233f0b65fb admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.665246 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 637/1261] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:40:57 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:40:57.665246 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76698c-c137-48a5-85a1-6416bdde0200 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.667441 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626924a6-2ba5-40f1-acef-d61bef072628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.668092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626924a6-2ba5-40f1-acef-d61bef072628 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.668359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626924a6-2ba5-40f1-acef-d61bef072628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.668629 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626924a6-2ba5-40f1-acef-d61bef072628 admin admin] PATH_INFO: `/v3/projects/624f7324ae0c44b1b53fe790eb2f9ccd/users/f6eeeea7a6e84461aa1945595c7bf398/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.673356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76698c-c137-48a5-85a1-6416bdde0200 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.678725 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098820d-60c7-460a-9d64-a5bc7133f61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.679329 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098820d-60c7-460a-9d64-a5bc7133f61b admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.679617 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098820d-60c7-460a-9d64-a5bc7133f61b admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.679946 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098820d-60c7-460a-9d64-a5bc7133f61b admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.680589 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098820d-60c7-460a-9d64-a5bc7133f61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.683130 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098820d-60c7-460a-9d64-a5bc7133f61b admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.683754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626924a6-2ba5-40f1-acef-d61bef072628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=624f7324ae0c44b1b53fe790eb2f9ccd, user_id=f6eeeea7a6e84461aa1945595c7bf398, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.686621 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626924a6-2ba5-40f1-acef-d61bef072628 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.693354 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 638/1262] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:40:57.694235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098820d-60c7-460a-9d64-a5bc7133f61b admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.701812 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 625/1263] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:40:57 2022] PUT /identity/v3/projects/624f7324ae0c44b1b53fe790eb2f9ccd/users/f6eeeea7a6e84461aa1945595c7bf398/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:40:57.704263 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098820d-60c7-460a-9d64-a5bc7133f61b admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.706273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626924a6-2ba5-40f1-acef-d61bef072628 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.736610 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:57.761332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2db91-e5c9-4006-92ee-18ac87111899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.761974 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2db91-e5c9-4006-92ee-18ac87111899 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.762256 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2db91-e5c9-4006-92ee-18ac87111899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.762531 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2db91-e5c9-4006-92ee-18ac87111899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.763173 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2db91-e5c9-4006-92ee-18ac87111899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.764772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2db91-e5c9-4006-92ee-18ac87111899 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.770089 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626924a6-2ba5-40f1-acef-d61bef072628 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.774671 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 639/1264] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:40:57.774828 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec9f97-b5cb-4810-ad24-fac98f36ecf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.775463 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2db91-e5c9-4006-92ee-18ac87111899 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.775584 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec9f97-b5cb-4810-ad24-fac98f36ecf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.775982 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec9f97-b5cb-4810-ad24-fac98f36ecf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.776264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec9f97-b5cb-4810-ad24-fac98f36ecf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.777022 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec9f97-b5cb-4810-ad24-fac98f36ecf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.778804 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec9f97-b5cb-4810-ad24-fac98f36ecf5 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.785567 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2db91-e5c9-4006-92ee-18ac87111899 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.789881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 626/1265] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:40:57.789881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec9f97-b5cb-4810-ad24-fac98f36ecf5 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.793891 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159dfe6-fb7d-4c3a-91d1-98173f2e8605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.794500 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159dfe6-fb7d-4c3a-91d1-98173f2e8605 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.794778 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159dfe6-fb7d-4c3a-91d1-98173f2e8605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.795045 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159dfe6-fb7d-4c3a-91d1-98173f2e8605 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.795668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159dfe6-fb7d-4c3a-91d1-98173f2e8605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.797581 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159dfe6-fb7d-4c3a-91d1-98173f2e8605 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.799387 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec9f97-b5cb-4810-ad24-fac98f36ecf5 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.803796 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1ec70-a171-4a4c-aac6-5272453ce0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.804373 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1ec70-a171-4a4c-aac6-5272453ce0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.804649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1ec70-a171-4a4c-aac6-5272453ce0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.804918 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1ec70-a171-4a4c-aac6-5272453ce0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.805537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1ec70-a171-4a4c-aac6-5272453ce0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.807328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1ec70-a171-4a4c-aac6-5272453ce0b3 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.817507 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 627/1266] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:40:57.818652 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1ec70-a171-4a4c-aac6-5272453ce0b3 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.823588 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 640/1267] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:40:57 2022] POST /identity/v3/users => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:40:57.823588 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159dfe6-fb7d-4c3a-91d1-98173f2e8605 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.829190 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1ec70-a171-4a4c-aac6-5272453ce0b3 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.831927 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159dfe6-fb7d-4c3a-91d1-98173f2e8605 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.833809 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fe2a7-a57c-46f4-a883-c6ab1b6878ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.834426 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fe2a7-a57c-46f4-a883-c6ab1b6878ad admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.834711 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fe2a7-a57c-46f4-a883-c6ab1b6878ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.834985 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fe2a7-a57c-46f4-a883-c6ab1b6878ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.835618 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fe2a7-a57c-46f4-a883-c6ab1b6878ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.836497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d36366-598c-4828-9c06-bc9a0763196a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.837082 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d36366-598c-4828-9c06-bc9a0763196a admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.837234 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fe2a7-a57c-46f4-a883-c6ab1b6878ad admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.837362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d36366-598c-4828-9c06-bc9a0763196a admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.837657 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d36366-598c-4828-9c06-bc9a0763196a admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.838476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d36366-598c-4828-9c06-bc9a0763196a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.840183 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d36366-598c-4828-9c06-bc9a0763196a admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.847786 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 628/1268] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:40:57.848567 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fe2a7-a57c-46f4-a883-c6ab1b6878ad admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.852588 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 641/1269] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:40:57.852588 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac6525-7d86-428d-a0ac-136ebfdeba50 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.852588 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac6525-7d86-428d-a0ac-136ebfdeba50 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.852588 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac6525-7d86-428d-a0ac-136ebfdeba50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.862186 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fe2a7-a57c-46f4-a883-c6ab1b6878ad admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.866938 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e58a2-c06b-43d4-a7de-3391a67ea200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.867683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e58a2-c06b-43d4-a7de-3391a67ea200 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.868035 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e58a2-c06b-43d4-a7de-3391a67ea200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.868376 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e58a2-c06b-43d4-a7de-3391a67ea200 admin admin] PATH_INFO: `/v3/projects/f0411e6298d947cabdc31fae14b51075/users/b485a3d48e934557baefacfb826c9384/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.871101 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-eeac6525-7d86-428d-a0ac-136ebfdeba50 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:57.872317 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-eeac6525-7d86-428d-a0ac-136ebfdeba50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:57.879966 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 642/1270] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:57.883324 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac6525-7d86-428d-a0ac-136ebfdeba50 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.884263 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e58a2-c06b-43d4-a7de-3391a67ea200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0411e6298d947cabdc31fae14b51075, user_id=b485a3d48e934557baefacfb826c9384, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.887276 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e58a2-c06b-43d4-a7de-3391a67ea200 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.891169 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac6525-7d86-428d-a0ac-136ebfdeba50 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.896587 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fef3f-a5fc-44e0-9b0c-749d1ecb8346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:57.897587 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fef3f-a5fc-44e0-9b0c-749d1ecb8346 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:57.897903 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fef3f-a5fc-44e0-9b0c-749d1ecb8346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:57.898181 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fef3f-a5fc-44e0-9b0c-749d1ecb8346 admin admin] PATH_INFO: `/v3/projects/0ce616f0d97a49d3ae4482a41c2559c1/users/218e5a1ab3a948079eed1592c8867bd2/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:57.902905 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 629/1271] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:40:57 2022] PUT /identity/v3/projects/f0411e6298d947cabdc31fae14b51075/users/b485a3d48e934557baefacfb826c9384/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:40:57.906709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e58a2-c06b-43d4-a7de-3391a67ea200 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.913745 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27fef3f-a5fc-44e0-9b0c-749d1ecb8346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce616f0d97a49d3ae4482a41c2559c1, user_id=218e5a1ab3a948079eed1592c8867bd2, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:57.917215 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27fef3f-a5fc-44e0-9b0c-749d1ecb8346 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:57.931041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 643/1272] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:40:57 2022] PUT /identity/v3/projects/0ce616f0d97a49d3ae4482a41c2559c1/users/218e5a1ab3a948079eed1592c8867bd2/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:40:57.931880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fef3f-a5fc-44e0-9b0c-749d1ecb8346 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:57.964831 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:57.972349 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e58a2-c06b-43d4-a7de-3391a67ea200 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:57.997017 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fef3f-a5fc-44e0-9b0c-749d1ecb8346 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:58.001952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df0192-ff15-4e0a-9336-c0a97c3cf6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:58.002622 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df0192-ff15-4e0a-9336-c0a97c3cf6eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.002901 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df0192-ff15-4e0a-9336-c0a97c3cf6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.003176 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df0192-ff15-4e0a-9336-c0a97c3cf6eb admin admin] PATH_INFO: `/v3/projects/fcdfcea5bffc4b13b5fc1bf6b335a5bf/users/313d6c8e837f42bca164888a129213e7/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.017830 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df0192-ff15-4e0a-9336-c0a97c3cf6eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcdfcea5bffc4b13b5fc1bf6b335a5bf, user_id=313d6c8e837f42bca164888a129213e7, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:58.020527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df0192-ff15-4e0a-9336-c0a97c3cf6eb admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:58.029822 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87943565-5d1d-4036-ab3c-c420c4aac0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:58.030463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87943565-5d1d-4036-ab3c-c420c4aac0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.030743 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87943565-5d1d-4036-ab3c-c420c4aac0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.031015 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87943565-5d1d-4036-ab3c-c420c4aac0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.031654 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87943565-5d1d-4036-ab3c-c420c4aac0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:58.033253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87943565-5d1d-4036-ab3c-c420c4aac0c9 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:58.034147 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 644/1273] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:40:57 2022] PUT /identity/v3/projects/fcdfcea5bffc4b13b5fc1bf6b335a5bf/users/313d6c8e837f42bca164888a129213e7/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:40:58.034952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df0192-ff15-4e0a-9336-c0a97c3cf6eb admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:58.053330 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 630/1274] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:40:58.053330 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87943565-5d1d-4036-ab3c-c420c4aac0c9 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:58.061736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87943565-5d1d-4036-ab3c-c420c4aac0c9 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:58.081700 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:58.106143 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df0192-ff15-4e0a-9336-c0a97c3cf6eb admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:58.111077 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b12dd1-e013-4692-aafe-aaaf51109b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:58.111719 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b12dd1-e013-4692-aafe-aaaf51109b5c admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.112002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b12dd1-e013-4692-aafe-aaaf51109b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.112274 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b12dd1-e013-4692-aafe-aaaf51109b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.112915 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b12dd1-e013-4692-aafe-aaaf51109b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:58.114573 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b12dd1-e013-4692-aafe-aaaf51109b5c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:58.120598 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675633d-9649-4eb4-a5d3-e5e0bcb96e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:58.121252 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675633d-9649-4eb4-a5d3-e5e0bcb96e35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.121531 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675633d-9649-4eb4-a5d3-e5e0bcb96e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.121827 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675633d-9649-4eb4-a5d3-e5e0bcb96e35 admin admin] PATH_INFO: `/v3/projects/d78d7ca5af3241a78ac49b96168fa56c/users/17b4f0bec8cf413f8f0d86bd77211e1f/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.125917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 645/1275] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:40:58.125917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b12dd1-e013-4692-aafe-aaaf51109b5c admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:58.135212 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b12dd1-e013-4692-aafe-aaaf51109b5c admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:58.139821 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a271c0-79fd-455c-ab78-0676cb0a5d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:58.140408 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a271c0-79fd-455c-ab78-0676cb0a5d16 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.140614 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675633d-9649-4eb4-a5d3-e5e0bcb96e35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d78d7ca5af3241a78ac49b96168fa56c, user_id=17b4f0bec8cf413f8f0d86bd77211e1f, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:58.140733 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a271c0-79fd-455c-ab78-0676cb0a5d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.140952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a271c0-79fd-455c-ab78-0676cb0a5d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.141579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a271c0-79fd-455c-ab78-0676cb0a5d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:58.143198 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a271c0-79fd-455c-ab78-0676cb0a5d16 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:58.143616 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675633d-9649-4eb4-a5d3-e5e0bcb96e35 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:58.154324 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 646/1276] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:40:58.155146 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a271c0-79fd-455c-ab78-0676cb0a5d16 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:58.160798 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 631/1277] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:40:58 2022] PUT /identity/v3/projects/d78d7ca5af3241a78ac49b96168fa56c/users/17b4f0bec8cf413f8f0d86bd77211e1f/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:40:58.161923 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d66c3-c07c-41f0-ba04-85910ce3cef3 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.162210 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d66c3-c07c-41f0-ba04-85910ce3cef3 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.162486 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d66c3-c07c-41f0-ba04-85910ce3cef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.193774 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-fa9d66c3-c07c-41f0-ba04-85910ce3cef3 None None] MFA Rules not processed for user `b485a3d48e934557baefacfb826c9384`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:58.195054 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-fa9d66c3-c07c-41f0-ba04-85910ce3cef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:58.224187 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a271c0-79fd-455c-ab78-0676cb0a5d16 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:58.259607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 632/1278] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:58.261495 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e4e92-652c-4a4d-8cf4-6365cda13f85 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.261782 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e4e92-652c-4a4d-8cf4-6365cda13f85 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.262087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e4e92-652c-4a4d-8cf4-6365cda13f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.276603 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34713379-bf29-43dc-aaf7-ed5351c77204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:58.277400 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34713379-bf29-43dc-aaf7-ed5351c77204 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.277681 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34713379-bf29-43dc-aaf7-ed5351c77204 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.277981 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34713379-bf29-43dc-aaf7-ed5351c77204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.282754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-1f8e4e92-652c-4a4d-8cf4-6365cda13f85 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:58.283875 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-1f8e4e92-652c-4a4d-8cf4-6365cda13f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:58.284849 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:58.344353 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34713379-bf29-43dc-aaf7-ed5351c77204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:58.345835 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34713379-bf29-43dc-aaf7-ed5351c77204 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:58.348854 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 633/1279] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:58.350198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74296ae-962b-4a8d-b42c-529eadf695ae None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.350538 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74296ae-962b-4a8d-b42c-529eadf695ae None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.350872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74296ae-962b-4a8d-b42c-529eadf695ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.356743 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 647/1280] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:40:58.357545 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34713379-bf29-43dc-aaf7-ed5351c77204 service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:58.366894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34713379-bf29-43dc-aaf7-ed5351c77204 service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:58.371529 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427d4b1-1d50-4c24-bcfc-969a6dccfef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:58.372198 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427d4b1-1d50-4c24-bcfc-969a6dccfef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.372459 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427d4b1-1d50-4c24-bcfc-969a6dccfef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.372735 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427d4b1-1d50-4c24-bcfc-969a6dccfef7 admin admin] PATH_INFO: `/v3/projects/78c7bfb80dc941938c33350f70316dec/users/c573eb746e954dc2b20255b5fe9ed02d/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.380243 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-f74296ae-962b-4a8d-b42c-529eadf695ae None None] MFA Rules not processed for user `313d6c8e837f42bca164888a129213e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:58.381630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-f74296ae-962b-4a8d-b42c-529eadf695ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:58.389966 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427d4b1-1d50-4c24-bcfc-969a6dccfef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c7bfb80dc941938c33350f70316dec, user_id=c573eb746e954dc2b20255b5fe9ed02d, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:58.392727 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427d4b1-1d50-4c24-bcfc-969a6dccfef7 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:58.407280 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 648/1281] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:40:58 2022] PUT /identity/v3/projects/78c7bfb80dc941938c33350f70316dec/users/c573eb746e954dc2b20255b5fe9ed02d/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:40:58.414037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:58.418188 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427d4b1-1d50-4c24-bcfc-969a6dccfef7 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:58.457386 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 634/1282] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:58.458411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74296ae-962b-4a8d-b42c-529eadf695ae None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:58.473672 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74296ae-962b-4a8d-b42c-529eadf695ae None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:58.493178 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427d4b1-1d50-4c24-bcfc-969a6dccfef7 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:58.503313 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119e93d-413b-4a0d-af67-6e139e790e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:58.503944 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119e93d-413b-4a0d-af67-6e139e790e9c admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.504223 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119e93d-413b-4a0d-af67-6e139e790e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.504499 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119e93d-413b-4a0d-af67-6e139e790e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.505145 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119e93d-413b-4a0d-af67-6e139e790e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:58.507497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119e93d-413b-4a0d-af67-6e139e790e9c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:58.519098 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 649/1283] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:40:58.520360 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819f1ad-298d-41eb-a104-9f409b27214b None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.520644 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819f1ad-298d-41eb-a104-9f409b27214b None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.521047 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819f1ad-298d-41eb-a104-9f409b27214b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.541641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ed040-d088-46f1-878b-66031542a7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:58.542912 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ed040-d088-46f1-878b-66031542a7f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.543365 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ed040-d088-46f1-878b-66031542a7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.543807 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ed040-d088-46f1-878b-66031542a7f6 admin admin] PATH_INFO: `/v3/projects/e5e30a880ba54c91ae5be5b86b6b7be9/users/ebadd4bd1ec1442789777438c6d16414/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.553435 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-1819f1ad-298d-41eb-a104-9f409b27214b None None] MFA Rules not processed for user `17b4f0bec8cf413f8f0d86bd77211e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:58.555053 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-1819f1ad-298d-41eb-a104-9f409b27214b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:58.563317 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ed040-d088-46f1-878b-66031542a7f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e30a880ba54c91ae5be5b86b6b7be9, user_id=ebadd4bd1ec1442789777438c6d16414, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:58.566203 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ed040-d088-46f1-878b-66031542a7f6 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:58.583336 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 635/1284] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:40:58 2022] PUT /identity/v3/projects/e5e30a880ba54c91ae5be5b86b6b7be9/users/ebadd4bd1ec1442789777438c6d16414/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:40:58.584911 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52744130-0943-49a0-a9a6-62b485846ea0 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.585197 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52744130-0943-49a0-a9a6-62b485846ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.585475 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52744130-0943-49a0-a9a6-62b485846ea0 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.587087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 636/1285] 10.222.0.17 () {54 vars in 961 bytes} [Thu Oct 20 14:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:40:58.588478 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52744130-0943-49a0-a9a6-62b485846ea0 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:58.646246 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 650/1286] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:58.646246 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e81ab5-c653-492e-a2ff-14cdb9176102 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.646246 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e81ab5-c653-492e-a2ff-14cdb9176102 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.646246 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e81ab5-c653-492e-a2ff-14cdb9176102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.653346 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:58.672397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52744130-0943-49a0-a9a6-62b485846ea0 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:58.677405 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64af05-fa95-44d0-bab0-13e1ee74acea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:58.679039 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64af05-fa95-44d0-bab0-13e1ee74acea service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.679586 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64af05-fa95-44d0-bab0-13e1ee74acea service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.680039 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64af05-fa95-44d0-bab0-13e1ee74acea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.681118 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-47e81ab5-c653-492e-a2ff-14cdb9176102 None None] MFA Rules not processed for user `c573eb746e954dc2b20255b5fe9ed02d`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:58.682719 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-47e81ab5-c653-492e-a2ff-14cdb9176102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:58.756803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64af05-fa95-44d0-bab0-13e1ee74acea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:58.758302 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64af05-fa95-44d0-bab0-13e1ee74acea service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:58.763257 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:58.770015 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 637/1287] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:40:58.770552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64af05-fa95-44d0-bab0-13e1ee74acea service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:58.771938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 651/1288] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:58.772991 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e81ab5-c653-492e-a2ff-14cdb9176102 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:58.782714 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64af05-fa95-44d0-bab0-13e1ee74acea service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:58.784644 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e81ab5-c653-492e-a2ff-14cdb9176102 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:58.787694 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd877b0-11fe-4eea-846b-4796f58e6985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:58.788299 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd877b0-11fe-4eea-846b-4796f58e6985 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.788583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd877b0-11fe-4eea-846b-4796f58e6985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.788854 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd877b0-11fe-4eea-846b-4796f58e6985 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.789482 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd877b0-11fe-4eea-846b-4796f58e6985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:58.789656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf63e0-43bd-4552-aea2-1dbf3eb974a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:58.790320 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf63e0-43bd-4552-aea2-1dbf3eb974a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.790603 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf63e0-43bd-4552-aea2-1dbf3eb974a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.791062 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf63e0-43bd-4552-aea2-1dbf3eb974a9 admin admin] PATH_INFO: `/v3/projects/5a5d0f3a9160485ca819b6be6b782129/users/b5b9894a359c48dcbf10f55565191e39/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.792133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd877b0-11fe-4eea-846b-4796f58e6985 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:58.807771 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf63e0-43bd-4552-aea2-1dbf3eb974a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5d0f3a9160485ca819b6be6b782129, user_id=b5b9894a359c48dcbf10f55565191e39, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:58.811244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf63e0-43bd-4552-aea2-1dbf3eb974a9 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:58.831945 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 638/1289] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:40:58 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:40:58.831945 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884478f9-865c-45b4-ae58-53722c0a790d None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.831945 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884478f9-865c-45b4-ae58-53722c0a790d None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.831945 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884478f9-865c-45b4-ae58-53722c0a790d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.837068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 652/1290] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:40:58 2022] PUT /identity/v3/projects/5a5d0f3a9160485ca819b6be6b782129/users/b5b9894a359c48dcbf10f55565191e39/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:40:58.838806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3a42f-8b45-498d-885a-fcd3ca041043 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.840047 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3a42f-8b45-498d-885a-fcd3ca041043 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.840047 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3a42f-8b45-498d-885a-fcd3ca041043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.851280 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-884478f9-865c-45b4-ae58-53722c0a790d None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:58.852497 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-884478f9-865c-45b4-ae58-53722c0a790d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:58.889323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-96c3a42f-8b45-498d-885a-fcd3ca041043 None None] MFA Rules not processed for user `172b859c0d774c8f8a98ce23bdc237d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:58.890429 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-96c3a42f-8b45-498d-885a-fcd3ca041043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:58.934194 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 639/1291] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:58.936124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f331b9-11ed-42fe-8dbe-2450f590ebce None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.936710 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f331b9-11ed-42fe-8dbe-2450f590ebce None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.937318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f331b9-11ed-42fe-8dbe-2450f590ebce None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.939112 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 640/1292] 10.222.0.17 () {54 vars in 961 bytes} [Thu Oct 20 14:40:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:40:58.940347 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f331b9-11ed-42fe-8dbe-2450f590ebce None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:58.958359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f331b9-11ed-42fe-8dbe-2450f590ebce None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:58.967865 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760947a-6ec8-45af-8aba-63daad3a0551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:58.968567 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760947a-6ec8-45af-8aba-63daad3a0551 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.968865 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760947a-6ec8-45af-8aba-63daad3a0551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.969683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760947a-6ec8-45af-8aba-63daad3a0551 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:58.970539 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760947a-6ec8-45af-8aba-63daad3a0551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:58.973273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760947a-6ec8-45af-8aba-63daad3a0551 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:58.981554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 653/1293] 10.222.0.17 () {58 vars in 1058 bytes} [Thu Oct 20 14:40:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:58.983166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151e2a2-24e9-44e6-993d-3687d515326f None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:58.983559 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151e2a2-24e9-44e6-993d-3687d515326f None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:58.983903 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151e2a2-24e9-44e6-993d-3687d515326f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:59.005191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 641/1294] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:40:58 2022] POST /identity/v3/users => generated 288 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:40:59.007042 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3890a-0bd8-44cd-ac53-6545f559002e None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:59.007375 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3890a-0bd8-44cd-ac53-6545f559002e None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:59.007659 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3890a-0bd8-44cd-ac53-6545f559002e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:59.008833 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-c151e2a2-24e9-44e6-993d-3687d515326f None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:59.011255 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-c151e2a2-24e9-44e6-993d-3687d515326f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:59.024893 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 654/1295] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:59.027340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151e2a2-24e9-44e6-993d-3687d515326f None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:59.035551 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-3ea3890a-0bd8-44cd-ac53-6545f559002e None None] MFA Rules not processed for user `172b859c0d774c8f8a98ce23bdc237d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:59.036930 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-3ea3890a-0bd8-44cd-ac53-6545f559002e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:59.049676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 642/1296] 10.222.0.17 () {58 vars in 1058 bytes} [Thu Oct 20 14:40:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:59.050584 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3890a-0bd8-44cd-ac53-6545f559002e None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:59.063335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3890a-0bd8-44cd-ac53-6545f559002e None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:59.070682 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b35bd4-88b9-4137-a8b2-b23aa631cb2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:59.071383 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b35bd4-88b9-4137-a8b2-b23aa631cb2d service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:59.071669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b35bd4-88b9-4137-a8b2-b23aa631cb2d service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:59.071945 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b35bd4-88b9-4137-a8b2-b23aa631cb2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:59.083749 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:59.098632 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151e2a2-24e9-44e6-993d-3687d515326f None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:59.105124 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6477bb-73d9-4e55-a62c-d55b9a9166de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:59.106054 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6477bb-73d9-4e55-a62c-d55b9a9166de service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:59.106752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6477bb-73d9-4e55-a62c-d55b9a9166de service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:59.107181 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6477bb-73d9-4e55-a62c-d55b9a9166de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:59.120961 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6477bb-73d9-4e55-a62c-d55b9a9166de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:59.122977 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6477bb-73d9-4e55-a62c-d55b9a9166de service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:59.140201 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 655/1297] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:40:59.141577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6477bb-73d9-4e55-a62c-d55b9a9166de service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:59.144178 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b35bd4-88b9-4137-a8b2-b23aa631cb2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:59.146056 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b35bd4-88b9-4137-a8b2-b23aa631cb2d service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:59.156362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6477bb-73d9-4e55-a62c-d55b9a9166de service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:59.160552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 643/1298] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:40:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:40:59.161448 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b35bd4-88b9-4137-a8b2-b23aa631cb2d service nova] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:59.172139 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b35bd4-88b9-4137-a8b2-b23aa631cb2d service nova] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:59.176764 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbc430-f687-4c53-b458-2b1e01b6b8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:59.177398 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbc430-f687-4c53-b458-2b1e01b6b8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:59.177674 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbc430-f687-4c53-b458-2b1e01b6b8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:59.179042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbc430-f687-4c53-b458-2b1e01b6b8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:59.179700 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbc430-f687-4c53-b458-2b1e01b6b8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:59.183732 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3daec-0ea2-4078-913a-c7b566dee90e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:59.184774 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbc430-f687-4c53-b458-2b1e01b6b8a8 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:59.185100 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3daec-0ea2-4078-913a-c7b566dee90e service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:59.185631 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3daec-0ea2-4078-913a-c7b566dee90e service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:59.186168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3daec-0ea2-4078-913a-c7b566dee90e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:59.199998 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3daec-0ea2-4078-913a-c7b566dee90e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:59.201905 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3daec-0ea2-4078-913a-c7b566dee90e service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:59.202213 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 656/1299] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:40:59.203332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbc430-f687-4c53-b458-2b1e01b6b8a8 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:59.218145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 644/1300] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:40:59.219414 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3daec-0ea2-4078-913a-c7b566dee90e service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:59.219617 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbc430-f687-4c53-b458-2b1e01b6b8a8 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:59.226786 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7a62c-1c22-40c7-a370-35d72ca931c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:59.227590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7a62c-1c22-40c7-a370-35d72ca931c7 service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:59.227783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7a62c-1c22-40c7-a370-35d72ca931c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:59.228026 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7a62c-1c22-40c7-a370-35d72ca931c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:59.233252 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3daec-0ea2-4078-913a-c7b566dee90e service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:59.239834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86ad64-4be0-4324-a0a3-8ba8f7466de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:59.240939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86ad64-4be0-4324-a0a3-8ba8f7466de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:59.241338 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86ad64-4be0-4324-a0a3-8ba8f7466de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:59.241606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86ad64-4be0-4324-a0a3-8ba8f7466de4 admin admin] PATH_INFO: `/v3/projects/78484c4f65d74fb6912170f28a027990/users/e4b23344518f4a759536adfea0fa98ad/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:59.260832 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86ad64-4be0-4324-a0a3-8ba8f7466de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78484c4f65d74fb6912170f28a027990, user_id=e4b23344518f4a759536adfea0fa98ad, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:59.264026 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86ad64-4be0-4324-a0a3-8ba8f7466de4 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:59.283720 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 645/1301] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:40:59 2022] PUT /identity/v3/projects/78484c4f65d74fb6912170f28a027990/users/e4b23344518f4a759536adfea0fa98ad/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:40:59.287416 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86ad64-4be0-4324-a0a3-8ba8f7466de4 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:59.299698 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7a62c-1c22-40c7-a370-35d72ca931c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:59.301597 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7a62c-1c22-40c7-a370-35d72ca931c7 service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:59.304085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:59.335185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 657/1302] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:40:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:40:59.419247 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86ad64-4be0-4324-a0a3-8ba8f7466de4 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:59.426332 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41400d-6ab6-4e12-814c-45924e970223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:59.427110 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41400d-6ab6-4e12-814c-45924e970223 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:59.427392 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41400d-6ab6-4e12-814c-45924e970223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:59.427705 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41400d-6ab6-4e12-814c-45924e970223 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:59.428404 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41400d-6ab6-4e12-814c-45924e970223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:59.431049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41400d-6ab6-4e12-814c-45924e970223 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:59.452905 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 646/1303] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:40:59.457149 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7a62c-1c22-40c7-a370-35d72ca931c7 service nova] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:59.477098 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7a62c-1c22-40c7-a370-35d72ca931c7 service nova] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:59.489983 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1e1ae-8e61-4499-b666-76d25a5212fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:59.490675 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1e1ae-8e61-4499-b666-76d25a5212fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:59.491020 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1e1ae-8e61-4499-b666-76d25a5212fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:59.491222 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1e1ae-8e61-4499-b666-76d25a5212fc admin admin] PATH_INFO: `/v3/projects/78484c4f65d74fb6912170f28a027990/users/e4b23344518f4a759536adfea0fa98ad/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:59.497123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1e1ae-8e61-4499-b666-76d25a5212fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=78484c4f65d74fb6912170f28a027990, user_id=e4b23344518f4a759536adfea0fa98ad, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:59.499819 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1e1ae-8e61-4499-b666-76d25a5212fc admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:59.532714 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 658/1304] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:40:59 2022] PUT /identity/v3/projects/78484c4f65d74fb6912170f28a027990/users/e4b23344518f4a759536adfea0fa98ad/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:40:59.542923 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdbb33-593b-4f5a-b2c6-7ef0c82c48f8 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:59.543263 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdbb33-593b-4f5a-b2c6-7ef0c82c48f8 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:59.543494 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdbb33-593b-4f5a-b2c6-7ef0c82c48f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:59.612965 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-cfcdbb33-593b-4f5a-b2c6-7ef0c82c48f8 None None] MFA Rules not processed for user `e4b23344518f4a759536adfea0fa98ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:59.614940 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-cfcdbb33-593b-4f5a-b2c6-7ef0c82c48f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:40:59.639686 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1e1ae-8e61-4499-b666-76d25a5212fc admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:59.784357 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 647/1305] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:40:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:40:59.797460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdbb33-593b-4f5a-b2c6-7ef0c82c48f8 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:40:59.819433 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1e1ae-8e61-4499-b666-76d25a5212fc admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:59.830919 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8cdd8-0da1-4372-9e71-eb28238b38bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:59.831763 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8cdd8-0da1-4372-9e71-eb28238b38bd service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:59.832053 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8cdd8-0da1-4372-9e71-eb28238b38bd service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:59.832329 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8cdd8-0da1-4372-9e71-eb28238b38bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:59.918366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:59.921326 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8cdd8-0da1-4372-9e71-eb28238b38bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:59.921702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdbb33-593b-4f5a-b2c6-7ef0c82c48f8 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:40:59.923543 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8cdd8-0da1-4372-9e71-eb28238b38bd service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:59.929716 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42109538-61a0-46d8-99cf-603f65faeae4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:40:59.930459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42109538-61a0-46d8-99cf-603f65faeae4 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:59.930787 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42109538-61a0-46d8-99cf-603f65faeae4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:59.931066 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42109538-61a0-46d8-99cf-603f65faeae4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:59.936815 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 659/1306] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:40:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:40:59.938717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e039c8-4cad-4b1c-a03d-e37e3de82578 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:59.939387 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e039c8-4cad-4b1c-a03d-e37e3de82578 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:59.939672 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e039c8-4cad-4b1c-a03d-e37e3de82578 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:59.948308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 660/1307] 10.222.0.17 () {54 vars in 912 bytes} [Thu Oct 20 14:40:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:40:59.949989 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c272097-6db7-452f-bb67-a41c02bf42b8 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:40:59.950419 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c272097-6db7-452f-bb67-a41c02bf42b8 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:40:59.950724 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c272097-6db7-452f-bb67-a41c02bf42b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:40:59.979924 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42109538-61a0-46d8-99cf-603f65faeae4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:40:59.982092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42109538-61a0-46d8-99cf-603f65faeae4 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:40:59.988547 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-9c272097-6db7-452f-bb67-a41c02bf42b8 None None] MFA Rules not processed for user `172b859c0d774c8f8a98ce23bdc237d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:40:59.990032 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-9c272097-6db7-452f-bb67-a41c02bf42b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:00.005244 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 648/1308] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:40:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:00.019212 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ece06-6719-4359-862a-0b4848bd7fed None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:00.019648 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ece06-6719-4359-862a-0b4848bd7fed None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:00.020123 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ece06-6719-4359-862a-0b4848bd7fed None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:00.022240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 649/1309] 10.222.0.17 () {54 vars in 912 bytes} [Thu Oct 20 14:41:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 14:41:00.029629 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 661/1310] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Oct 20 14:40:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:00.033377 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027b3a3-604e-40b0-8be6-7cece5e0ec1f None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:00.033824 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027b3a3-604e-40b0-8be6-7cece5e0ec1f None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:00.034258 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027b3a3-604e-40b0-8be6-7cece5e0ec1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:00.048550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c272097-6db7-452f-bb67-a41c02bf42b8 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:00.060730 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c272097-6db7-452f-bb67-a41c02bf42b8 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:00.066526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03c68f-88ab-4855-a072-a3230ba9cb52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:00.067161 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03c68f-88ab-4855-a072-a3230ba9cb52 service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:00.067455 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03c68f-88ab-4855-a072-a3230ba9cb52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:00.067731 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03c68f-88ab-4855-a072-a3230ba9cb52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:00.084269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-a027b3a3-604e-40b0-8be6-7cece5e0ec1f None None] MFA Rules not processed for user `172b859c0d774c8f8a98ce23bdc237d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:00.085905 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a027b3a3-604e-40b0-8be6-7cece5e0ec1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:00.098681 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03c68f-88ab-4855-a072-a3230ba9cb52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:00.107681 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03c68f-88ab-4855-a072-a3230ba9cb52 service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:00.112184 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 650/1311] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Oct 20 14:41:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:41:00.135385 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 662/1312] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:41:00.152761 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027b3a3-604e-40b0-8be6-7cece5e0ec1f None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:00.162897 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027b3a3-604e-40b0-8be6-7cece5e0ec1f None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:00.178702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac0c9f-8d4f-489d-9479-030841eb010f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:00.179633 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac0c9f-8d4f-489d-9479-030841eb010f service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:00.180245 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac0c9f-8d4f-489d-9479-030841eb010f service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:00.180820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac0c9f-8d4f-489d-9479-030841eb010f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:00.193061 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac0c9f-8d4f-489d-9479-030841eb010f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:00.194903 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac0c9f-8d4f-489d-9479-030841eb010f service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:00.220735 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 651/1313] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:01.705797 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03c68f-88ab-4855-a072-a3230ba9cb52 service cinder] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:01.856508 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03c68f-88ab-4855-a072-a3230ba9cb52 service cinder] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:01.868602 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8f549-c3a4-4c02-960f-03aacc682987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:01.869341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8f549-c3a4-4c02-960f-03aacc682987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:01.869596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8f549-c3a4-4c02-960f-03aacc682987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:01.870058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8f549-c3a4-4c02-960f-03aacc682987 admin admin] PATH_INFO: `/v3/users/b485a3d48e934557baefacfb826c9384` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:01.872532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8f549-c3a4-4c02-960f-03aacc682987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b485a3d48e934557baefacfb826c9384)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:01.872532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: WARNING py.warnings [None req-b0b8f549-c3a4-4c02-960f-03aacc682987 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 14:41:01.872532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: warnings.warn(msg) Oct 20 14:41:01.872532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: Oct 20 14:41:01.873921 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8f549-c3a4-4c02-960f-03aacc682987 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:01.946271 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac0c9f-8d4f-489d-9479-030841eb010f service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:01.960227 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac0c9f-8d4f-489d-9479-030841eb010f service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:01.971788 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880b5b1-0306-41cf-8cc5-f345977510da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:01.975201 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880b5b1-0306-41cf-8cc5-f345977510da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:01.975660 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880b5b1-0306-41cf-8cc5-f345977510da admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:01.976191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880b5b1-0306-41cf-8cc5-f345977510da admin admin] PATH_INFO: `/v3/users/313d6c8e837f42bca164888a129213e7` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:01.976811 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b0b8f549-c3a4-4c02-960f-03aacc682987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b485a3d48e934557baefacfb826c9384'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:01.979654 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880b5b1-0306-41cf-8cc5-f345977510da admin admin] RBAC: Authorizing `identity:delete_user(user_id=313d6c8e837f42bca164888a129213e7)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:01.985264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880b5b1-0306-41cf-8cc5-f345977510da admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:02.005915 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b0b8f549-c3a4-4c02-960f-03aacc682987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b485a3d48e934557baefacfb826c9384'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:02.014661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:02.044619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b0b8f549-c3a4-4c02-960f-03aacc682987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b485a3d48e934557baefacfb826c9384'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:02.045549 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b0b8f549-c3a4-4c02-960f-03aacc682987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b485a3d48e934557baefacfb826c9384'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:02.064683 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b0b8f549-c3a4-4c02-960f-03aacc682987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b485a3d48e934557baefacfb826c9384'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:02.076185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 663/1314] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:01 2022] DELETE /identity/v3/users/b485a3d48e934557baefacfb826c9384 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:02.082690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712af8f0-6f8c-4c94-9346-73f79d234c37 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:02.084043 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712af8f0-6f8c-4c94-9346-73f79d234c37 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:02.084043 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712af8f0-6f8c-4c94-9346-73f79d234c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:02.088777 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0880b5b1-0306-41cf-8cc5-f345977510da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '313d6c8e837f42bca164888a129213e7'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:02.101371 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0880b5b1-0306-41cf-8cc5-f345977510da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '313d6c8e837f42bca164888a129213e7'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:02.106274 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0880b5b1-0306-41cf-8cc5-f345977510da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '313d6c8e837f42bca164888a129213e7'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:02.107734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0880b5b1-0306-41cf-8cc5-f345977510da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '313d6c8e837f42bca164888a129213e7'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:02.123975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0880b5b1-0306-41cf-8cc5-f345977510da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '313d6c8e837f42bca164888a129213e7'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:02.137922 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-712af8f0-6f8c-4c94-9346-73f79d234c37 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:02.139847 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-712af8f0-6f8c-4c94-9346-73f79d234c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:02.176603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 652/1315] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:01 2022] DELETE /identity/v3/users/313d6c8e837f42bca164888a129213e7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:02.184696 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c8df0-78ef-44be-a98f-d391515c77e4 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:02.185109 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c8df0-78ef-44be-a98f-d391515c77e4 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:02.185393 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c8df0-78ef-44be-a98f-d391515c77e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:02.226430 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-9b3c8df0-78ef-44be-a98f-d391515c77e4 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:02.228765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-9b3c8df0-78ef-44be-a98f-d391515c77e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:02.231687 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:02.255370 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 664/1316] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:02.323992 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712af8f0-6f8c-4c94-9346-73f79d234c37 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:02.325423 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-712af8f0-6f8c-4c94-9346-73f79d234c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:02.344041 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 653/1317] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:02.364052 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c8df0-78ef-44be-a98f-d391515c77e4 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:02.370488 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-9b3c8df0-78ef-44be-a98f-d391515c77e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:02.513113 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712af8f0-6f8c-4c94-9346-73f79d234c37 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:02.549068 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c8df0-78ef-44be-a98f-d391515c77e4 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:02.558268 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46303e7-fc65-4283-a001-f262fb037d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:02.558904 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46303e7-fc65-4283-a001-f262fb037d93 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:02.559186 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46303e7-fc65-4283-a001-f262fb037d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:02.559460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46303e7-fc65-4283-a001-f262fb037d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:02.583995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46303e7-fc65-4283-a001-f262fb037d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:02.585470 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46303e7-fc65-4283-a001-f262fb037d93 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:02.626801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 654/1318] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:41:02.794319 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720be576-c7c3-4d10-8115-bc9272dc6ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:02.795703 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720be576-c7c3-4d10-8115-bc9272dc6ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:02.796068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720be576-c7c3-4d10-8115-bc9272dc6ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:02.796564 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720be576-c7c3-4d10-8115-bc9272dc6ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:02.834392 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720be576-c7c3-4d10-8115-bc9272dc6ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:02.836241 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720be576-c7c3-4d10-8115-bc9272dc6ce4 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:02.849382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 665/1319] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:41:04.406847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46303e7-fc65-4283-a001-f262fb037d93 service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:04.409500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a46303e7-fc65-4283-a001-f262fb037d93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:04.429756 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720be576-c7c3-4d10-8115-bc9272dc6ce4 service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:04.431957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-720be576-c7c3-4d10-8115-bc9272dc6ce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:04.438076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46303e7-fc65-4283-a001-f262fb037d93 service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:04.461899 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720be576-c7c3-4d10-8115-bc9272dc6ce4 service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:04.467176 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e6a3f-44c0-4785-9443-04293003c730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:04.467938 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e6a3f-44c0-4785-9443-04293003c730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:04.468284 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e6a3f-44c0-4785-9443-04293003c730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:04.468562 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e6a3f-44c0-4785-9443-04293003c730 admin admin] PATH_INFO: `/v3/projects/fcdfcea5bffc4b13b5fc1bf6b335a5bf` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:04.470864 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e6a3f-44c0-4785-9443-04293003c730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcdfcea5bffc4b13b5fc1bf6b335a5bf)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:04.471967 dv-cinder-779233-7-smb devstack@keystone.service[81802]: WARNING py.warnings [None req-573e6a3f-44c0-4785-9443-04293003c730 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 14:41:04.471967 dv-cinder-779233-7-smb devstack@keystone.service[81802]: warnings.warn(msg) Oct 20 14:41:04.471967 dv-cinder-779233-7-smb devstack@keystone.service[81802]: Oct 20 14:41:04.478964 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e6a3f-44c0-4785-9443-04293003c730 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:04.491593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd0252-31db-4e4e-b90a-eb0628d8d439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:04.492321 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd0252-31db-4e4e-b90a-eb0628d8d439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:04.492743 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd0252-31db-4e4e-b90a-eb0628d8d439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:04.493478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd0252-31db-4e4e-b90a-eb0628d8d439 admin admin] PATH_INFO: `/v3/users/17b4f0bec8cf413f8f0d86bd77211e1f` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:04.495170 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd0252-31db-4e4e-b90a-eb0628d8d439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b4f0bec8cf413f8f0d86bd77211e1f)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:04.498076 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd0252-31db-4e4e-b90a-eb0628d8d439 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:04.598370 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:04.645718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-573e6a3f-44c0-4785-9443-04293003c730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcdfcea5bffc4b13b5fc1bf6b335a5bf', 'request_id': 'req-573e6a3f-44c0-4785-9443-04293003c730'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:04.664150 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-58bd0252-31db-4e4e-b90a-eb0628d8d439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b4f0bec8cf413f8f0d86bd77211e1f'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:04.667644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-573e6a3f-44c0-4785-9443-04293003c730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcdfcea5bffc4b13b5fc1bf6b335a5bf', 'request_id': 'req-573e6a3f-44c0-4785-9443-04293003c730'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:04.680959 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-573e6a3f-44c0-4785-9443-04293003c730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcdfcea5bffc4b13b5fc1bf6b335a5bf', 'request_id': 'req-573e6a3f-44c0-4785-9443-04293003c730'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:04.686467 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-58bd0252-31db-4e4e-b90a-eb0628d8d439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b4f0bec8cf413f8f0d86bd77211e1f'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:04.718709 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-58bd0252-31db-4e4e-b90a-eb0628d8d439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b4f0bec8cf413f8f0d86bd77211e1f'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:04.720575 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-573e6a3f-44c0-4785-9443-04293003c730 admin admin] The token cache is being invalidate because project fcdfcea5bffc4b13b5fc1bf6b335a5bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:04.721066 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-58bd0252-31db-4e4e-b90a-eb0628d8d439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b4f0bec8cf413f8f0d86bd77211e1f'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:04.721213 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-573e6a3f-44c0-4785-9443-04293003c730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:04.722145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-573e6a3f-44c0-4785-9443-04293003c730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:04.724330 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 655/1320] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:04 2022] DELETE /identity/v3/projects/fcdfcea5bffc4b13b5fc1bf6b335a5bf => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:04.725409 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e6a3f-44c0-4785-9443-04293003c730 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:04.727316 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-573e6a3f-44c0-4785-9443-04293003c730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:04.746533 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-58bd0252-31db-4e4e-b90a-eb0628d8d439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b4f0bec8cf413f8f0d86bd77211e1f'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:04.758480 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 666/1321] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:04 2022] DELETE /identity/v3/users/17b4f0bec8cf413f8f0d86bd77211e1f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:41:04.763957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd0252-31db-4e4e-b90a-eb0628d8d439 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:04.766598 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-58bd0252-31db-4e4e-b90a-eb0628d8d439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:04.857139 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:04.873214 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e6a3f-44c0-4785-9443-04293003c730 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:04.937748 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd0252-31db-4e4e-b90a-eb0628d8d439 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:04.950805 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dc92e-379a-41f1-a33c-31fd6d7c1a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:04.952932 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dc92e-379a-41f1-a33c-31fd6d7c1a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:04.953317 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dc92e-379a-41f1-a33c-31fd6d7c1a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:04.953601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dc92e-379a-41f1-a33c-31fd6d7c1a3a admin admin] PATH_INFO: `/v3/users/e4b23344518f4a759536adfea0fa98ad` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:04.956128 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917dc92e-379a-41f1-a33c-31fd6d7c1a3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4b23344518f4a759536adfea0fa98ad)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:04.961277 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917dc92e-379a-41f1-a33c-31fd6d7c1a3a admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:05.062394 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddb464-ec63-41d9-a633-78d0248f5564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:05.063072 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddb464-ec63-41d9-a633-78d0248f5564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:05.070039 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddb464-ec63-41d9-a633-78d0248f5564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:05.070348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddb464-ec63-41d9-a633-78d0248f5564 admin admin] PATH_INFO: `/v3/projects/f0411e6298d947cabdc31fae14b51075` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:05.074784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddb464-ec63-41d9-a633-78d0248f5564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0411e6298d947cabdc31fae14b51075)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:05.076794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddb464-ec63-41d9-a633-78d0248f5564 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:05.088188 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-917dc92e-379a-41f1-a33c-31fd6d7c1a3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4b23344518f4a759536adfea0fa98ad'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:05.104254 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-917dc92e-379a-41f1-a33c-31fd6d7c1a3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4b23344518f4a759536adfea0fa98ad'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:05.136921 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-917dc92e-379a-41f1-a33c-31fd6d7c1a3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4b23344518f4a759536adfea0fa98ad'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:05.141878 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-917dc92e-379a-41f1-a33c-31fd6d7c1a3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4b23344518f4a759536adfea0fa98ad'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:05.160824 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-917dc92e-379a-41f1-a33c-31fd6d7c1a3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4b23344518f4a759536adfea0fa98ad'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:05.176537 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 667/1322] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:04 2022] DELETE /identity/v3/users/e4b23344518f4a759536adfea0fa98ad => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:05.179041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72ecb8-d923-4d33-adba-28426283cb6c None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:05.180115 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72ecb8-d923-4d33-adba-28426283cb6c None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:05.180747 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72ecb8-d923-4d33-adba-28426283cb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:05.223582 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0dddb464-ec63-41d9-a633-78d0248f5564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0411e6298d947cabdc31fae14b51075', 'request_id': 'req-0dddb464-ec63-41d9-a633-78d0248f5564'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:05.241834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-1d72ecb8-d923-4d33-adba-28426283cb6c None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:05.244574 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0dddb464-ec63-41d9-a633-78d0248f5564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0411e6298d947cabdc31fae14b51075', 'request_id': 'req-0dddb464-ec63-41d9-a633-78d0248f5564'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:05.251408 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-1d72ecb8-d923-4d33-adba-28426283cb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:05.262577 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0dddb464-ec63-41d9-a633-78d0248f5564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0411e6298d947cabdc31fae14b51075', 'request_id': 'req-0dddb464-ec63-41d9-a633-78d0248f5564'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:05.264123 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:05.292453 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0dddb464-ec63-41d9-a633-78d0248f5564 admin admin] The token cache is being invalidate because project f0411e6298d947cabdc31fae14b51075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:05.292840 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0dddb464-ec63-41d9-a633-78d0248f5564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:05.296921 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0dddb464-ec63-41d9-a633-78d0248f5564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:05.305455 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 656/1323] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:04 2022] DELETE /identity/v3/projects/f0411e6298d947cabdc31fae14b51075 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:05.312390 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12cf41-4909-4a5f-b8c0-27ebef28f7de None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:05.312734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12cf41-4909-4a5f-b8c0-27ebef28f7de None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:05.313039 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12cf41-4909-4a5f-b8c0-27ebef28f7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:05.358099 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-2d12cf41-4909-4a5f-b8c0-27ebef28f7de None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:05.360980 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-2d12cf41-4909-4a5f-b8c0-27ebef28f7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:05.407664 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 668/1324] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:05.472957 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 657/1325] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:05.481556 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ea2a4-a5a3-448b-a7aa-7cdbd7ab881d None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:05.482122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ea2a4-a5a3-448b-a7aa-7cdbd7ab881d None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:05.482205 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ea2a4-a5a3-448b-a7aa-7cdbd7ab881d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:05.511834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12cf41-4909-4a5f-b8c0-27ebef28f7de None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:05.513287 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-2d12cf41-4909-4a5f-b8c0-27ebef28f7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:05.536492 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-744ea2a4-a5a3-448b-a7aa-7cdbd7ab881d None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:05.537721 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-744ea2a4-a5a3-448b-a7aa-7cdbd7ab881d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:05.570960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 669/1326] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:05.577649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ea2a4-a5a3-448b-a7aa-7cdbd7ab881d None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:05.599643 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ea2a4-a5a3-448b-a7aa-7cdbd7ab881d None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:05.626762 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa2d55-f56c-47d2-a2ca-fecc7c3a0ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:05.627169 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa2d55-f56c-47d2-a2ca-fecc7c3a0ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:05.627411 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa2d55-f56c-47d2-a2ca-fecc7c3a0ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:05.627685 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa2d55-f56c-47d2-a2ca-fecc7c3a0ef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:05.628343 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa2d55-f56c-47d2-a2ca-fecc7c3a0ef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:41:05.628647 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa2d55-f56c-47d2-a2ca-fecc7c3a0ef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:05.635607 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa2d55-f56c-47d2-a2ca-fecc7c3a0ef1 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:05.656696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 670/1327] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:41:05.660859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa2d55-f56c-47d2-a2ca-fecc7c3a0ef1 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:05.671171 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12cf41-4909-4a5f-b8c0-27ebef28f7de None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:05.673584 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa2d55-f56c-47d2-a2ca-fecc7c3a0ef1 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:05.676562 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642b8f6-9c9d-454e-bc1b-e9965ca1e614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:05.677379 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642b8f6-9c9d-454e-bc1b-e9965ca1e614 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:05.677875 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642b8f6-9c9d-454e-bc1b-e9965ca1e614 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:05.678407 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642b8f6-9c9d-454e-bc1b-e9965ca1e614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:05.689382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c6ec5-0b4b-4107-a862-8ad61536abac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:05.690160 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c6ec5-0b4b-4107-a862-8ad61536abac admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:05.690532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c6ec5-0b4b-4107-a862-8ad61536abac admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:05.690884 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c6ec5-0b4b-4107-a862-8ad61536abac admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:05.691608 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c6ec5-0b4b-4107-a862-8ad61536abac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:05.694164 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c6ec5-0b4b-4107-a862-8ad61536abac admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:05.707217 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642b8f6-9c9d-454e-bc1b-e9965ca1e614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:05.708917 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642b8f6-9c9d-454e-bc1b-e9965ca1e614 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:05.735105 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 658/1328] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:41:05.774445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 671/1329] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:05 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:05.779259 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642b8f6-9c9d-454e-bc1b-e9965ca1e614 service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:05.793534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642b8f6-9c9d-454e-bc1b-e9965ca1e614 service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:05.940009 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e2aeb-6b1c-4fb2-8156-4234f68f45a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:05.940662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e2aeb-6b1c-4fb2-8156-4234f68f45a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:05.940974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e2aeb-6b1c-4fb2-8156-4234f68f45a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:05.941256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e2aeb-6b1c-4fb2-8156-4234f68f45a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:05.941961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e2aeb-6b1c-4fb2-8156-4234f68f45a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:05.944005 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e2aeb-6b1c-4fb2-8156-4234f68f45a3 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:05.986019 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161181ed-055d-4584-9b04-ab1362f33a94 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:05.986342 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161181ed-055d-4584-9b04-ab1362f33a94 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:05.986582 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161181ed-055d-4584-9b04-ab1362f33a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:05.991322 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 659/1330] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:05 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:05.995745 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e2aeb-6b1c-4fb2-8156-4234f68f45a3 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:05.999088 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:06.013986 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e2aeb-6b1c-4fb2-8156-4234f68f45a3 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:06.028041 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781dd8f-9bfa-44ad-afdb-3ef25074c013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:06.028684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781dd8f-9bfa-44ad-afdb-3ef25074c013 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:06.028970 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781dd8f-9bfa-44ad-afdb-3ef25074c013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:06.029246 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781dd8f-9bfa-44ad-afdb-3ef25074c013 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:06.030029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781dd8f-9bfa-44ad-afdb-3ef25074c013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:06.031764 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781dd8f-9bfa-44ad-afdb-3ef25074c013 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:06.037295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-161181ed-055d-4584-9b04-ab1362f33a94 None None] MFA Rules not processed for user `218e5a1ab3a948079eed1592c8867bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:06.038694 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-161181ed-055d-4584-9b04-ab1362f33a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:06.053977 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 660/1331] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:06.074236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781dd8f-9bfa-44ad-afdb-3ef25074c013 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:06.095183 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781dd8f-9bfa-44ad-afdb-3ef25074c013 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:06.104534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4400a6-f1b8-4237-ac5a-31096bf9f1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:06.104534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4400a6-f1b8-4237-ac5a-31096bf9f1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:06.104906 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4400a6-f1b8-4237-ac5a-31096bf9f1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:06.105001 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4400a6-f1b8-4237-ac5a-31096bf9f1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:06.105663 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4400a6-f1b8-4237-ac5a-31096bf9f1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:06.108275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4400a6-f1b8-4237-ac5a-31096bf9f1e2 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:06.134544 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 661/1332] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:06.139076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4400a6-f1b8-4237-ac5a-31096bf9f1e2 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:06.148004 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:06.152893 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4400a6-f1b8-4237-ac5a-31096bf9f1e2 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:06.168909 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94b9c1-f197-49a6-9bed-f564a5bc56ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:06.168909 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94b9c1-f197-49a6-9bed-f564a5bc56ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:06.168909 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94b9c1-f197-49a6-9bed-f564a5bc56ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:06.168909 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94b9c1-f197-49a6-9bed-f564a5bc56ec admin admin] PATH_INFO: `/v3/projects/921b60225e88451680b7392a7b9ef204/users/327a221009664f66a1a2e0a9e26d1d4c/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:06.181037 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 672/1333] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:06.184466 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841fd75-a9f6-4fff-acd3-fcf481faccaa None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:06.184759 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841fd75-a9f6-4fff-acd3-fcf481faccaa None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:06.185040 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841fd75-a9f6-4fff-acd3-fcf481faccaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:06.205921 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94b9c1-f197-49a6-9bed-f564a5bc56ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=921b60225e88451680b7392a7b9ef204, user_id=327a221009664f66a1a2e0a9e26d1d4c, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:06.207632 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94b9c1-f197-49a6-9bed-f564a5bc56ec admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:06.230571 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-3841fd75-a9f6-4fff-acd3-fcf481faccaa None None] MFA Rules not processed for user `218e5a1ab3a948079eed1592c8867bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:06.241318 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-3841fd75-a9f6-4fff-acd3-fcf481faccaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:06.253157 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 662/1334] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:06 2022] PUT /identity/v3/projects/921b60225e88451680b7392a7b9ef204/users/327a221009664f66a1a2e0a9e26d1d4c/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:41:06.266576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475e2b4-4b6d-44b4-be7a-12bd57f7eff4 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:06.266869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475e2b4-4b6d-44b4-be7a-12bd57f7eff4 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:06.267144 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475e2b4-4b6d-44b4-be7a-12bd57f7eff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:06.313121 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-6475e2b4-4b6d-44b4-be7a-12bd57f7eff4 None None] MFA Rules not processed for user `327a221009664f66a1a2e0a9e26d1d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:06.314422 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-6475e2b4-4b6d-44b4-be7a-12bd57f7eff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:06.495099 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 673/1335] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:06.525509 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841fd75-a9f6-4fff-acd3-fcf481faccaa None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:06.530099 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-3841fd75-a9f6-4fff-acd3-fcf481faccaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:06.626431 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 663/1336] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:41:06.629226 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475e2b4-4b6d-44b4-be7a-12bd57f7eff4 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:06.631625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-6475e2b4-4b6d-44b4-be7a-12bd57f7eff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:06.742971 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841fd75-a9f6-4fff-acd3-fcf481faccaa None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:06.774078 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011a5b8-1206-49e6-a600-7a90c839732c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:06.774751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011a5b8-1206-49e6-a600-7a90c839732c service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:06.775062 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011a5b8-1206-49e6-a600-7a90c839732c service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:06.777503 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011a5b8-1206-49e6-a600-7a90c839732c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:06.799532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011a5b8-1206-49e6-a600-7a90c839732c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:06.801154 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011a5b8-1206-49e6-a600-7a90c839732c service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:06.848117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475e2b4-4b6d-44b4-be7a-12bd57f7eff4 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:06.859621 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 674/1337] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:06.860748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b1821-a360-4861-8bfb-2d1fdc66e932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:06.861488 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b1821-a360-4861-8bfb-2d1fdc66e932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:06.861862 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b1821-a360-4861-8bfb-2d1fdc66e932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:06.862207 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b1821-a360-4861-8bfb-2d1fdc66e932 admin admin] PATH_INFO: `/v3/users/c573eb746e954dc2b20255b5fe9ed02d` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:06.864151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011a5b8-1206-49e6-a600-7a90c839732c service nova] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:06.865227 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b1821-a360-4861-8bfb-2d1fdc66e932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c573eb746e954dc2b20255b5fe9ed02d)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:06.867355 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b1821-a360-4861-8bfb-2d1fdc66e932 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:06.906655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011a5b8-1206-49e6-a600-7a90c839732c service nova] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:06.922424 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93b3de-8eb3-4765-bad7-6664cc456e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:06.924445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93b3de-8eb3-4765-bad7-6664cc456e00 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:06.924807 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93b3de-8eb3-4765-bad7-6664cc456e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:06.925213 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93b3de-8eb3-4765-bad7-6664cc456e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:06.927026 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93b3de-8eb3-4765-bad7-6664cc456e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:06.936245 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93b3de-8eb3-4765-bad7-6664cc456e00 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:06.979099 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d56b1821-a360-4861-8bfb-2d1fdc66e932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c573eb746e954dc2b20255b5fe9ed02d'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:07.002123 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d56b1821-a360-4861-8bfb-2d1fdc66e932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c573eb746e954dc2b20255b5fe9ed02d'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:07.007003 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d56b1821-a360-4861-8bfb-2d1fdc66e932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c573eb746e954dc2b20255b5fe9ed02d'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:07.007824 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d56b1821-a360-4861-8bfb-2d1fdc66e932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c573eb746e954dc2b20255b5fe9ed02d'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:07.025575 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d56b1821-a360-4861-8bfb-2d1fdc66e932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c573eb746e954dc2b20255b5fe9ed02d'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:07.031876 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 675/1338] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:06 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:07.032830 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93b3de-8eb3-4765-bad7-6664cc456e00 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:07.041180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-6b93b3de-8eb3-4765-bad7-6664cc456e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:07.047104 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:07.047400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:07.083686 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 664/1339] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:06 2022] DELETE /identity/v3/users/c573eb746e954dc2b20255b5fe9ed02d => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:07.088715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419f9f5-1d6f-4a18-9a6c-edc83c1af1eb None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:07.089037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419f9f5-1d6f-4a18-9a6c-edc83c1af1eb None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:07.089291 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419f9f5-1d6f-4a18-9a6c-edc83c1af1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:07.138880 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-e419f9f5-1d6f-4a18-9a6c-edc83c1af1eb None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:07.140127 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e419f9f5-1d6f-4a18-9a6c-edc83c1af1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:07.196183 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93b3de-8eb3-4765-bad7-6664cc456e00 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:07.363915 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 665/1340] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:41:07.364804 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419f9f5-1d6f-4a18-9a6c-edc83c1af1eb None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:07.367229 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e419f9f5-1d6f-4a18-9a6c-edc83c1af1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:07.405684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419f9f5-1d6f-4a18-9a6c-edc83c1af1eb None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:07.421914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02caa559-52ac-48b8-a8dd-30d5272b9e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:07.422563 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caa559-52ac-48b8-a8dd-30d5272b9e87 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:07.422846 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caa559-52ac-48b8-a8dd-30d5272b9e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:07.423127 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caa559-52ac-48b8-a8dd-30d5272b9e87 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:07.423773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02caa559-52ac-48b8-a8dd-30d5272b9e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:07.426516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3bae8-f5ef-4eee-84f2-2a13b76f5a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:07.427178 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3bae8-f5ef-4eee-84f2-2a13b76f5a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:07.427611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3bae8-f5ef-4eee-84f2-2a13b76f5a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:07.427888 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3bae8-f5ef-4eee-84f2-2a13b76f5a36 admin admin] PATH_INFO: `/v3/projects/78484c4f65d74fb6912170f28a027990` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:07.429952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02caa559-52ac-48b8-a8dd-30d5272b9e87 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:07.433322 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3bae8-f5ef-4eee-84f2-2a13b76f5a36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78484c4f65d74fb6912170f28a027990)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:07.435753 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3bae8-f5ef-4eee-84f2-2a13b76f5a36 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:07.494784 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 676/1341] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:07 2022] POST /identity/v3/users => generated 295 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:07.495795 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02caa559-52ac-48b8-a8dd-30d5272b9e87 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:07.532944 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02caa559-52ac-48b8-a8dd-30d5272b9e87 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:07.566381 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f9ceb-5b25-473a-ba88-016b2e8c8f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:07.566753 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f9ceb-5b25-473a-ba88-016b2e8c8f1a admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:07.567101 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f9ceb-5b25-473a-ba88-016b2e8c8f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:07.567384 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f9ceb-5b25-473a-ba88-016b2e8c8f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:07.568719 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f9ceb-5b25-473a-ba88-016b2e8c8f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:07.570416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f9ceb-5b25-473a-ba88-016b2e8c8f1a admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:07.580906 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-b6b3bae8-f5ef-4eee-84f2-2a13b76f5a36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78484c4f65d74fb6912170f28a027990', 'request_id': 'req-b6b3bae8-f5ef-4eee-84f2-2a13b76f5a36'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:07.598216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-b6b3bae8-f5ef-4eee-84f2-2a13b76f5a36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78484c4f65d74fb6912170f28a027990', 'request_id': 'req-b6b3bae8-f5ef-4eee-84f2-2a13b76f5a36'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:07.619784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-b6b3bae8-f5ef-4eee-84f2-2a13b76f5a36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78484c4f65d74fb6912170f28a027990', 'request_id': 'req-b6b3bae8-f5ef-4eee-84f2-2a13b76f5a36'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:07.630186 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 677/1342] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:07.631117 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f9ceb-5b25-473a-ba88-016b2e8c8f1a admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:07.638146 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-4a3f9ceb-5b25-473a-ba88-016b2e8c8f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:07.654860 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-b6b3bae8-f5ef-4eee-84f2-2a13b76f5a36 admin admin] The token cache is being invalidate because project 78484c4f65d74fb6912170f28a027990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:07.655384 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-b6b3bae8-f5ef-4eee-84f2-2a13b76f5a36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:07.657187 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-b6b3bae8-f5ef-4eee-84f2-2a13b76f5a36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:07.662956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 666/1343] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:07 2022] DELETE /identity/v3/projects/78484c4f65d74fb6912170f28a027990 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:07.663888 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3bae8-f5ef-4eee-84f2-2a13b76f5a36 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:07.667191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-b6b3bae8-f5ef-4eee-84f2-2a13b76f5a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:07.820299 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f9ceb-5b25-473a-ba88-016b2e8c8f1a admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:07.905018 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:07.927570 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde9423-792c-48dd-87f0-13b6b30517fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:07.931345 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde9423-792c-48dd-87f0-13b6b30517fc service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:07.933039 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde9423-792c-48dd-87f0-13b6b30517fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:07.933390 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde9423-792c-48dd-87f0-13b6b30517fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:07.937978 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ccde9423-792c-48dd-87f0-13b6b30517fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:07.959499 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3bae8-f5ef-4eee-84f2-2a13b76f5a36 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:07.965394 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde9423-792c-48dd-87f0-13b6b30517fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:07.980407 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde9423-792c-48dd-87f0-13b6b30517fc service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:07.985152 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e6a26-66b2-47dd-bffd-af19be515871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:07.986121 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e6a26-66b2-47dd-bffd-af19be515871 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:07.987613 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e6a26-66b2-47dd-bffd-af19be515871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:07.987973 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e6a26-66b2-47dd-bffd-af19be515871 admin admin] PATH_INFO: `/v3/projects/d9251a1d77f349f895a1abd480ed0753/users/ae75c1bdead344938557ccf2ad665b9b/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:07.993480 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 678/1344] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:07.995553 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2fc27-d301-456b-895e-f01ea6f0d83a None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:07.995904 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2fc27-d301-456b-895e-f01ea6f0d83a None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:07.996244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2fc27-d301-456b-895e-f01ea6f0d83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:08.025944 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e6a26-66b2-47dd-bffd-af19be515871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9251a1d77f349f895a1abd480ed0753, user_id=ae75c1bdead344938557ccf2ad665b9b, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:08.028637 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e6a26-66b2-47dd-bffd-af19be515871 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:08.039840 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-e6a2fc27-d301-456b-895e-f01ea6f0d83a None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:08.041741 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:08.042101 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e6a2fc27-d301-456b-895e-f01ea6f0d83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:08.068691 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 667/1345] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:07 2022] PUT /identity/v3/projects/d9251a1d77f349f895a1abd480ed0753/users/ae75c1bdead344938557ccf2ad665b9b/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:08.073026 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e6a26-66b2-47dd-bffd-af19be515871 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:08.097557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 679/1346] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:08.099107 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65305955-305b-4ce7-9f29-66daf600c6ef None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:08.099391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65305955-305b-4ce7-9f29-66daf600c6ef None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:08.099671 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65305955-305b-4ce7-9f29-66daf600c6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:08.159011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-65305955-305b-4ce7-9f29-66daf600c6ef None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:08.167456 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-65305955-305b-4ce7-9f29-66daf600c6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:08.298676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e6a26-66b2-47dd-bffd-af19be515871 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:08.303380 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000fdd5-e702-46f0-be04-c4f37ad9373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:08.304003 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000fdd5-e702-46f0-be04-c4f37ad9373f admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:08.304360 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000fdd5-e702-46f0-be04-c4f37ad9373f admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:08.304715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000fdd5-e702-46f0-be04-c4f37ad9373f admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:08.305495 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000fdd5-e702-46f0-be04-c4f37ad9373f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:08.308013 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000fdd5-e702-46f0-be04-c4f37ad9373f admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:08.323785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 668/1347] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:41:08.325494 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054299f-0a13-4b7f-a3a1-b84b1885022c None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:08.325878 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054299f-0a13-4b7f-a3a1-b84b1885022c None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:08.326266 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054299f-0a13-4b7f-a3a1-b84b1885022c None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:08.327811 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 669/1348] 10.222.0.17 () {54 vars in 912 bytes} [Thu Oct 20 14:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:41:08.328640 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054299f-0a13-4b7f-a3a1-b84b1885022c None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:08.351249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054299f-0a13-4b7f-a3a1-b84b1885022c None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:08.355164 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 680/1349] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:08.356588 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24fd9a-139e-4dd8-a3c5-f27fc4a9ee15 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:08.356883 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24fd9a-139e-4dd8-a3c5-f27fc4a9ee15 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:08.357169 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24fd9a-139e-4dd8-a3c5-f27fc4a9ee15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:08.364947 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef991e8-e015-41d5-adb0-0dd6abe75004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:08.366004 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef991e8-e015-41d5-adb0-0dd6abe75004 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:08.366403 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef991e8-e015-41d5-adb0-0dd6abe75004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:08.366751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef991e8-e015-41d5-adb0-0dd6abe75004 admin admin] PATH_INFO: `/v3/projects/d9251a1d77f349f895a1abd480ed0753/users/ae75c1bdead344938557ccf2ad665b9b/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:08.370993 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef991e8-e015-41d5-adb0-0dd6abe75004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9251a1d77f349f895a1abd480ed0753, user_id=ae75c1bdead344938557ccf2ad665b9b, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:08.377456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef991e8-e015-41d5-adb0-0dd6abe75004 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:08.409196 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 670/1350] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:08 2022] PUT /identity/v3/projects/d9251a1d77f349f895a1abd480ed0753/users/ae75c1bdead344938557ccf2ad665b9b/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:08.410399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef991e8-e015-41d5-adb0-0dd6abe75004 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:08.438878 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-2f24fd9a-139e-4dd8-a3c5-f27fc4a9ee15 None None] MFA Rules not processed for user `359e9d904b0d43acae86337c1eb6a71d`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:08.440130 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2f24fd9a-139e-4dd8-a3c5-f27fc4a9ee15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:08.531755 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef991e8-e015-41d5-adb0-0dd6abe75004 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:08.537529 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26903809-de6c-49d2-8e93-e6da124cc142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:08.538675 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26903809-de6c-49d2-8e93-e6da124cc142 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:08.539164 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26903809-de6c-49d2-8e93-e6da124cc142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:08.540344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26903809-de6c-49d2-8e93-e6da124cc142 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:08.541547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26903809-de6c-49d2-8e93-e6da124cc142 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:41:08.543348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26903809-de6c-49d2-8e93-e6da124cc142 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:08.545407 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26903809-de6c-49d2-8e93-e6da124cc142 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:08.572312 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 671/1351] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:41:08.574460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d912a30-86ac-4685-951e-ca6644d49923 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:08.574973 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d912a30-86ac-4685-951e-ca6644d49923 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:08.575466 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d912a30-86ac-4685-951e-ca6644d49923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:08.577509 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 681/1352] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Oct 20 14:41:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:08.578434 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24fd9a-139e-4dd8-a3c5-f27fc4a9ee15 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:08.579934 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2f24fd9a-139e-4dd8-a3c5-f27fc4a9ee15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:08.612747 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24fd9a-139e-4dd8-a3c5-f27fc4a9ee15 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:08.630732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda4da7-3ed5-4616-a207-7690a7a98246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:08.631401 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda4da7-3ed5-4616-a207-7690a7a98246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:08.631682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda4da7-3ed5-4616-a207-7690a7a98246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:08.631958 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda4da7-3ed5-4616-a207-7690a7a98246 admin admin] PATH_INFO: `/v3/projects/d78d7ca5af3241a78ac49b96168fa56c` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:08.636119 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda4da7-3ed5-4616-a207-7690a7a98246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d78d7ca5af3241a78ac49b96168fa56c)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:08.640766 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-0d912a30-86ac-4685-951e-ca6644d49923 None None] MFA Rules not processed for user `ae75c1bdead344938557ccf2ad665b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:08.641488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda4da7-3ed5-4616-a207-7690a7a98246 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:08.650366 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-0d912a30-86ac-4685-951e-ca6644d49923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:08.741231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-1bda4da7-3ed5-4616-a207-7690a7a98246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd78d7ca5af3241a78ac49b96168fa56c', 'request_id': 'req-1bda4da7-3ed5-4616-a207-7690a7a98246'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:08.747753 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-1bda4da7-3ed5-4616-a207-7690a7a98246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd78d7ca5af3241a78ac49b96168fa56c', 'request_id': 'req-1bda4da7-3ed5-4616-a207-7690a7a98246'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:08.760406 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-1bda4da7-3ed5-4616-a207-7690a7a98246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd78d7ca5af3241a78ac49b96168fa56c', 'request_id': 'req-1bda4da7-3ed5-4616-a207-7690a7a98246'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:08.776810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:08.789420 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-1bda4da7-3ed5-4616-a207-7690a7a98246 admin admin] The token cache is being invalidate because project d78d7ca5af3241a78ac49b96168fa56c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:08.791590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-1bda4da7-3ed5-4616-a207-7690a7a98246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:08.799219 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-1bda4da7-3ed5-4616-a207-7690a7a98246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:08.807291 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 682/1353] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:08 2022] DELETE /identity/v3/projects/d78d7ca5af3241a78ac49b96168fa56c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:08.808589 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda4da7-3ed5-4616-a207-7690a7a98246 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:08.814031 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-1bda4da7-3ed5-4616-a207-7690a7a98246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:08.820261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:08.830701 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 672/1354] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:08.831932 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d912a30-86ac-4685-951e-ca6644d49923 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:08.835285 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-0d912a30-86ac-4685-951e-ca6644d49923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:08.865595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d912a30-86ac-4685-951e-ca6644d49923 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:08.948087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2184539-fe33-49c1-867d-c61bb15c4edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:08.948584 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2184539-fe33-49c1-867d-c61bb15c4edb service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:08.948858 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2184539-fe33-49c1-867d-c61bb15c4edb service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:08.949133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2184539-fe33-49c1-867d-c61bb15c4edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:08.951071 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-f2184539-fe33-49c1-867d-c61bb15c4edb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:08.964248 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2184539-fe33-49c1-867d-c61bb15c4edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:08.966059 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2184539-fe33-49c1-867d-c61bb15c4edb service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:08.977396 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 673/1355] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:08.979387 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0370f-4589-4597-afb0-a854addf1b84 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:08.979992 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0370f-4589-4597-afb0-a854addf1b84 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:08.980265 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0370f-4589-4597-afb0-a854addf1b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:08.988314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda4da7-3ed5-4616-a207-7690a7a98246 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:09.003516 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f7daa-d8a5-4fac-8df4-31528b4e0a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:09.004474 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f7daa-d8a5-4fac-8df4-31528b4e0a5b admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:09.004996 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f7daa-d8a5-4fac-8df4-31528b4e0a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:09.005471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f7daa-d8a5-4fac-8df4-31528b4e0a5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:09.006412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f7daa-d8a5-4fac-8df4-31528b4e0a5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:09.008228 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-6cb0370f-4589-4597-afb0-a854addf1b84 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:09.008871 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f7daa-d8a5-4fac-8df4-31528b4e0a5b admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:09.011370 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-6cb0370f-4589-4597-afb0-a854addf1b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:09.033183 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 674/1356] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:09.034450 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0370f-4589-4597-afb0-a854addf1b84 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:09.041191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-6cb0370f-4589-4597-afb0-a854addf1b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:09.064479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 683/1357] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:08 2022] POST /identity/v3/projects => generated 355 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:09.069460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56524e3c-00e2-4dd8-811c-dfe02295b353 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:09.070067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56524e3c-00e2-4dd8-811c-dfe02295b353 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:09.072295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56524e3c-00e2-4dd8-811c-dfe02295b353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:09.111445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-56524e3c-00e2-4dd8-811c-dfe02295b353 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:09.113725 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-56524e3c-00e2-4dd8-811c-dfe02295b353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:09.187973 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0370f-4589-4597-afb0-a854addf1b84 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:09.279452 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 684/1358] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:09.279452 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56524e3c-00e2-4dd8-811c-dfe02295b353 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:09.282224 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd48ec2-3e79-4011-a8c1-c6a533fa0e58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:09.283823 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd48ec2-3e79-4011-a8c1-c6a533fa0e58 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:09.284843 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd48ec2-3e79-4011-a8c1-c6a533fa0e58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:09.285220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd48ec2-3e79-4011-a8c1-c6a533fa0e58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:09.287344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-7cd48ec2-3e79-4011-a8c1-c6a533fa0e58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:09.300955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56524e3c-00e2-4dd8-811c-dfe02295b353 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:09.307958 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb2e11-1560-4def-9b58-6b87154b1a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:09.308857 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb2e11-1560-4def-9b58-6b87154b1a34 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:09.309155 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb2e11-1560-4def-9b58-6b87154b1a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:09.309427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb2e11-1560-4def-9b58-6b87154b1a34 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:09.310550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb2e11-1560-4def-9b58-6b87154b1a34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:09.313809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb2e11-1560-4def-9b58-6b87154b1a34 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:09.359883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd48ec2-3e79-4011-a8c1-c6a533fa0e58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:09.363455 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd48ec2-3e79-4011-a8c1-c6a533fa0e58 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:09.371035 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 685/1359] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:09 2022] POST /identity/v3/users => generated 278 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:09.376030 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb2e11-1560-4def-9b58-6b87154b1a34 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:09.379542 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-d3bb2e11-1560-4def-9b58-6b87154b1a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:09.388155 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 675/1360] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:09.390848 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd48ec2-3e79-4011-a8c1-c6a533fa0e58 service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:09.408860 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:09.409346 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb2e11-1560-4def-9b58-6b87154b1a34 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:09.415308 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd48ec2-3e79-4011-a8c1-c6a533fa0e58 service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:09.417792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea3aab-2a21-4b22-9b19-8ad8d803819c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:09.419365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea3aab-2a21-4b22-9b19-8ad8d803819c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:09.419795 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea3aab-2a21-4b22-9b19-8ad8d803819c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:09.420065 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea3aab-2a21-4b22-9b19-8ad8d803819c admin admin] PATH_INFO: `/v3/projects/78c7bfb80dc941938c33350f70316dec` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:09.421832 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06961559-4410-4c81-80c6-28a3f12a7c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:09.422005 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea3aab-2a21-4b22-9b19-8ad8d803819c admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c7bfb80dc941938c33350f70316dec)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:09.424598 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea3aab-2a21-4b22-9b19-8ad8d803819c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:09.428026 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06961559-4410-4c81-80c6-28a3f12a7c10 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:09.428497 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06961559-4410-4c81-80c6-28a3f12a7c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:09.428898 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06961559-4410-4c81-80c6-28a3f12a7c10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:09.430045 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06961559-4410-4c81-80c6-28a3f12a7c10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:41:09.430456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06961559-4410-4c81-80c6-28a3f12a7c10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:09.439710 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06961559-4410-4c81-80c6-28a3f12a7c10 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:09.469880 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 676/1361] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:41:09.471270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06961559-4410-4c81-80c6-28a3f12a7c10 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:09.487316 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06961559-4410-4c81-80c6-28a3f12a7c10 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:09.511934 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-44ea3aab-2a21-4b22-9b19-8ad8d803819c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c7bfb80dc941938c33350f70316dec', 'request_id': 'req-44ea3aab-2a21-4b22-9b19-8ad8d803819c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:09.519840 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-44ea3aab-2a21-4b22-9b19-8ad8d803819c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c7bfb80dc941938c33350f70316dec', 'request_id': 'req-44ea3aab-2a21-4b22-9b19-8ad8d803819c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:09.526428 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:09.534914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-44ea3aab-2a21-4b22-9b19-8ad8d803819c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c7bfb80dc941938c33350f70316dec', 'request_id': 'req-44ea3aab-2a21-4b22-9b19-8ad8d803819c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:09.583732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-44ea3aab-2a21-4b22-9b19-8ad8d803819c admin admin] The token cache is being invalidate because project 78c7bfb80dc941938c33350f70316dec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:09.584323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-44ea3aab-2a21-4b22-9b19-8ad8d803819c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:09.585699 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-44ea3aab-2a21-4b22-9b19-8ad8d803819c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:09.592041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 686/1362] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:09 2022] DELETE /identity/v3/projects/78c7bfb80dc941938c33350f70316dec => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:09.593402 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea3aab-2a21-4b22-9b19-8ad8d803819c admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:09.599735 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-44ea3aab-2a21-4b22-9b19-8ad8d803819c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:09.631910 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c21089-2123-4020-a9b4-9f0d26776d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:09.632921 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c21089-2123-4020-a9b4-9f0d26776d5b admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:09.633063 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c21089-2123-4020-a9b4-9f0d26776d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:09.633501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c21089-2123-4020-a9b4-9f0d26776d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:09.634806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c21089-2123-4020-a9b4-9f0d26776d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:09.636530 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c21089-2123-4020-a9b4-9f0d26776d5b admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:09.687357 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 677/1363] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:09.697435 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46841f0-dbf4-4cf2-b420-54d52371d1f0 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:09.699111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46841f0-dbf4-4cf2-b420-54d52371d1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:09.702302 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46841f0-dbf4-4cf2-b420-54d52371d1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:09.781062 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-a46841f0-dbf4-4cf2-b420-54d52371d1f0 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:09.784442 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a46841f0-dbf4-4cf2-b420-54d52371d1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:09.823567 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 678/1364] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:09.825967 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46841f0-dbf4-4cf2-b420-54d52371d1f0 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:09.829800 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a46841f0-dbf4-4cf2-b420-54d52371d1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:09.876252 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea3aab-2a21-4b22-9b19-8ad8d803819c admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:09.886474 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46841f0-dbf4-4cf2-b420-54d52371d1f0 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:09.893658 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5691fe-2b89-47e5-9693-f37f2a58c32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:09.898520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5691fe-2b89-47e5-9693-f37f2a58c32f admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:09.898815 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5691fe-2b89-47e5-9693-f37f2a58c32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:09.899093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5691fe-2b89-47e5-9693-f37f2a58c32f admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:09.902610 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5691fe-2b89-47e5-9693-f37f2a58c32f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:09.908096 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179412a8-c167-4f32-a9b7-2279e5f46e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:09.908867 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179412a8-c167-4f32-a9b7-2279e5f46e63 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:09.909204 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179412a8-c167-4f32-a9b7-2279e5f46e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:09.911138 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5691fe-2b89-47e5-9693-f37f2a58c32f admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:09.911737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179412a8-c167-4f32-a9b7-2279e5f46e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:09.915802 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179412a8-c167-4f32-a9b7-2279e5f46e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:09.923151 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179412a8-c167-4f32-a9b7-2279e5f46e63 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:09.959809 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 679/1365] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:09.964438 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c51ee-e330-4b6f-b756-50252de24e49 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:09.964720 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c51ee-e330-4b6f-b756-50252de24e49 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:09.966205 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c51ee-e330-4b6f-b756-50252de24e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:10.011868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 687/1366] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:09 2022] POST /identity/v3/projects => generated 383 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:10.016148 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5691fe-2b89-47e5-9693-f37f2a58c32f admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:10.034856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-a93c51ee-e330-4b6f-b756-50252de24e49 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:10.036161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a93c51ee-e330-4b6f-b756-50252de24e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:10.235698 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5691fe-2b89-47e5-9693-f37f2a58c32f admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:10.263279 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c71781-7b46-4d0d-a5df-8e5b94afc1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:10.263978 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c71781-7b46-4d0d-a5df-8e5b94afc1e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:10.264256 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c71781-7b46-4d0d-a5df-8e5b94afc1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:10.264526 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c71781-7b46-4d0d-a5df-8e5b94afc1e0 admin admin] PATH_INFO: `/v3/projects/5b4c3c166b5249ccac5551f39d9452a1/users/a6ddba666dc145638a555c4a3fddf7a1/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:10.303061 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 680/1367] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:10.307864 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c51ee-e330-4b6f-b756-50252de24e49 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:10.319125 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c71781-7b46-4d0d-a5df-8e5b94afc1e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4c3c166b5249ccac5551f39d9452a1, user_id=a6ddba666dc145638a555c4a3fddf7a1, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:10.324450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c71781-7b46-4d0d-a5df-8e5b94afc1e0 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:10.333170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c51ee-e330-4b6f-b756-50252de24e49 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:10.348759 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ee1e7-fb9d-4f13-a324-8854f4bb0dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:10.349407 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ee1e7-fb9d-4f13-a324-8854f4bb0dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:10.349682 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ee1e7-fb9d-4f13-a324-8854f4bb0dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:10.349987 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ee1e7-fb9d-4f13-a324-8854f4bb0dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:10.350651 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ee1e7-fb9d-4f13-a324-8854f4bb0dc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:10.352846 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ee1e7-fb9d-4f13-a324-8854f4bb0dc0 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:10.354130 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 688/1368] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:10 2022] PUT /identity/v3/projects/5b4c3c166b5249ccac5551f39d9452a1/users/a6ddba666dc145638a555c4a3fddf7a1/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:10.355166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c71781-7b46-4d0d-a5df-8e5b94afc1e0 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:10.364657 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-84c71781-7b46-4d0d-a5df-8e5b94afc1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:10.403367 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 681/1369] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:10 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:10.403367 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ee1e7-fb9d-4f13-a324-8854f4bb0dc0 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:10.427041 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ee1e7-fb9d-4f13-a324-8854f4bb0dc0 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:10.532381 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:10.547054 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c71781-7b46-4d0d-a5df-8e5b94afc1e0 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:10.548835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:10.560279 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe4db8-8c70-4e89-abb5-8085d38feea6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e94a60e43914cf38a5f2f88b182083f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:10.560925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe4db8-8c70-4e89-abb5-8085d38feea6 service placement] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:10.561218 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe4db8-8c70-4e89-abb5-8085d38feea6 service placement] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:10.561570 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe4db8-8c70-4e89-abb5-8085d38feea6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:10.567402 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-8cfe4db8-8c70-4e89-abb5-8085d38feea6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:10.578307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa136eb6-6256-4245-8c74-4dcc3820ce26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:10.578946 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa136eb6-6256-4245-8c74-4dcc3820ce26 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:10.579229 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa136eb6-6256-4245-8c74-4dcc3820ce26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:10.579506 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa136eb6-6256-4245-8c74-4dcc3820ce26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:10.580170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa136eb6-6256-4245-8c74-4dcc3820ce26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:41:10.580473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa136eb6-6256-4245-8c74-4dcc3820ce26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:10.582309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa136eb6-6256-4245-8c74-4dcc3820ce26 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:10.592198 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe4db8-8c70-4e89-abb5-8085d38feea6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:10.595225 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe4db8-8c70-4e89-abb5-8085d38feea6 service placement] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:10.611692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 682/1370] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:41:10.613257 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425033fc-8bee-4e9e-a0c8-9866cf55b90a None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:10.613548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425033fc-8bee-4e9e-a0c8-9866cf55b90a None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:10.613824 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425033fc-8bee-4e9e-a0c8-9866cf55b90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:10.621084 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 689/1371] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:10.622013 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe4db8-8c70-4e89-abb5-8085d38feea6 service placement] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:10.663369 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe4db8-8c70-4e89-abb5-8085d38feea6 service placement] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:10.682219 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d440fc-9878-4adb-9294-033f01254610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:10.684360 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d440fc-9878-4adb-9294-033f01254610 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:10.687323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d440fc-9878-4adb-9294-033f01254610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:10.688246 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-425033fc-8bee-4e9e-a0c8-9866cf55b90a None None] MFA Rules not processed for user `a6ddba666dc145638a555c4a3fddf7a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:10.688471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d440fc-9878-4adb-9294-033f01254610 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:10.689153 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d440fc-9878-4adb-9294-033f01254610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:10.694992 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-425033fc-8bee-4e9e-a0c8-9866cf55b90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:10.695196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d440fc-9878-4adb-9294-033f01254610 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:10.723728 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 690/1372] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:10.724718 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d440fc-9878-4adb-9294-033f01254610 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:10.747687 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d440fc-9878-4adb-9294-033f01254610 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:10.752990 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d67d5-ef35-4cd5-a411-ea4864c699ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:10.753654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d67d5-ef35-4cd5-a411-ea4864c699ee admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:10.753962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d67d5-ef35-4cd5-a411-ea4864c699ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:10.754231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d67d5-ef35-4cd5-a411-ea4864c699ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:10.754864 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d67d5-ef35-4cd5-a411-ea4864c699ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:10.757273 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d67d5-ef35-4cd5-a411-ea4864c699ee admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:10.825292 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 691/1373] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:10 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:10.826288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d67d5-ef35-4cd5-a411-ea4864c699ee admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:10.849988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 683/1374] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:10.850705 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425033fc-8bee-4e9e-a0c8-9866cf55b90a None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:10.875195 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425033fc-8bee-4e9e-a0c8-9866cf55b90a None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:10.999426 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df042f1a-3b88-4c77-8bcf-17208b4b4123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:11.000142 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df042f1a-3b88-4c77-8bcf-17208b4b4123 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:11.000494 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df042f1a-3b88-4c77-8bcf-17208b4b4123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:11.000936 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df042f1a-3b88-4c77-8bcf-17208b4b4123 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:11.001553 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df042f1a-3b88-4c77-8bcf-17208b4b4123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:11.003596 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df042f1a-3b88-4c77-8bcf-17208b4b4123 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:11.036483 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d67d5-ef35-4cd5-a411-ea4864c699ee admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:11.049451 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 684/1375] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:10 2022] POST /identity/v3/users => generated 286 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:11.050460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df042f1a-3b88-4c77-8bcf-17208b4b4123 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:11.051542 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf181db2-2308-4e0f-9260-8b51670b0ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:11.054490 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf181db2-2308-4e0f-9260-8b51670b0ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:11.054780 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf181db2-2308-4e0f-9260-8b51670b0ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:11.055057 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf181db2-2308-4e0f-9260-8b51670b0ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:11.058035 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf181db2-2308-4e0f-9260-8b51670b0ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:11.062754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf181db2-2308-4e0f-9260-8b51670b0ce4 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:11.074672 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df042f1a-3b88-4c77-8bcf-17208b4b4123 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:11.088454 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03638b96-6e47-430b-9682-251e649faae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:11.089746 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 692/1376] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:11.092567 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03638b96-6e47-430b-9682-251e649faae2 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:11.092712 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf181db2-2308-4e0f-9260-8b51670b0ce4 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:11.092799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03638b96-6e47-430b-9682-251e649faae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:11.093184 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03638b96-6e47-430b-9682-251e649faae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:11.094057 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03638b96-6e47-430b-9682-251e649faae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:11.096004 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03638b96-6e47-430b-9682-251e649faae2 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:11.119045 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf181db2-2308-4e0f-9260-8b51670b0ce4 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:11.133406 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8522d-3f22-405a-9af0-dd663a659ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:11.138063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8522d-3f22-405a-9af0-dd663a659ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:11.138409 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8522d-3f22-405a-9af0-dd663a659ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:11.139194 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8522d-3f22-405a-9af0-dd663a659ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:11.139885 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8522d-3f22-405a-9af0-dd663a659ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:11.142182 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 685/1377] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:11 2022] POST /identity/v3/projects => generated 355 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:11.143314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03638b96-6e47-430b-9682-251e649faae2 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:11.145388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8522d-3f22-405a-9af0-dd663a659ee1 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:11.169291 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 693/1378] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:11.176579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8522d-3f22-405a-9af0-dd663a659ee1 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:11.190659 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8522d-3f22-405a-9af0-dd663a659ee1 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:11.331602 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190828e-9ec4-412a-9496-446f5818e5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:11.332322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190828e-9ec4-412a-9496-446f5818e5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:11.332609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190828e-9ec4-412a-9496-446f5818e5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:11.332881 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190828e-9ec4-412a-9496-446f5818e5d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:11.334717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190828e-9ec4-412a-9496-446f5818e5d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:11.343016 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190828e-9ec4-412a-9496-446f5818e5d2 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:11.359990 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:11.396174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 694/1379] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:11 2022] POST /identity/v3/users => generated 284 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:11.397125 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190828e-9ec4-412a-9496-446f5818e5d2 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:11.406779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03638b96-6e47-430b-9682-251e649faae2 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:11.421486 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c315fa-7ec9-416f-acef-56f83761de6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:11.422606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c315fa-7ec9-416f-acef-56f83761de6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:11.423070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c315fa-7ec9-416f-acef-56f83761de6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:11.423503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c315fa-7ec9-416f-acef-56f83761de6a admin admin] PATH_INFO: `/v3/projects/67cec1fa0e2641358b8561da686f49f2/users/954fa60344294dce9f557db99d4e2125/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:11.423626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190828e-9ec4-412a-9496-446f5818e5d2 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:11.437680 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d0a41-65dc-4e39-8ab5-f1faa0157ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:11.438576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d0a41-65dc-4e39-8ab5-f1faa0157ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:11.439737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d0a41-65dc-4e39-8ab5-f1faa0157ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:11.440446 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d0a41-65dc-4e39-8ab5-f1faa0157ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:11.442530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d0a41-65dc-4e39-8ab5-f1faa0157ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:11.445891 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d0a41-65dc-4e39-8ab5-f1faa0157ee3 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:11.468594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c315fa-7ec9-416f-acef-56f83761de6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=67cec1fa0e2641358b8561da686f49f2, user_id=954fa60344294dce9f557db99d4e2125, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:11.472989 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c315fa-7ec9-416f-acef-56f83761de6a admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:11.503320 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 686/1380] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:11 2022] PUT /identity/v3/projects/67cec1fa0e2641358b8561da686f49f2/users/954fa60344294dce9f557db99d4e2125/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:11.503613 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 695/1381] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:11.505068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d0a41-65dc-4e39-8ab5-f1faa0157ee3 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:11.506690 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c315fa-7ec9-416f-acef-56f83761de6a admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:11.549901 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d0a41-65dc-4e39-8ab5-f1faa0157ee3 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:11.587873 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:11.660122 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c315fa-7ec9-416f-acef-56f83761de6a admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:11.675896 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c92c3-4065-4618-bdb0-4ebece70c522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:11.676584 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c92c3-4065-4618-bdb0-4ebece70c522 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:11.677082 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c92c3-4065-4618-bdb0-4ebece70c522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:11.677373 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c92c3-4065-4618-bdb0-4ebece70c522 admin admin] PATH_INFO: `/v3/projects/841766aac03f483a8bd2744f1486b8d8/users/b647108b4f594da3a1c7024a7f10e11b/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:11.683345 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee63a5f-ce31-4448-a3e9-6ac1346bd839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:11.685593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee63a5f-ce31-4448-a3e9-6ac1346bd839 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:11.686127 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee63a5f-ce31-4448-a3e9-6ac1346bd839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:11.686492 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee63a5f-ce31-4448-a3e9-6ac1346bd839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:11.689231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee63a5f-ce31-4448-a3e9-6ac1346bd839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:11.692338 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee63a5f-ce31-4448-a3e9-6ac1346bd839 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:11.714411 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 696/1382] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:11.714411 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997389b4-6d9e-40b5-af5d-d5a759d7123e None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:11.714411 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997389b4-6d9e-40b5-af5d-d5a759d7123e None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:11.714411 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997389b4-6d9e-40b5-af5d-d5a759d7123e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:11.715255 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c92c3-4065-4618-bdb0-4ebece70c522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=841766aac03f483a8bd2744f1486b8d8, user_id=b647108b4f594da3a1c7024a7f10e11b, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:11.718308 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c92c3-4065-4618-bdb0-4ebece70c522 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:11.743810 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 687/1383] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:11 2022] PUT /identity/v3/projects/841766aac03f483a8bd2744f1486b8d8/users/b647108b4f594da3a1c7024a7f10e11b/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:11.744745 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c92c3-4065-4618-bdb0-4ebece70c522 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:11.802976 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-997389b4-6d9e-40b5-af5d-d5a759d7123e None None] MFA Rules not processed for user `954fa60344294dce9f557db99d4e2125`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:11.812829 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-997389b4-6d9e-40b5-af5d-d5a759d7123e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:11.903751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c92c3-4065-4618-bdb0-4ebece70c522 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:11.918907 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfa378-de88-4cae-90e0-ddc43de7ae6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:11.920646 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfa378-de88-4cae-90e0-ddc43de7ae6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:11.921165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfa378-de88-4cae-90e0-ddc43de7ae6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:11.921464 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfa378-de88-4cae-90e0-ddc43de7ae6d admin admin] PATH_INFO: `/v3/projects/00f6291de4eb4d7986f6afb7747ca4b1/users/996287bae64848df9e62e3157f7484c4/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:11.961646 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfa378-de88-4cae-90e0-ddc43de7ae6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f6291de4eb4d7986f6afb7747ca4b1, user_id=996287bae64848df9e62e3157f7484c4, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:11.969202 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfa378-de88-4cae-90e0-ddc43de7ae6d admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:11.994463 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 697/1384] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:11.998350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dbc3f-0ffb-4d0e-89eb-6db585d8dcd3 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:11.998632 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dbc3f-0ffb-4d0e-89eb-6db585d8dcd3 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:12.001460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 688/1385] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:11 2022] PUT /identity/v3/projects/00f6291de4eb4d7986f6afb7747ca4b1/users/996287bae64848df9e62e3157f7484c4/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:12.002622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfa378-de88-4cae-90e0-ddc43de7ae6d admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:12.002994 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dbc3f-0ffb-4d0e-89eb-6db585d8dcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:12.074954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-2e8dbc3f-0ffb-4d0e-89eb-6db585d8dcd3 None None] MFA Rules not processed for user `b647108b4f594da3a1c7024a7f10e11b`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:12.079142 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2e8dbc3f-0ffb-4d0e-89eb-6db585d8dcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:12.091539 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:12.153106 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfa378-de88-4cae-90e0-ddc43de7ae6d admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:12.162706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7b2b6-1569-4a7a-a92f-f58f52a750d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:12.163265 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7b2b6-1569-4a7a-a92f-f58f52a750d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:12.163547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7b2b6-1569-4a7a-a92f-f58f52a750d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:12.163819 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7b2b6-1569-4a7a-a92f-f58f52a750d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:12.164496 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7b2b6-1569-4a7a-a92f-f58f52a750d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:12.171369 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7b2b6-1569-4a7a-a92f-f58f52a750d5 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:12.237043 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 689/1386] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:12 2022] POST /identity/v3/projects => generated 385 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:12.237277 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 698/1387] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:12.238403 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dbc3f-0ffb-4d0e-89eb-6db585d8dcd3 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:12.241217 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7b2b6-1569-4a7a-a92f-f58f52a750d5 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:12.263819 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dbc3f-0ffb-4d0e-89eb-6db585d8dcd3 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:12.342682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:12.444704 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7b2b6-1569-4a7a-a92f-f58f52a750d5 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:12.460870 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3f015-1aec-4461-95e7-f53909030970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:12.464353 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3f015-1aec-4461-95e7-f53909030970 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:12.467002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3f015-1aec-4461-95e7-f53909030970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:12.467300 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3f015-1aec-4461-95e7-f53909030970 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:12.469099 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3ad47-5a0b-4787-a517-b44f99edfe4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:12.471813 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3f015-1aec-4461-95e7-f53909030970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:12.474709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3ad47-5a0b-4787-a517-b44f99edfe4d admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:12.476226 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3ad47-5a0b-4787-a517-b44f99edfe4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:12.476637 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3ad47-5a0b-4787-a517-b44f99edfe4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:12.479044 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3ad47-5a0b-4787-a517-b44f99edfe4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:12.481835 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3f015-1aec-4461-95e7-f53909030970 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:12.483594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3ad47-5a0b-4787-a517-b44f99edfe4d admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:12.526102 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 699/1388] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:12 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:41:12.527493 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3f015-1aec-4461-95e7-f53909030970 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:12.528366 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 690/1389] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:12.529385 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3ad47-5a0b-4787-a517-b44f99edfe4d admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:12.553387 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3f015-1aec-4461-95e7-f53909030970 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:12.561766 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3ad47-5a0b-4787-a517-b44f99edfe4d admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:12.564891 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b901d3-a376-4d02-a369-163a58dce5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:12.566263 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b901d3-a376-4d02-a369-163a58dce5dd admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:12.567542 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b901d3-a376-4d02-a369-163a58dce5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:12.567991 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b901d3-a376-4d02-a369-163a58dce5dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:12.568792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b901d3-a376-4d02-a369-163a58dce5dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:12.573965 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b901d3-a376-4d02-a369-163a58dce5dd admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:12.575100 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e49802-13c8-4185-8482-a16a4754df5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:12.575658 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e49802-13c8-4185-8482-a16a4754df5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:12.576192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e49802-13c8-4185-8482-a16a4754df5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:12.576614 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e49802-13c8-4185-8482-a16a4754df5c admin admin] PATH_INFO: `/v3/projects/00f6291de4eb4d7986f6afb7747ca4b1/users/996287bae64848df9e62e3157f7484c4/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:12.582825 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e49802-13c8-4185-8482-a16a4754df5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f6291de4eb4d7986f6afb7747ca4b1, user_id=996287bae64848df9e62e3157f7484c4, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:12.593695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e49802-13c8-4185-8482-a16a4754df5c admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:12.623677 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 700/1390] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:12 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:12.623677 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b901d3-a376-4d02-a369-163a58dce5dd admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:12.624140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 691/1391] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:12 2022] PUT /identity/v3/projects/00f6291de4eb4d7986f6afb7747ca4b1/users/996287bae64848df9e62e3157f7484c4/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:12.625449 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e49802-13c8-4185-8482-a16a4754df5c admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:12.792276 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e49802-13c8-4185-8482-a16a4754df5c admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:12.820155 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b901d3-a376-4d02-a369-163a58dce5dd admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:12.832015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bedf59-b5b0-4ea6-bdd8-52e5ed1ad9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:12.832268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bedf59-b5b0-4ea6-bdd8-52e5ed1ad9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:12.832546 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bedf59-b5b0-4ea6-bdd8-52e5ed1ad9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:12.832819 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bedf59-b5b0-4ea6-bdd8-52e5ed1ad9e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:12.833755 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bedf59-b5b0-4ea6-bdd8-52e5ed1ad9e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:12.835491 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bedf59-b5b0-4ea6-bdd8-52e5ed1ad9e8 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:12.863537 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 701/1392] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:12.864955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d290dc-98ea-4dc7-890a-c5ac687194a7 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:12.868807 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d290dc-98ea-4dc7-890a-c5ac687194a7 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:12.869186 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d290dc-98ea-4dc7-890a-c5ac687194a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:12.913295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:12.945051 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-39d290dc-98ea-4dc7-890a-c5ac687194a7 None None] MFA Rules not processed for user `996287bae64848df9e62e3157f7484c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:12.945051 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-39d290dc-98ea-4dc7-890a-c5ac687194a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:12.954573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c08b2-88ec-48d1-be1e-f9aaaaee4367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:12.957632 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c08b2-88ec-48d1-be1e-f9aaaaee4367 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:12.958789 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c08b2-88ec-48d1-be1e-f9aaaaee4367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:12.959747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c08b2-88ec-48d1-be1e-f9aaaaee4367 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:12.962550 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c08b2-88ec-48d1-be1e-f9aaaaee4367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:12.967239 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c08b2-88ec-48d1-be1e-f9aaaaee4367 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:13.026819 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 692/1393] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:12 2022] POST /identity/v3/users => generated 293 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:41:13.029484 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c08b2-88ec-48d1-be1e-f9aaaaee4367 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:13.056684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c08b2-88ec-48d1-be1e-f9aaaaee4367 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:13.070304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c92b8-8832-47b0-a1ae-2bbe4e45c8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:13.071798 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c92b8-8832-47b0-a1ae-2bbe4e45c8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:13.072190 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c92b8-8832-47b0-a1ae-2bbe4e45c8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:13.072569 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c92b8-8832-47b0-a1ae-2bbe4e45c8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:13.073327 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c92b8-8832-47b0-a1ae-2bbe4e45c8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:13.078826 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c92b8-8832-47b0-a1ae-2bbe4e45c8a0 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:13.101462 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 702/1394] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:13.102158 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d290dc-98ea-4dc7-890a-c5ac687194a7 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:13.110200 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-39d290dc-98ea-4dc7-890a-c5ac687194a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:13.118804 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 693/1395] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:13.120504 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c92b8-8832-47b0-a1ae-2bbe4e45c8a0 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:13.145134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c92b8-8832-47b0-a1ae-2bbe4e45c8a0 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:13.161026 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee57a8-9e4d-4650-aeef-c885aaafdc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:13.161671 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee57a8-9e4d-4650-aeef-c885aaafdc00 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:13.162563 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee57a8-9e4d-4650-aeef-c885aaafdc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:13.162563 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee57a8-9e4d-4650-aeef-c885aaafdc00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:13.163200 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee57a8-9e4d-4650-aeef-c885aaafdc00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:13.170004 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee57a8-9e4d-4650-aeef-c885aaafdc00 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:13.197058 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 694/1396] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:13.197378 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:13.198913 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee57a8-9e4d-4650-aeef-c885aaafdc00 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:13.219862 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee57a8-9e4d-4650-aeef-c885aaafdc00 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:13.237156 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef4230-09c7-45f9-8cd2-f8c042261ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:13.238106 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef4230-09c7-45f9-8cd2-f8c042261ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:13.238660 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef4230-09c7-45f9-8cd2-f8c042261ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:13.239045 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef4230-09c7-45f9-8cd2-f8c042261ae3 admin admin] PATH_INFO: `/v3/projects/6b35ac942ee842469fdb9b857c6c67b6/users/694746e03def4301b9f1018e214250c0/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:13.260301 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d290dc-98ea-4dc7-890a-c5ac687194a7 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:13.264085 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef3af0-0fe0-4723-8a6a-c08db7399b52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:13.265020 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef3af0-0fe0-4723-8a6a-c08db7399b52 service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:13.265020 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef3af0-0fe0-4723-8a6a-c08db7399b52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:13.265263 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef3af0-0fe0-4723-8a6a-c08db7399b52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:13.267064 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e3ef3af0-0fe0-4723-8a6a-c08db7399b52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:13.295991 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef4230-09c7-45f9-8cd2-f8c042261ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b35ac942ee842469fdb9b857c6c67b6, user_id=694746e03def4301b9f1018e214250c0, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:13.303156 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef4230-09c7-45f9-8cd2-f8c042261ae3 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:13.334226 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 695/1397] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:13 2022] PUT /identity/v3/projects/6b35ac942ee842469fdb9b857c6c67b6/users/694746e03def4301b9f1018e214250c0/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:13.335372 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef4230-09c7-45f9-8cd2-f8c042261ae3 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:13.344457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-86ef4230-09c7-45f9-8cd2-f8c042261ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:13.435977 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef3af0-0fe0-4723-8a6a-c08db7399b52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:13.440025 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef3af0-0fe0-4723-8a6a-c08db7399b52 service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:13.464120 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 703/1398] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:13.472799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef3af0-0fe0-4723-8a6a-c08db7399b52 service cinder] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:13.496648 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef3af0-0fe0-4723-8a6a-c08db7399b52 service cinder] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:13.618826 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef4230-09c7-45f9-8cd2-f8c042261ae3 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:13.642937 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc71c85-80d4-42d9-a5dd-d464a88ebc13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:13.646936 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc71c85-80d4-42d9-a5dd-d464a88ebc13 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:13.647378 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc71c85-80d4-42d9-a5dd-d464a88ebc13 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:13.653036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc71c85-80d4-42d9-a5dd-d464a88ebc13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:13.697194 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9e901-afa3-44ee-b41b-9229c5bb346e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:13.701827 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9e901-afa3-44ee-b41b-9229c5bb346e admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:13.704374 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9e901-afa3-44ee-b41b-9229c5bb346e admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:13.704797 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9e901-afa3-44ee-b41b-9229c5bb346e admin admin] PATH_INFO: `/v3/projects/6ebb0983f2654b7b94d930763a8a919e/users/3baabb671cc94395a64bfbd6c765f582/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:13.757451 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9e901-afa3-44ee-b41b-9229c5bb346e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ebb0983f2654b7b94d930763a8a919e, user_id=3baabb671cc94395a64bfbd6c765f582, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:13.765909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9e901-afa3-44ee-b41b-9229c5bb346e admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:13.800260 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 704/1399] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:13 2022] PUT /identity/v3/projects/6ebb0983f2654b7b94d930763a8a919e/users/3baabb671cc94395a64bfbd6c765f582/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:13.800260 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a9404-e0c5-4454-9cee-5192a395bd64 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:13.800260 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a9404-e0c5-4454-9cee-5192a395bd64 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:13.800700 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a9404-e0c5-4454-9cee-5192a395bd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:13.815881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc71c85-80d4-42d9-a5dd-d464a88ebc13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:13.817648 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc71c85-80d4-42d9-a5dd-d464a88ebc13 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:13.846265 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 696/1400] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:13 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:13.848500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc71c85-80d4-42d9-a5dd-d464a88ebc13 service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:13.897995 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-ef3a9404-e0c5-4454-9cee-5192a395bd64 None None] MFA Rules not processed for user `694746e03def4301b9f1018e214250c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:13.901389 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ef3a9404-e0c5-4454-9cee-5192a395bd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:13.905835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc71c85-80d4-42d9-a5dd-d464a88ebc13 service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:14.140901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:14.143326 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:14.203172 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e892d-e5a3-412c-a12d-42382f35103c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:14.212725 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e892d-e5a3-412c-a12d-42382f35103c admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:14.214158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e892d-e5a3-412c-a12d-42382f35103c admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:14.214943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e892d-e5a3-412c-a12d-42382f35103c admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:14.216475 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e892d-e5a3-412c-a12d-42382f35103c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:14.224600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e892d-e5a3-412c-a12d-42382f35103c admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:14.228591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 705/1401] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:14.229696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a9404-e0c5-4454-9cee-5192a395bd64 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:14.295240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 697/1402] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:14.297897 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e892d-e5a3-412c-a12d-42382f35103c admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:14.328550 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e892d-e5a3-412c-a12d-42382f35103c admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:14.339428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18644ed2-5717-4968-b3f1-98bfb27993f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:14.340665 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18644ed2-5717-4968-b3f1-98bfb27993f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:14.340665 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18644ed2-5717-4968-b3f1-98bfb27993f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:14.340665 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18644ed2-5717-4968-b3f1-98bfb27993f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:14.341621 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18644ed2-5717-4968-b3f1-98bfb27993f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:14.344301 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18644ed2-5717-4968-b3f1-98bfb27993f2 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:14.390058 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 698/1403] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:14 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:14.391339 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18644ed2-5717-4968-b3f1-98bfb27993f2 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:14.412885 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a9404-e0c5-4454-9cee-5192a395bd64 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:14.492746 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e4a61-075f-4ada-8535-9c6c4f5a98f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:14.493861 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e4a61-075f-4ada-8535-9c6c4f5a98f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:14.494271 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e4a61-075f-4ada-8535-9c6c4f5a98f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:14.495335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e4a61-075f-4ada-8535-9c6c4f5a98f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:14.514035 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18644ed2-5717-4968-b3f1-98bfb27993f2 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:14.521889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3233d93-3e0c-41c2-9881-8d19f65e0e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:14.522499 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3233d93-3e0c-41c2-9881-8d19f65e0e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:14.522798 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3233d93-3e0c-41c2-9881-8d19f65e0e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:14.523079 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3233d93-3e0c-41c2-9881-8d19f65e0e50 admin admin] PATH_INFO: `/v3/projects/6ebb0983f2654b7b94d930763a8a919e/users/3baabb671cc94395a64bfbd6c765f582/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:14.528896 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3233d93-3e0c-41c2-9881-8d19f65e0e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ebb0983f2654b7b94d930763a8a919e, user_id=3baabb671cc94395a64bfbd6c765f582, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:14.539537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3233d93-3e0c-41c2-9881-8d19f65e0e50 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:14.598259 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 699/1404] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:14 2022] PUT /identity/v3/projects/6ebb0983f2654b7b94d930763a8a919e/users/3baabb671cc94395a64bfbd6c765f582/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:14.616421 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3233d93-3e0c-41c2-9881-8d19f65e0e50 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:14.641924 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e4a61-075f-4ada-8535-9c6c4f5a98f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:14.643906 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e4a61-075f-4ada-8535-9c6c4f5a98f2 service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:14.662908 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 706/1405] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:14.664325 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154247e-a5aa-4780-9b0a-faffe0f65559 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:14.664612 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154247e-a5aa-4780-9b0a-faffe0f65559 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:14.665872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154247e-a5aa-4780-9b0a-faffe0f65559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:14.708066 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-8154247e-a5aa-4780-9b0a-faffe0f65559 None None] MFA Rules not processed for user `3baabb671cc94395a64bfbd6c765f582`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:14.709382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-8154247e-a5aa-4780-9b0a-faffe0f65559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:14.824675 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3233d93-3e0c-41c2-9881-8d19f65e0e50 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:14.845260 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2179b-9ed3-42af-8870-b446d9c4ba39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:14.846042 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2179b-9ed3-42af-8870-b446d9c4ba39 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:14.846397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2179b-9ed3-42af-8870-b446d9c4ba39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:14.846710 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2179b-9ed3-42af-8870-b446d9c4ba39 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:14.860780 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2179b-9ed3-42af-8870-b446d9c4ba39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:14.866911 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2179b-9ed3-42af-8870-b446d9c4ba39 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:14.921140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 700/1406] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:14 2022] POST /identity/v3/users => generated 298 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:14.922633 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f07728-497d-45d7-b5bb-9c65092b553e None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:14.922920 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f07728-497d-45d7-b5bb-9c65092b553e None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:14.923189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f07728-497d-45d7-b5bb-9c65092b553e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:14.953003 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:14.966190 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-76f07728-497d-45d7-b5bb-9c65092b553e None None] MFA Rules not processed for user `f6eeeea7a6e84461aa1945595c7bf398`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:14.967658 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-76f07728-497d-45d7-b5bb-9c65092b553e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:14.990274 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 707/1407] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:14.992801 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434317c7-78bd-4c8f-b5a6-1d6ed3039d26 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:14.993337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434317c7-78bd-4c8f-b5a6-1d6ed3039d26 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:14.994328 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434317c7-78bd-4c8f-b5a6-1d6ed3039d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:15.007093 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:15.062332 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 701/1408] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:15.077481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-434317c7-78bd-4c8f-b5a6-1d6ed3039d26 None None] MFA Rules not processed for user `a1bdbce1b3d047cfa5ddf72f902ecd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:15.079020 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-434317c7-78bd-4c8f-b5a6-1d6ed3039d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:15.079229 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f07728-497d-45d7-b5bb-9c65092b553e None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:15.097463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f07728-497d-45d7-b5bb-9c65092b553e None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:15.104898 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b458eb-47ef-4f2b-a180-ded3539eae6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:15.105612 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b458eb-47ef-4f2b-a180-ded3539eae6e admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:15.105935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b458eb-47ef-4f2b-a180-ded3539eae6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:15.106435 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b458eb-47ef-4f2b-a180-ded3539eae6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:15.107010 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b458eb-47ef-4f2b-a180-ded3539eae6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:15.109108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b458eb-47ef-4f2b-a180-ded3539eae6e admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:15.127763 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 702/1409] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:15.129342 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b458eb-47ef-4f2b-a180-ded3539eae6e admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:15.168626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 708/1410] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Oct 20 14:41:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:15.168626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434317c7-78bd-4c8f-b5a6-1d6ed3039d26 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:15.168626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-434317c7-78bd-4c8f-b5a6-1d6ed3039d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:15.248038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b458eb-47ef-4f2b-a180-ded3539eae6e admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:15.254179 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb94768-f014-40ef-861a-c2a18e2ceaaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:15.255229 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb94768-f014-40ef-861a-c2a18e2ceaaf service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:15.255879 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb94768-f014-40ef-861a-c2a18e2ceaaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:15.256355 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb94768-f014-40ef-861a-c2a18e2ceaaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:15.268250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb94768-f014-40ef-861a-c2a18e2ceaaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:15.270659 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb94768-f014-40ef-861a-c2a18e2ceaaf service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:15.283515 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 703/1411] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:15.284808 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb94768-f014-40ef-861a-c2a18e2ceaaf service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:15.312557 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb94768-f014-40ef-861a-c2a18e2ceaaf service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:15.326455 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd199a0-e16b-47b7-92dc-460b7a6133be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:15.328383 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd199a0-e16b-47b7-92dc-460b7a6133be admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:15.328881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd199a0-e16b-47b7-92dc-460b7a6133be admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:15.329399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd199a0-e16b-47b7-92dc-460b7a6133be admin admin] PATH_INFO: `/v3/projects/6ce161a668ce4bbda2765a77cab43f7f/users/8422875065aa4d1fbe78bb3d07ac2658/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:15.354893 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd199a0-e16b-47b7-92dc-460b7a6133be admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce161a668ce4bbda2765a77cab43f7f, user_id=8422875065aa4d1fbe78bb3d07ac2658, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:15.358618 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd199a0-e16b-47b7-92dc-460b7a6133be admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:15.361947 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434317c7-78bd-4c8f-b5a6-1d6ed3039d26 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:15.373978 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfc8c3-1925-4216-a148-3e69c0fd2ee9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:15.375019 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfc8c3-1925-4216-a148-3e69c0fd2ee9 service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:15.375597 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfc8c3-1925-4216-a148-3e69c0fd2ee9 service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:15.376097 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfc8c3-1925-4216-a148-3e69c0fd2ee9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:15.377695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 704/1412] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:15 2022] PUT /identity/v3/projects/6ce161a668ce4bbda2765a77cab43f7f/users/8422875065aa4d1fbe78bb3d07ac2658/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:15.381969 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd199a0-e16b-47b7-92dc-460b7a6133be admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:15.393593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bfc8c3-1925-4216-a148-3e69c0fd2ee9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:15.396596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bfc8c3-1925-4216-a148-3e69c0fd2ee9 service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:15.431523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 709/1413] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:15.496791 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd199a0-e16b-47b7-92dc-460b7a6133be admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:15.511449 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480901f-4c11-4914-9a31-3ce76ab0d7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:15.512805 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480901f-4c11-4914-9a31-3ce76ab0d7df admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:15.519103 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480901f-4c11-4914-9a31-3ce76ab0d7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:15.519103 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480901f-4c11-4914-9a31-3ce76ab0d7df admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:15.519103 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480901f-4c11-4914-9a31-3ce76ab0d7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:15.519659 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480901f-4c11-4914-9a31-3ce76ab0d7df admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:15.523267 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfc8c3-1925-4216-a148-3e69c0fd2ee9 service nova] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:15.525203 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-c9bfc8c3-1925-4216-a148-3e69c0fd2ee9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:15.591759 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 705/1414] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:41:15.595698 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480901f-4c11-4914-9a31-3ce76ab0d7df admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:15.625046 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480901f-4c11-4914-9a31-3ce76ab0d7df admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:15.645297 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f220911-35bf-4e68-bb56-919804416167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:15.650170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f220911-35bf-4e68-bb56-919804416167 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:15.650465 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f220911-35bf-4e68-bb56-919804416167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:15.650752 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f220911-35bf-4e68-bb56-919804416167 admin admin] PATH_INFO: `/v3/projects/6ce161a668ce4bbda2765a77cab43f7f/users/8422875065aa4d1fbe78bb3d07ac2658/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:15.663176 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f220911-35bf-4e68-bb56-919804416167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce161a668ce4bbda2765a77cab43f7f, user_id=8422875065aa4d1fbe78bb3d07ac2658, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:15.673077 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f220911-35bf-4e68-bb56-919804416167 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:15.735900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 706/1415] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:15 2022] PUT /identity/v3/projects/6ce161a668ce4bbda2765a77cab43f7f/users/8422875065aa4d1fbe78bb3d07ac2658/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:15.740234 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:15.748028 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e5583-ca9b-4677-88b0-71bcb7f8b689 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:15.748325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e5583-ca9b-4677-88b0-71bcb7f8b689 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:15.748737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e5583-ca9b-4677-88b0-71bcb7f8b689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:15.791181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-223e5583-ca9b-4677-88b0-71bcb7f8b689 None None] MFA Rules not processed for user `8422875065aa4d1fbe78bb3d07ac2658`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:15.792542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-223e5583-ca9b-4677-88b0-71bcb7f8b689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:15.807108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:15.923953 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 707/1416] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:15.933785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfc8c3-1925-4216-a148-3e69c0fd2ee9 service nova] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:15.944325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e5583-ca9b-4677-88b0-71bcb7f8b689 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:16.046318 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d5042-fb8f-411c-9756-d4c66b13bccb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60d62d14cd4042ab1bff5509e30f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:16.046964 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d5042-fb8f-411c-9756-d4c66b13bccb service swift] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:16.047408 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d5042-fb8f-411c-9756-d4c66b13bccb service swift] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:16.047692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d5042-fb8f-411c-9756-d4c66b13bccb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:16.074032 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e5583-ca9b-4677-88b0-71bcb7f8b689 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:16.088085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85589c50-da10-463c-bae7-9779524e3035 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:16.089307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589c50-da10-463c-bae7-9779524e3035 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:16.090090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589c50-da10-463c-bae7-9779524e3035 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:16.091702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589c50-da10-463c-bae7-9779524e3035 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:16.206857 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d5042-fb8f-411c-9756-d4c66b13bccb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:16.211962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d5042-fb8f-411c-9756-d4c66b13bccb service swift] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:16.239396 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 710/1417] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Oct 20 14:41:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 14:41:16.271035 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85589c50-da10-463c-bae7-9779524e3035 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:16.278309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85589c50-da10-463c-bae7-9779524e3035 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:16.297206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 708/1418] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:41:16.899421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d5042-fb8f-411c-9756-d4c66b13bccb service swift] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:17.124062 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d5042-fb8f-411c-9756-d4c66b13bccb service swift] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:17.129677 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0041b65-5fef-428e-b01e-ab9fa61affee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:17.130390 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0041b65-5fef-428e-b01e-ab9fa61affee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:17.130670 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0041b65-5fef-428e-b01e-ab9fa61affee admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:17.130947 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0041b65-5fef-428e-b01e-ab9fa61affee admin admin] PATH_INFO: `/v3/users/b647108b4f594da3a1c7024a7f10e11b` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:17.132105 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0041b65-5fef-428e-b01e-ab9fa61affee admin admin] RBAC: Authorizing `identity:delete_user(user_id=b647108b4f594da3a1c7024a7f10e11b)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:17.141792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0041b65-5fef-428e-b01e-ab9fa61affee admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:17.148557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:17.256417 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b0041b65-5fef-428e-b01e-ab9fa61affee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b647108b4f594da3a1c7024a7f10e11b'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:17.266954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b0041b65-5fef-428e-b01e-ab9fa61affee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b647108b4f594da3a1c7024a7f10e11b'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:17.301245 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b0041b65-5fef-428e-b01e-ab9fa61affee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b647108b4f594da3a1c7024a7f10e11b'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:17.304079 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b0041b65-5fef-428e-b01e-ab9fa61affee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b647108b4f594da3a1c7024a7f10e11b'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:17.324207 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b0041b65-5fef-428e-b01e-ab9fa61affee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b647108b4f594da3a1c7024a7f10e11b'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:17.338014 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 711/1419] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:16 2022] DELETE /identity/v3/users/b647108b4f594da3a1c7024a7f10e11b => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:17.339899 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128991a-ceaa-4740-9616-77cebadbc9bf None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:17.340345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128991a-ceaa-4740-9616-77cebadbc9bf None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:17.340475 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128991a-ceaa-4740-9616-77cebadbc9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:17.397429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-c128991a-ceaa-4740-9616-77cebadbc9bf None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:17.410864 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-c128991a-ceaa-4740-9616-77cebadbc9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:17.610502 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:17.631699 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 709/1420] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:18.659037 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0041b65-5fef-428e-b01e-ab9fa61affee admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:18.663759 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b0041b65-5fef-428e-b01e-ab9fa61affee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:18.878573 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0041b65-5fef-428e-b01e-ab9fa61affee admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:18.895767 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c14f4-be0e-4a20-8f18-e84ba06ab3f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:18.897889 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c14f4-be0e-4a20-8f18-e84ba06ab3f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:18.899843 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c14f4-be0e-4a20-8f18-e84ba06ab3f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:18.900718 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c14f4-be0e-4a20-8f18-e84ba06ab3f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:18.910937 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128991a-ceaa-4740-9616-77cebadbc9bf None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:18.912529 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-c128991a-ceaa-4740-9616-77cebadbc9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:18.951363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c14f4-be0e-4a20-8f18-e84ba06ab3f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:18.954941 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c14f4-be0e-4a20-8f18-e84ba06ab3f2 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:19.014075 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 712/1421] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:19.144847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128991a-ceaa-4740-9616-77cebadbc9bf None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:19.172398 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245693b9-e795-4c28-a246-774924427390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:19.173044 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245693b9-e795-4c28-a246-774924427390 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:19.173328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245693b9-e795-4c28-a246-774924427390 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:19.173604 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245693b9-e795-4c28-a246-774924427390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:19.188011 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-245693b9-e795-4c28-a246-774924427390 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:19.419164 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245693b9-e795-4c28-a246-774924427390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:19.420992 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245693b9-e795-4c28-a246-774924427390 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:19.452314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 710/1422] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:20.765034 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdca2c-12fc-48d3-b078-e56a7bcb55ba None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:20.765557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdca2c-12fc-48d3-b078-e56a7bcb55ba None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:20.765677 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdca2c-12fc-48d3-b078-e56a7bcb55ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:20.837556 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-1bfdca2c-12fc-48d3-b078-e56a7bcb55ba None None] MFA Rules not processed for user `f6eeeea7a6e84461aa1945595c7bf398`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:20.848167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-1bfdca2c-12fc-48d3-b078-e56a7bcb55ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:21.072745 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 713/1423] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:21.296464 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245693b9-e795-4c28-a246-774924427390 service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:21.315266 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245693b9-e795-4c28-a246-774924427390 service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:21.328432 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ddd53-e89c-475c-acb3-4d869cb5ff7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:21.329315 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ddd53-e89c-475c-acb3-4d869cb5ff7b service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:21.331633 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ddd53-e89c-475c-acb3-4d869cb5ff7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:21.332088 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ddd53-e89c-475c-acb3-4d869cb5ff7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:21.344624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-232ddd53-e89c-475c-acb3-4d869cb5ff7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:21.544643 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ddd53-e89c-475c-acb3-4d869cb5ff7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:21.546485 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ddd53-e89c-475c-acb3-4d869cb5ff7b service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:21.590577 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 711/1424] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:21.911821 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3280122-39a8-46f6-ade1-b1d4f96e8122 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:21.912389 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3280122-39a8-46f6-ade1-b1d4f96e8122 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:21.912389 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3280122-39a8-46f6-ade1-b1d4f96e8122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:21.996231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-e3280122-39a8-46f6-ade1-b1d4f96e8122 None None] MFA Rules not processed for user `359e9d904b0d43acae86337c1eb6a71d`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:21.997652 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e3280122-39a8-46f6-ade1-b1d4f96e8122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:22.031288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 714/1425] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Oct 20 14:41:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:22.159458 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ddd53-e89c-475c-acb3-4d869cb5ff7b service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:22.161388 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-232ddd53-e89c-475c-acb3-4d869cb5ff7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:22.217388 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ddd53-e89c-475c-acb3-4d869cb5ff7b service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:22.230442 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd52fc-296d-40d5-810a-2b45728aec7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:22.231448 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd52fc-296d-40d5-810a-2b45728aec7d service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:22.231968 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd52fc-296d-40d5-810a-2b45728aec7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:22.232697 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd52fc-296d-40d5-810a-2b45728aec7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:22.272062 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd52fc-296d-40d5-810a-2b45728aec7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:22.282649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd52fc-296d-40d5-810a-2b45728aec7d service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:22.326924 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 712/1426] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:22.540865 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3280122-39a8-46f6-ade1-b1d4f96e8122 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:22.544503 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e3280122-39a8-46f6-ade1-b1d4f96e8122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:22.605302 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3280122-39a8-46f6-ade1-b1d4f96e8122 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:22.627506 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d6466-597b-4189-b7da-79b292309ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:22.628183 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d6466-597b-4189-b7da-79b292309ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:22.647847 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d6466-597b-4189-b7da-79b292309ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:22.648196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d6466-597b-4189-b7da-79b292309ada admin admin] PATH_INFO: `/v3/projects/841766aac03f483a8bd2744f1486b8d8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:22.674150 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d6466-597b-4189-b7da-79b292309ada admin admin] RBAC: Authorizing `identity:delete_project(project_id=841766aac03f483a8bd2744f1486b8d8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:22.683499 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d6466-597b-4189-b7da-79b292309ada admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:22.792380 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:22.905186 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b97d6466-597b-4189-b7da-79b292309ada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '841766aac03f483a8bd2744f1486b8d8', 'request_id': 'req-b97d6466-597b-4189-b7da-79b292309ada'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:22.928944 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b97d6466-597b-4189-b7da-79b292309ada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '841766aac03f483a8bd2744f1486b8d8', 'request_id': 'req-b97d6466-597b-4189-b7da-79b292309ada'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:22.964753 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b97d6466-597b-4189-b7da-79b292309ada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '841766aac03f483a8bd2744f1486b8d8', 'request_id': 'req-b97d6466-597b-4189-b7da-79b292309ada'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:23.005238 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b97d6466-597b-4189-b7da-79b292309ada admin admin] The token cache is being invalidate because project 841766aac03f483a8bd2744f1486b8d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:23.008977 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b97d6466-597b-4189-b7da-79b292309ada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:23.014346 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b97d6466-597b-4189-b7da-79b292309ada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:23.018380 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 715/1427] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:22 2022] DELETE /identity/v3/projects/841766aac03f483a8bd2744f1486b8d8 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:23.022482 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd52fc-296d-40d5-810a-2b45728aec7d service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:23.050372 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd52fc-296d-40d5-810a-2b45728aec7d service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:23.149509 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:23.273962 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a05a2d-866e-4ec7-a194-79e1d8bdc890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:23.275162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a05a2d-866e-4ec7-a194-79e1d8bdc890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:23.284527 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a05a2d-866e-4ec7-a194-79e1d8bdc890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:23.284906 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a05a2d-866e-4ec7-a194-79e1d8bdc890 admin admin] PATH_INFO: `/v3/users/3baabb671cc94395a64bfbd6c765f582` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:23.289540 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a05a2d-866e-4ec7-a194-79e1d8bdc890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3baabb671cc94395a64bfbd6c765f582)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:23.299576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a05a2d-866e-4ec7-a194-79e1d8bdc890 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:23.463131 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-54a05a2d-866e-4ec7-a194-79e1d8bdc890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3baabb671cc94395a64bfbd6c765f582'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:23.483501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-54a05a2d-866e-4ec7-a194-79e1d8bdc890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3baabb671cc94395a64bfbd6c765f582'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:23.486913 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-54a05a2d-866e-4ec7-a194-79e1d8bdc890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3baabb671cc94395a64bfbd6c765f582'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:23.489490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-54a05a2d-866e-4ec7-a194-79e1d8bdc890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3baabb671cc94395a64bfbd6c765f582'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:23.510645 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-54a05a2d-866e-4ec7-a194-79e1d8bdc890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3baabb671cc94395a64bfbd6c765f582'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:23.569769 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 713/1428] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:23 2022] DELETE /identity/v3/users/3baabb671cc94395a64bfbd6c765f582 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:24.660345 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d6466-597b-4189-b7da-79b292309ada admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:24.666590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b97d6466-597b-4189-b7da-79b292309ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:24.720838 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d6466-597b-4189-b7da-79b292309ada admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:24.902229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2908bf-b995-447f-b242-d66328dddbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:24.903090 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2908bf-b995-447f-b242-d66328dddbaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:24.903478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2908bf-b995-447f-b242-d66328dddbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:24.903914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2908bf-b995-447f-b242-d66328dddbaf admin admin] PATH_INFO: `/v3/projects/6ebb0983f2654b7b94d930763a8a919e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:24.920812 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2908bf-b995-447f-b242-d66328dddbaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ebb0983f2654b7b94d930763a8a919e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:24.923058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2908bf-b995-447f-b242-d66328dddbaf admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:25.224551 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-7d2908bf-b995-447f-b242-d66328dddbaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ebb0983f2654b7b94d930763a8a919e', 'request_id': 'req-7d2908bf-b995-447f-b242-d66328dddbaf'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:25.261607 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-7d2908bf-b995-447f-b242-d66328dddbaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ebb0983f2654b7b94d930763a8a919e', 'request_id': 'req-7d2908bf-b995-447f-b242-d66328dddbaf'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:25.296243 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-7d2908bf-b995-447f-b242-d66328dddbaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ebb0983f2654b7b94d930763a8a919e', 'request_id': 'req-7d2908bf-b995-447f-b242-d66328dddbaf'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:25.349222 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-7d2908bf-b995-447f-b242-d66328dddbaf admin admin] The token cache is being invalidate because project 6ebb0983f2654b7b94d930763a8a919e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:25.349522 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-7d2908bf-b995-447f-b242-d66328dddbaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:25.355264 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-7d2908bf-b995-447f-b242-d66328dddbaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:25.361280 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 716/1429] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:24 2022] DELETE /identity/v3/projects/6ebb0983f2654b7b94d930763a8a919e => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:25.366759 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde13f56-c487-4374-b911-027463292598 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:25.367481 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde13f56-c487-4374-b911-027463292598 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:25.367481 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde13f56-c487-4374-b911-027463292598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:25.430513 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-bde13f56-c487-4374-b911-027463292598 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:25.436477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-bde13f56-c487-4374-b911-027463292598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:25.635511 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 714/1430] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:25.643724 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7f0d2-e15a-4202-95b1-2fd80d60b93e None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:25.644005 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7f0d2-e15a-4202-95b1-2fd80d60b93e None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:25.644558 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7f0d2-e15a-4202-95b1-2fd80d60b93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:25.711803 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-27f7f0d2-e15a-4202-95b1-2fd80d60b93e None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:25.714918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-27f7f0d2-e15a-4202-95b1-2fd80d60b93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:25.734436 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde13f56-c487-4374-b911-027463292598 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:25.734798 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 717/1431] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:25.748953 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde13f56-c487-4374-b911-027463292598 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:25.762253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f05c6-7333-4389-a13d-378c99408c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:25.766000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f05c6-7333-4389-a13d-378c99408c31 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:25.766000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f05c6-7333-4389-a13d-378c99408c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:25.767994 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f05c6-7333-4389-a13d-378c99408c31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:25.770135 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f05c6-7333-4389-a13d-378c99408c31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:41:25.771314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f05c6-7333-4389-a13d-378c99408c31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:25.778510 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f05c6-7333-4389-a13d-378c99408c31 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:25.852709 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7f0d2-e15a-4202-95b1-2fd80d60b93e None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:25.859593 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 715/1432] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:41:25.865008 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7f0d2-e15a-4202-95b1-2fd80d60b93e None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:25.882157 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14654fd6-7f11-4c12-94a1-c41a9e3784f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:25.886452 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14654fd6-7f11-4c12-94a1-c41a9e3784f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:25.886732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14654fd6-7f11-4c12-94a1-c41a9e3784f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:25.898693 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14654fd6-7f11-4c12-94a1-c41a9e3784f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:25.907824 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14654fd6-7f11-4c12-94a1-c41a9e3784f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:25.923657 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14654fd6-7f11-4c12-94a1-c41a9e3784f2 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:26.069378 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 718/1433] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:25 2022] POST /identity/v3/projects => generated 367 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:26.073718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f05c6-7333-4389-a13d-378c99408c31 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:26.087128 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f05c6-7333-4389-a13d-378c99408c31 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:26.263743 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:26.330346 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bacd11-5b63-4d3e-b9ce-f57f78f42512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:26.331203 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bacd11-5b63-4d3e-b9ce-f57f78f42512 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:26.331522 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bacd11-5b63-4d3e-b9ce-f57f78f42512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:26.331807 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bacd11-5b63-4d3e-b9ce-f57f78f42512 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:26.334677 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bacd11-5b63-4d3e-b9ce-f57f78f42512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:26.337525 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bacd11-5b63-4d3e-b9ce-f57f78f42512 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:26.387774 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 716/1434] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:26 2022] POST /identity/v3/users => generated 284 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:26.392025 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14654fd6-7f11-4c12-94a1-c41a9e3784f2 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:26.409558 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14654fd6-7f11-4c12-94a1-c41a9e3784f2 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:26.417453 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ea5fd-84e7-484f-817b-d0224675390d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:26.418457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ea5fd-84e7-484f-817b-d0224675390d admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:26.418917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ea5fd-84e7-484f-817b-d0224675390d admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:26.419340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ea5fd-84e7-484f-817b-d0224675390d admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:26.420298 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ea5fd-84e7-484f-817b-d0224675390d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:26.422774 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ea5fd-84e7-484f-817b-d0224675390d admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:26.425760 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:26.437913 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 719/1435] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:26.443469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bacd11-5b63-4d3e-b9ce-f57f78f42512 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:26.461389 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dc73e-e5dd-4870-8859-07fd7aa1ff66 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:26.462256 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dc73e-e5dd-4870-8859-07fd7aa1ff66 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:26.464387 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dc73e-e5dd-4870-8859-07fd7aa1ff66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:26.467711 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bacd11-5b63-4d3e-b9ce-f57f78f42512 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:26.481009 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e10494-bd46-44b2-b495-e236ca5a348a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:26.481646 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e10494-bd46-44b2-b495-e236ca5a348a admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:26.483749 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e10494-bd46-44b2-b495-e236ca5a348a admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:26.484751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e10494-bd46-44b2-b495-e236ca5a348a admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:26.486230 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e10494-bd46-44b2-b495-e236ca5a348a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:26.488662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e10494-bd46-44b2-b495-e236ca5a348a admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:26.526287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-6c0dc73e-e5dd-4870-8859-07fd7aa1ff66 None None] MFA Rules not processed for user `ebadd4bd1ec1442789777438c6d16414`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:26.527537 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-6c0dc73e-e5dd-4870-8859-07fd7aa1ff66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:26.551368 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 717/1436] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:26.555985 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e10494-bd46-44b2-b495-e236ca5a348a admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:26.588502 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e10494-bd46-44b2-b495-e236ca5a348a admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:26.625861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef96d2b-d029-4ca0-911f-2f84fef212b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:26.627297 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef96d2b-d029-4ca0-911f-2f84fef212b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:26.627635 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef96d2b-d029-4ca0-911f-2f84fef212b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:26.627930 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef96d2b-d029-4ca0-911f-2f84fef212b9 admin admin] PATH_INFO: `/v3/projects/dad124866ba74171a55bb0bc1f46493c/users/4311acd779a744fcaebb9918c1fb020c/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:26.686825 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef96d2b-d029-4ca0-911f-2f84fef212b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad124866ba74171a55bb0bc1f46493c, user_id=4311acd779a744fcaebb9918c1fb020c, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:26.696305 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef96d2b-d029-4ca0-911f-2f84fef212b9 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:26.703154 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 720/1437] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:26.715973 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4c02d-31b0-4eac-b9a1-91c538727fae None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:26.716554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4c02d-31b0-4eac-b9a1-91c538727fae None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:26.716693 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4c02d-31b0-4eac-b9a1-91c538727fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:26.759737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 718/1438] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:26 2022] PUT /identity/v3/projects/dad124866ba74171a55bb0bc1f46493c/users/4311acd779a744fcaebb9918c1fb020c/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:26.774526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c46282-dee7-4845-ae02-47cb17da541f None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:26.774860 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c46282-dee7-4845-ae02-47cb17da541f None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:26.775175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c46282-dee7-4845-ae02-47cb17da541f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:26.795021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-e3b4c02d-31b0-4eac-b9a1-91c538727fae None None] MFA Rules not processed for user `ebadd4bd1ec1442789777438c6d16414`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:26.796430 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e3b4c02d-31b0-4eac-b9a1-91c538727fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:26.872836 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-86c46282-dee7-4845-ae02-47cb17da541f None None] MFA Rules not processed for user `4311acd779a744fcaebb9918c1fb020c`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:26.875753 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-86c46282-dee7-4845-ae02-47cb17da541f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:26.962172 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 721/1439] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:41:26.973992 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4c02d-31b0-4eac-b9a1-91c538727fae None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:26.975801 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e3b4c02d-31b0-4eac-b9a1-91c538727fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:27.171823 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 719/1440] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:27.172793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c46282-dee7-4845-ae02-47cb17da541f None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:27.284472 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4c02d-31b0-4eac-b9a1-91c538727fae None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:27.309523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dce539-4b25-4a98-bcdb-736984c06081 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:27.312455 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dce539-4b25-4a98-bcdb-736984c06081 service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:27.313081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dce539-4b25-4a98-bcdb-736984c06081 service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:27.316325 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dce539-4b25-4a98-bcdb-736984c06081 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:27.354958 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dce539-4b25-4a98-bcdb-736984c06081 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:27.360894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dce539-4b25-4a98-bcdb-736984c06081 service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:27.420230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 722/1441] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:26 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:41:27.423240 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dce539-4b25-4a98-bcdb-736984c06081 service nova] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:27.433341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-c7dce539-4b25-4a98-bcdb-736984c06081 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:27.509156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:27.567614 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c46282-dee7-4845-ae02-47cb17da541f None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:27.581446 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c51df-e1e2-4079-a3e9-d5448204aa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:27.583412 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c51df-e1e2-4079-a3e9-d5448204aa2b admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:27.583701 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c51df-e1e2-4079-a3e9-d5448204aa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:27.583983 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c51df-e1e2-4079-a3e9-d5448204aa2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:27.584643 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c51df-e1e2-4079-a3e9-d5448204aa2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:27.597055 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c51df-e1e2-4079-a3e9-d5448204aa2b admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:27.649564 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dce539-4b25-4a98-bcdb-736984c06081 service nova] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:27.667576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b77af-f21d-4eaf-a243-c2994a2abdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:27.668394 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b77af-f21d-4eaf-a243-c2994a2abdee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:27.669314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b77af-f21d-4eaf-a243-c2994a2abdee admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:27.669598 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b77af-f21d-4eaf-a243-c2994a2abdee admin admin] PATH_INFO: `/v3/users/954fa60344294dce9f557db99d4e2125` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:27.674898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b77af-f21d-4eaf-a243-c2994a2abdee admin admin] RBAC: Authorizing `identity:delete_user(user_id=954fa60344294dce9f557db99d4e2125)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:27.682729 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b77af-f21d-4eaf-a243-c2994a2abdee admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:27.717504 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 720/1442] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:27 2022] POST /identity/v3/projects => generated 367 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:27.723465 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b24fb-a7e6-4a28-b962-c56eb3173cf4 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:27.723771 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b24fb-a7e6-4a28-b962-c56eb3173cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:27.724091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b24fb-a7e6-4a28-b962-c56eb3173cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:27.807759 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-1d3b77af-f21d-4eaf-a243-c2994a2abdee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '954fa60344294dce9f557db99d4e2125'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:27.811968 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:27.830125 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-1d3b77af-f21d-4eaf-a243-c2994a2abdee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '954fa60344294dce9f557db99d4e2125'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:27.839025 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-923b24fb-a7e6-4a28-b962-c56eb3173cf4 None None] MFA Rules not processed for user `b5b9894a359c48dcbf10f55565191e39`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:27.841688 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-923b24fb-a7e6-4a28-b962-c56eb3173cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:27.865717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-1d3b77af-f21d-4eaf-a243-c2994a2abdee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '954fa60344294dce9f557db99d4e2125'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:27.866662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-1d3b77af-f21d-4eaf-a243-c2994a2abdee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '954fa60344294dce9f557db99d4e2125'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:27.902239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-1d3b77af-f21d-4eaf-a243-c2994a2abdee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '954fa60344294dce9f557db99d4e2125'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:27.920529 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 723/1443] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:27 2022] DELETE /identity/v3/users/954fa60344294dce9f557db99d4e2125 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:27.922119 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba28cd4-1363-4e82-aa5e-d36a9a8ab113 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:27.922401 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba28cd4-1363-4e82-aa5e-d36a9a8ab113 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:27.922671 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba28cd4-1363-4e82-aa5e-d36a9a8ab113 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:27.924131 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 724/1444] 10.222.0.17 () {54 vars in 921 bytes} [Thu Oct 20 14:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:41:27.925568 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba28cd4-1363-4e82-aa5e-d36a9a8ab113 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:27.927477 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-8ba28cd4-1363-4e82-aa5e-d36a9a8ab113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:27.998726 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 721/1445] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:28.000122 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d28294-27be-4f9e-8894-3e1200b8fded None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:28.000469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d28294-27be-4f9e-8894-3e1200b8fded None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:28.000849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d28294-27be-4f9e-8894-3e1200b8fded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:28.026543 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba28cd4-1363-4e82-aa5e-d36a9a8ab113 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:28.042045 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cb69e-716a-4486-a188-bf31a646f9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:28.043020 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cb69e-716a-4486-a188-bf31a646f9ff admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:28.045982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cb69e-716a-4486-a188-bf31a646f9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:28.046524 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cb69e-716a-4486-a188-bf31a646f9ff admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:28.047405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246cb69e-716a-4486-a188-bf31a646f9ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:28.049745 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246cb69e-716a-4486-a188-bf31a646f9ff admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:28.067056 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-14d28294-27be-4f9e-8894-3e1200b8fded None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:28.068326 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-14d28294-27be-4f9e-8894-3e1200b8fded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:28.084630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 722/1446] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:28.104105 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710d1a5-fca6-4403-afa2-9585dfabb220 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:28.104397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710d1a5-fca6-4403-afa2-9585dfabb220 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:28.104680 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710d1a5-fca6-4403-afa2-9585dfabb220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:28.109698 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 725/1447] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:27 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:28.113518 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cb69e-716a-4486-a188-bf31a646f9ff admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:28.115541 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-246cb69e-716a-4486-a188-bf31a646f9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:28.167302 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-3710d1a5-fca6-4403-afa2-9585dfabb220 None None] MFA Rules not processed for user `172b859c0d774c8f8a98ce23bdc237d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:28.168546 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-3710d1a5-fca6-4403-afa2-9585dfabb220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:28.189687 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:28.259623 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cb69e-716a-4486-a188-bf31a646f9ff admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:28.265889 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a73122-faa6-44a2-bbda-df7c05acb664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:28.267561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a73122-faa6-44a2-bbda-df7c05acb664 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:28.268145 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a73122-faa6-44a2-bbda-df7c05acb664 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:28.268563 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a73122-faa6-44a2-bbda-df7c05acb664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:28.291409 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a73122-faa6-44a2-bbda-df7c05acb664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:28.293276 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a73122-faa6-44a2-bbda-df7c05acb664 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:28.306743 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 726/1448] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:28.309320 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a73122-faa6-44a2-bbda-df7c05acb664 service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:28.330993 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a73122-faa6-44a2-bbda-df7c05acb664 service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:28.336712 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac1235-3df3-469a-a961-5d82134bb907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:28.337938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac1235-3df3-469a-a961-5d82134bb907 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:28.338269 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac1235-3df3-469a-a961-5d82134bb907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:28.338710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac1235-3df3-469a-a961-5d82134bb907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:28.339866 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac1235-3df3-469a-a961-5d82134bb907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:28.341703 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac1235-3df3-469a-a961-5d82134bb907 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:28.358208 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 727/1449] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:28.362467 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac1235-3df3-469a-a961-5d82134bb907 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:28.380167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac1235-3df3-469a-a961-5d82134bb907 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:28.390085 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74abf6-5d01-482a-bf81-70d0c37845a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:28.391887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74abf6-5d01-482a-bf81-70d0c37845a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:28.391887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74abf6-5d01-482a-bf81-70d0c37845a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:28.392304 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74abf6-5d01-482a-bf81-70d0c37845a8 admin admin] PATH_INFO: `/v3/projects/9ac0525d17cc4bae970d4a348dff79ca/users/7baac643565344a1a99ff37a5da45d68/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:28.440837 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 723/1450] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Oct 20 14:41:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:28.452010 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74abf6-5d01-482a-bf81-70d0c37845a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac0525d17cc4bae970d4a348dff79ca, user_id=7baac643565344a1a99ff37a5da45d68, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:28.461123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74abf6-5d01-482a-bf81-70d0c37845a8 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:28.495643 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 728/1451] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:28 2022] PUT /identity/v3/projects/9ac0525d17cc4bae970d4a348dff79ca/users/7baac643565344a1a99ff37a5da45d68/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:41:28.500196 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710d1a5-fca6-4403-afa2-9585dfabb220 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:28.514756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710d1a5-fca6-4403-afa2-9585dfabb220 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:28.837177 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455bd48-d917-4544-b34a-e1a41e043485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:28.839032 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455bd48-d917-4544-b34a-e1a41e043485 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:28.839311 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455bd48-d917-4544-b34a-e1a41e043485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:28.839661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455bd48-d917-4544-b34a-e1a41e043485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:28.840403 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455bd48-d917-4544-b34a-e1a41e043485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:28.842093 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455bd48-d917-4544-b34a-e1a41e043485 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:28.877375 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 724/1452] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:28.881688 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74abf6-5d01-482a-bf81-70d0c37845a8 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:28.900719 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74abf6-5d01-482a-bf81-70d0c37845a8 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:28.927605 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051cf99-08f8-40f3-b293-caa8e0abaa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:28.930043 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051cf99-08f8-40f3-b293-caa8e0abaa7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:28.930888 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051cf99-08f8-40f3-b293-caa8e0abaa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:28.931179 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051cf99-08f8-40f3-b293-caa8e0abaa7c admin admin] PATH_INFO: `/v3/projects/9ac0525d17cc4bae970d4a348dff79ca/users/7baac643565344a1a99ff37a5da45d68/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:28.942069 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051cf99-08f8-40f3-b293-caa8e0abaa7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac0525d17cc4bae970d4a348dff79ca, user_id=7baac643565344a1a99ff37a5da45d68, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:28.958095 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051cf99-08f8-40f3-b293-caa8e0abaa7c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:29.001932 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 729/1453] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:28 2022] PUT /identity/v3/projects/9ac0525d17cc4bae970d4a348dff79ca/users/7baac643565344a1a99ff37a5da45d68/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:29.004166 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c11dd-0255-40e6-bb02-e3482285c053 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:29.004661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c11dd-0255-40e6-bb02-e3482285c053 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:29.004944 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c11dd-0255-40e6-bb02-e3482285c053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:29.104925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-a56c11dd-0255-40e6-bb02-e3482285c053 None None] MFA Rules not processed for user `7baac643565344a1a99ff37a5da45d68`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:29.106266 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a56c11dd-0255-40e6-bb02-e3482285c053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:29.136133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:29.277312 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051cf99-08f8-40f3-b293-caa8e0abaa7c admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:29.280873 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-0051cf99-08f8-40f3-b293-caa8e0abaa7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:29.411338 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 725/1454] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:29.417434 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f916fb0-d9ee-48ee-a224-a3b6c3629da6 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:29.417974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f916fb0-d9ee-48ee-a224-a3b6c3629da6 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:29.418489 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f916fb0-d9ee-48ee-a224-a3b6c3629da6 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:29.420937 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 726/1455] 10.222.0.17 () {54 vars in 912 bytes} [Thu Oct 20 14:41:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:41:29.430351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f916fb0-d9ee-48ee-a224-a3b6c3629da6 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:29.439085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-2f916fb0-d9ee-48ee-a224-a3b6c3629da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:29.574280 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051cf99-08f8-40f3-b293-caa8e0abaa7c admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:29.588402 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853902c8-0e44-4b42-986c-3d631234251d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:29.589049 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853902c8-0e44-4b42-986c-3d631234251d service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:29.590667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853902c8-0e44-4b42-986c-3d631234251d service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:29.591047 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853902c8-0e44-4b42-986c-3d631234251d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:29.592437 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f916fb0-d9ee-48ee-a224-a3b6c3629da6 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:29.603067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a37ec-d214-4b3f-b0c9-d7258b5c2590 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:29.603717 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a37ec-d214-4b3f-b0c9-d7258b5c2590 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:29.604008 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a37ec-d214-4b3f-b0c9-d7258b5c2590 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:29.604306 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a37ec-d214-4b3f-b0c9-d7258b5c2590 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:29.626632 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a37ec-d214-4b3f-b0c9-d7258b5c2590 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:29.628103 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a37ec-d214-4b3f-b0c9-d7258b5c2590 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:29.658951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 727/1456] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:29.661680 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c023250-9bf4-4d97-9026-be05ae6f5da8 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:29.662028 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c023250-9bf4-4d97-9026-be05ae6f5da8 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:29.664250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c023250-9bf4-4d97-9026-be05ae6f5da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:29.707832 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-3c023250-9bf4-4d97-9026-be05ae6f5da8 None None] MFA Rules not processed for user `359e9d904b0d43acae86337c1eb6a71d`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:29.709570 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-3c023250-9bf4-4d97-9026-be05ae6f5da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:29.742355 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853902c8-0e44-4b42-986c-3d631234251d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:29.744963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853902c8-0e44-4b42-986c-3d631234251d service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:29.767271 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 730/1457] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:41:29.839299 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 728/1458] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Oct 20 14:41:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:29.880004 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853902c8-0e44-4b42-986c-3d631234251d service nova] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:29.881567 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-853902c8-0e44-4b42-986c-3d631234251d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:29.909667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853902c8-0e44-4b42-986c-3d631234251d service nova] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:29.919457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd858555-682f-4740-b372-a377cd2b950f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:29.921134 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd858555-682f-4740-b372-a377cd2b950f service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:29.921305 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd858555-682f-4740-b372-a377cd2b950f service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:29.922335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd858555-682f-4740-b372-a377cd2b950f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:29.945441 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd858555-682f-4740-b372-a377cd2b950f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:29.952206 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd858555-682f-4740-b372-a377cd2b950f service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:29.999258 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c023250-9bf4-4d97-9026-be05ae6f5da8 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:30.002541 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 731/1459] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:30.055557 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c023250-9bf4-4d97-9026-be05ae6f5da8 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:30.081371 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fba7a0-c96e-4b7e-b39a-2fd4129cf4b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:30.082132 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fba7a0-c96e-4b7e-b39a-2fd4129cf4b4 service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:30.082491 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fba7a0-c96e-4b7e-b39a-2fd4129cf4b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:30.082835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fba7a0-c96e-4b7e-b39a-2fd4129cf4b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:30.126935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fba7a0-c96e-4b7e-b39a-2fd4129cf4b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:30.131925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fba7a0-c96e-4b7e-b39a-2fd4129cf4b4 service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:30.172627 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 729/1460] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:41:31.775193 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd858555-682f-4740-b372-a377cd2b950f service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:31.777455 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-cd858555-682f-4740-b372-a377cd2b950f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:31.786993 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:31.978426 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd858555-682f-4740-b372-a377cd2b950f service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:31.997895 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25503c01-322f-4ca3-98b3-c7ef302bff9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:31.998575 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25503c01-322f-4ca3-98b3-c7ef302bff9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:31.998849 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25503c01-322f-4ca3-98b3-c7ef302bff9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:31.999113 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25503c01-322f-4ca3-98b3-c7ef302bff9f admin admin] PATH_INFO: `/v3/projects/67cec1fa0e2641358b8561da686f49f2` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:32.005586 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25503c01-322f-4ca3-98b3-c7ef302bff9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=67cec1fa0e2641358b8561da686f49f2)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:32.016876 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25503c01-322f-4ca3-98b3-c7ef302bff9f admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:32.093244 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fba7a0-c96e-4b7e-b39a-2fd4129cf4b4 service nova] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:32.095992 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-95fba7a0-c96e-4b7e-b39a-2fd4129cf4b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:32.120055 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fba7a0-c96e-4b7e-b39a-2fd4129cf4b4 service nova] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:32.157789 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-25503c01-322f-4ca3-98b3-c7ef302bff9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67cec1fa0e2641358b8561da686f49f2', 'request_id': 'req-25503c01-322f-4ca3-98b3-c7ef302bff9f'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:32.175497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-25503c01-322f-4ca3-98b3-c7ef302bff9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67cec1fa0e2641358b8561da686f49f2', 'request_id': 'req-25503c01-322f-4ca3-98b3-c7ef302bff9f'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:32.198797 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-25503c01-322f-4ca3-98b3-c7ef302bff9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67cec1fa0e2641358b8561da686f49f2', 'request_id': 'req-25503c01-322f-4ca3-98b3-c7ef302bff9f'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:32.220752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-25503c01-322f-4ca3-98b3-c7ef302bff9f admin admin] The token cache is being invalidate because project 67cec1fa0e2641358b8561da686f49f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:32.221404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-25503c01-322f-4ca3-98b3-c7ef302bff9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:32.222254 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-25503c01-322f-4ca3-98b3-c7ef302bff9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:32.224738 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 732/1461] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:31 2022] DELETE /identity/v3/projects/67cec1fa0e2641358b8561da686f49f2 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:32.229054 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25503c01-322f-4ca3-98b3-c7ef302bff9f admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:32.231420 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-25503c01-322f-4ca3-98b3-c7ef302bff9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:32.287582 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:32.340044 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e9247-5c57-47cd-b394-fa30836e286a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:32.340716 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e9247-5c57-47cd-b394-fa30836e286a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:32.341000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e9247-5c57-47cd-b394-fa30836e286a admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:32.341274 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e9247-5c57-47cd-b394-fa30836e286a admin admin] PATH_INFO: `/v3/users/327a221009664f66a1a2e0a9e26d1d4c` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:32.351517 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e9247-5c57-47cd-b394-fa30836e286a admin admin] RBAC: Authorizing `identity:delete_user(user_id=327a221009664f66a1a2e0a9e26d1d4c)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:32.355975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e9247-5c57-47cd-b394-fa30836e286a admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:32.403881 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25503c01-322f-4ca3-98b3-c7ef302bff9f admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:32.413264 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a3db9-085c-4fb3-857a-666ff6b92107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:32.415843 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a3db9-085c-4fb3-857a-666ff6b92107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:32.415843 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a3db9-085c-4fb3-857a-666ff6b92107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:32.416079 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a3db9-085c-4fb3-857a-666ff6b92107 admin admin] PATH_INFO: `/v3/users/694746e03def4301b9f1018e214250c0` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:32.417752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a3db9-085c-4fb3-857a-666ff6b92107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=694746e03def4301b9f1018e214250c0)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:32.421139 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a3db9-085c-4fb3-857a-666ff6b92107 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:32.486258 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:32.524972 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-288a3db9-085c-4fb3-857a-666ff6b92107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '694746e03def4301b9f1018e214250c0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:32.555355 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-288a3db9-085c-4fb3-857a-666ff6b92107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '694746e03def4301b9f1018e214250c0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:32.594302 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-082e9247-5c57-47cd-b394-fa30836e286a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327a221009664f66a1a2e0a9e26d1d4c'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:32.609155 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-288a3db9-085c-4fb3-857a-666ff6b92107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '694746e03def4301b9f1018e214250c0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:32.609155 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-288a3db9-085c-4fb3-857a-666ff6b92107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '694746e03def4301b9f1018e214250c0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:32.621353 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-288a3db9-085c-4fb3-857a-666ff6b92107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '694746e03def4301b9f1018e214250c0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:32.625435 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-082e9247-5c57-47cd-b394-fa30836e286a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327a221009664f66a1a2e0a9e26d1d4c'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:32.626612 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-082e9247-5c57-47cd-b394-fa30836e286a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327a221009664f66a1a2e0a9e26d1d4c'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:32.628147 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-082e9247-5c57-47cd-b394-fa30836e286a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327a221009664f66a1a2e0a9e26d1d4c'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:32.652370 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 733/1462] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:32 2022] DELETE /identity/v3/users/694746e03def4301b9f1018e214250c0 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:32.653048 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-082e9247-5c57-47cd-b394-fa30836e286a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327a221009664f66a1a2e0a9e26d1d4c'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:32.659536 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfa9de-342f-44b6-bd6e-532ef0f684c1 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:32.664173 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfa9de-342f-44b6-bd6e-532ef0f684c1 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:32.664518 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfa9de-342f-44b6-bd6e-532ef0f684c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:32.699516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 730/1463] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:32 2022] DELETE /identity/v3/users/327a221009664f66a1a2e0a9e26d1d4c => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:32.705180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bd71e-f5c2-4b24-b4bb-0e6c7087a14e None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:32.705755 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bd71e-f5c2-4b24-b4bb-0e6c7087a14e None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:32.706395 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bd71e-f5c2-4b24-b4bb-0e6c7087a14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:32.740548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-dc7bd71e-f5c2-4b24-b4bb-0e6c7087a14e None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:32.743126 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-dc7bd71e-f5c2-4b24-b4bb-0e6c7087a14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:32.745884 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-98dfa9de-342f-44b6-bd6e-532ef0f684c1 None None] MFA Rules not processed for user `ebadd4bd1ec1442789777438c6d16414`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:32.754189 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-98dfa9de-342f-44b6-bd6e-532ef0f684c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:32.859397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 731/1464] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:41:32.961360 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bd71e-f5c2-4b24-b4bb-0e6c7087a14e None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:32.962458 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-dc7bd71e-f5c2-4b24-b4bb-0e6c7087a14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:32.994408 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 734/1465] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:33.176170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bd71e-f5c2-4b24-b4bb-0e6c7087a14e None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:33.188116 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74edadd-e478-4162-8e18-f2b9533d0b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:33.188886 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74edadd-e478-4162-8e18-f2b9533d0b28 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:33.189261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74edadd-e478-4162-8e18-f2b9533d0b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:33.189631 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74edadd-e478-4162-8e18-f2b9533d0b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:33.219703 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74edadd-e478-4162-8e18-f2b9533d0b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:33.237336 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74edadd-e478-4162-8e18-f2b9533d0b28 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:33.260455 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 732/1466] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:41:33.577253 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfa9de-342f-44b6-bd6e-532ef0f684c1 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:33.578757 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-98dfa9de-342f-44b6-bd6e-532ef0f684c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:33.601371 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfa9de-342f-44b6-bd6e-532ef0f684c1 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:33.615180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b8722-6db6-4a78-a487-0fc18b4e2a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:33.615909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b8722-6db6-4a78-a487-0fc18b4e2a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:33.616296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b8722-6db6-4a78-a487-0fc18b4e2a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:33.616871 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b8722-6db6-4a78-a487-0fc18b4e2a72 admin admin] PATH_INFO: `/v3/users/4311acd779a744fcaebb9918c1fb020c` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:33.622427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b8722-6db6-4a78-a487-0fc18b4e2a72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4311acd779a744fcaebb9918c1fb020c)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:33.624751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b8722-6db6-4a78-a487-0fc18b4e2a72 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:33.759700 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-a24b8722-6db6-4a78-a487-0fc18b4e2a72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4311acd779a744fcaebb9918c1fb020c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:33.782780 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-a24b8722-6db6-4a78-a487-0fc18b4e2a72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4311acd779a744fcaebb9918c1fb020c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:33.811708 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-a24b8722-6db6-4a78-a487-0fc18b4e2a72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4311acd779a744fcaebb9918c1fb020c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:33.812390 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-a24b8722-6db6-4a78-a487-0fc18b4e2a72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4311acd779a744fcaebb9918c1fb020c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:33.830046 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-a24b8722-6db6-4a78-a487-0fc18b4e2a72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4311acd779a744fcaebb9918c1fb020c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:33.849372 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d2a24-8abb-4d81-8f5e-21248005e219 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:33.849668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d2a24-8abb-4d81-8f5e-21248005e219 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:33.849940 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 735/1467] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:33 2022] DELETE /identity/v3/users/4311acd779a744fcaebb9918c1fb020c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:33.850055 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d2a24-8abb-4d81-8f5e-21248005e219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:33.886374 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-8b3d2a24-8abb-4d81-8f5e-21248005e219 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:33.895148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-8b3d2a24-8abb-4d81-8f5e-21248005e219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:33.901790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:34.043121 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 733/1468] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:34.074294 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b8722-6db6-4a78-a487-0fc18b4e2a72 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:34.075775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a24b8722-6db6-4a78-a487-0fc18b4e2a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:34.196763 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:34.239479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b8722-6db6-4a78-a487-0fc18b4e2a72 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:34.258037 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092af9ff-43e3-4391-ab7d-23b944a5e55f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:34.259447 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092af9ff-43e3-4391-ab7d-23b944a5e55f service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:34.260033 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092af9ff-43e3-4391-ab7d-23b944a5e55f service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:34.260670 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092af9ff-43e3-4391-ab7d-23b944a5e55f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:34.278308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092af9ff-43e3-4391-ab7d-23b944a5e55f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:34.280298 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092af9ff-43e3-4391-ab7d-23b944a5e55f service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:34.301972 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 736/1469] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:35.099166 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d2a24-8abb-4d81-8f5e-21248005e219 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:35.102121 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092af9ff-43e3-4391-ab7d-23b944a5e55f service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:35.103670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-8b3d2a24-8abb-4d81-8f5e-21248005e219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:35.106655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-092af9ff-43e3-4391-ab7d-23b944a5e55f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:35.155085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d2a24-8abb-4d81-8f5e-21248005e219 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:35.173246 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092af9ff-43e3-4391-ab7d-23b944a5e55f service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:35.192201 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfd663-62fe-430e-b4a4-2236f920c35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:35.192865 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfd663-62fe-430e-b4a4-2236f920c35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:35.193143 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfd663-62fe-430e-b4a4-2236f920c35a admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:35.193416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfd663-62fe-430e-b4a4-2236f920c35a admin admin] PATH_INFO: `/v3/projects/921b60225e88451680b7392a7b9ef204` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:35.197456 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfd663-62fe-430e-b4a4-2236f920c35a admin admin] RBAC: Authorizing `identity:delete_project(project_id=921b60225e88451680b7392a7b9ef204)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:35.199647 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfd663-62fe-430e-b4a4-2236f920c35a admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:35.199762 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ffecb-6b22-463d-9223-033c0eca1318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:35.200473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ffecb-6b22-463d-9223-033c0eca1318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:35.200764 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ffecb-6b22-463d-9223-033c0eca1318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:35.201256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ffecb-6b22-463d-9223-033c0eca1318 admin admin] PATH_INFO: `/v3/projects/6b35ac942ee842469fdb9b857c6c67b6` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:35.204956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ffecb-6b22-463d-9223-033c0eca1318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b35ac942ee842469fdb9b857c6c67b6)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:35.208651 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ffecb-6b22-463d-9223-033c0eca1318 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:35.329167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-d9bfd663-62fe-430e-b4a4-2236f920c35a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '921b60225e88451680b7392a7b9ef204', 'request_id': 'req-d9bfd663-62fe-430e-b4a4-2236f920c35a'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:35.348461 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-d9bfd663-62fe-430e-b4a4-2236f920c35a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '921b60225e88451680b7392a7b9ef204', 'request_id': 'req-d9bfd663-62fe-430e-b4a4-2236f920c35a'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:35.362915 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e21ffecb-6b22-463d-9223-033c0eca1318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b35ac942ee842469fdb9b857c6c67b6', 'request_id': 'req-e21ffecb-6b22-463d-9223-033c0eca1318'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:35.372988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-d9bfd663-62fe-430e-b4a4-2236f920c35a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '921b60225e88451680b7392a7b9ef204', 'request_id': 'req-d9bfd663-62fe-430e-b4a4-2236f920c35a'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:35.381604 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e21ffecb-6b22-463d-9223-033c0eca1318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b35ac942ee842469fdb9b857c6c67b6', 'request_id': 'req-e21ffecb-6b22-463d-9223-033c0eca1318'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:35.395325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e21ffecb-6b22-463d-9223-033c0eca1318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b35ac942ee842469fdb9b857c6c67b6', 'request_id': 'req-e21ffecb-6b22-463d-9223-033c0eca1318'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:35.408427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-d9bfd663-62fe-430e-b4a4-2236f920c35a admin admin] The token cache is being invalidate because project 921b60225e88451680b7392a7b9ef204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:35.415012 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-d9bfd663-62fe-430e-b4a4-2236f920c35a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:35.417687 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-d9bfd663-62fe-430e-b4a4-2236f920c35a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:35.420357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 737/1470] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:35 2022] DELETE /identity/v3/projects/921b60225e88451680b7392a7b9ef204 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:35.420876 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e21ffecb-6b22-463d-9223-033c0eca1318 admin admin] The token cache is being invalidate because project 6b35ac942ee842469fdb9b857c6c67b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:35.421282 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e21ffecb-6b22-463d-9223-033c0eca1318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:35.422491 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e21ffecb-6b22-463d-9223-033c0eca1318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:35.422880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6943da9-df47-4652-bde9-8a0defbf1c58 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:35.423420 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6943da9-df47-4652-bde9-8a0defbf1c58 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:35.423942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6943da9-df47-4652-bde9-8a0defbf1c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:35.425439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 734/1471] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:35 2022] DELETE /identity/v3/projects/6b35ac942ee842469fdb9b857c6c67b6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:35.427195 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ffecb-6b22-463d-9223-033c0eca1318 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:35.430083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e21ffecb-6b22-463d-9223-033c0eca1318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:35.485828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-b6943da9-df47-4652-bde9-8a0defbf1c58 None None] MFA Rules not processed for user `b5b9894a359c48dcbf10f55565191e39`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:35.487192 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b6943da9-df47-4652-bde9-8a0defbf1c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:35.649310 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ffecb-6b22-463d-9223-033c0eca1318 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:35.667838 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cf463-5026-4e6f-940a-cdbbe2d13cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:35.668736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cf463-5026-4e6f-940a-cdbbe2d13cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:35.669408 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cf463-5026-4e6f-940a-cdbbe2d13cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:35.669830 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cf463-5026-4e6f-940a-cdbbe2d13cc7 admin admin] PATH_INFO: `/v3/users/ae75c1bdead344938557ccf2ad665b9b` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:35.673696 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4cf463-5026-4e6f-940a-cdbbe2d13cc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae75c1bdead344938557ccf2ad665b9b)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:35.675852 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4cf463-5026-4e6f-940a-cdbbe2d13cc7 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:35.707001 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 738/1472] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:35.721873 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6943da9-df47-4652-bde9-8a0defbf1c58 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:35.721873 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b6943da9-df47-4652-bde9-8a0defbf1c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:35.791883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:35.794667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6943da9-df47-4652-bde9-8a0defbf1c58 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:35.806867 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8d4cf463-5026-4e6f-940a-cdbbe2d13cc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae75c1bdead344938557ccf2ad665b9b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:35.822778 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8d4cf463-5026-4e6f-940a-cdbbe2d13cc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae75c1bdead344938557ccf2ad665b9b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:35.823541 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8d4cf463-5026-4e6f-940a-cdbbe2d13cc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae75c1bdead344938557ccf2ad665b9b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:35.824874 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8d4cf463-5026-4e6f-940a-cdbbe2d13cc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae75c1bdead344938557ccf2ad665b9b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:35.847245 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8d4cf463-5026-4e6f-940a-cdbbe2d13cc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae75c1bdead344938557ccf2ad665b9b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:35.849194 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b17db-a49e-446b-a080-71647d3a793c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:35.852013 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b17db-a49e-446b-a080-71647d3a793c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:35.852359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b17db-a49e-446b-a080-71647d3a793c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:35.853667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b17db-a49e-446b-a080-71647d3a793c admin admin] PATH_INFO: `/v3/users/8422875065aa4d1fbe78bb3d07ac2658` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:35.856534 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b17db-a49e-446b-a080-71647d3a793c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8422875065aa4d1fbe78bb3d07ac2658)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:35.861092 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b17db-a49e-446b-a080-71647d3a793c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:35.917449 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 735/1473] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:35 2022] DELETE /identity/v3/users/ae75c1bdead344938557ccf2ad665b9b => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:35.924132 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cf463-5026-4e6f-940a-cdbbe2d13cc7 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:35.937688 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-8d4cf463-5026-4e6f-940a-cdbbe2d13cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:35.988049 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-929b17db-a49e-446b-a080-71647d3a793c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8422875065aa4d1fbe78bb3d07ac2658'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:36.010183 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-929b17db-a49e-446b-a080-71647d3a793c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8422875065aa4d1fbe78bb3d07ac2658'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:36.013341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:36.045606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-929b17db-a49e-446b-a080-71647d3a793c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8422875065aa4d1fbe78bb3d07ac2658'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:36.048662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-929b17db-a49e-446b-a080-71647d3a793c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8422875065aa4d1fbe78bb3d07ac2658'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:36.064651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-929b17db-a49e-446b-a080-71647d3a793c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8422875065aa4d1fbe78bb3d07ac2658'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:36.092315 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 739/1474] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:35 2022] DELETE /identity/v3/users/8422875065aa4d1fbe78bb3d07ac2658 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:36.183360 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cf463-5026-4e6f-940a-cdbbe2d13cc7 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:36.366986 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c0cdd-9a1c-413a-991f-952e712f7f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:36.367650 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c0cdd-9a1c-413a-991f-952e712f7f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:36.370091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c0cdd-9a1c-413a-991f-952e712f7f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:36.370382 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c0cdd-9a1c-413a-991f-952e712f7f12 admin admin] PATH_INFO: `/v3/projects/dad124866ba74171a55bb0bc1f46493c` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:36.372513 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c0cdd-9a1c-413a-991f-952e712f7f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad124866ba74171a55bb0bc1f46493c)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:36.374769 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c0cdd-9a1c-413a-991f-952e712f7f12 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:36.602392 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-343c0cdd-9a1c-413a-991f-952e712f7f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad124866ba74171a55bb0bc1f46493c', 'request_id': 'req-343c0cdd-9a1c-413a-991f-952e712f7f12'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:36.627697 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-343c0cdd-9a1c-413a-991f-952e712f7f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad124866ba74171a55bb0bc1f46493c', 'request_id': 'req-343c0cdd-9a1c-413a-991f-952e712f7f12'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:36.643511 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:36.657178 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-343c0cdd-9a1c-413a-991f-952e712f7f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad124866ba74171a55bb0bc1f46493c', 'request_id': 'req-343c0cdd-9a1c-413a-991f-952e712f7f12'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:36.688222 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-343c0cdd-9a1c-413a-991f-952e712f7f12 admin admin] The token cache is being invalidate because project dad124866ba74171a55bb0bc1f46493c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:36.688889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-343c0cdd-9a1c-413a-991f-952e712f7f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:36.691131 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-343c0cdd-9a1c-413a-991f-952e712f7f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:36.695674 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 736/1475] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:35 2022] DELETE /identity/v3/projects/dad124866ba74171a55bb0bc1f46493c => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:36.700496 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b17db-a49e-446b-a080-71647d3a793c admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:36.702585 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-929b17db-a49e-446b-a080-71647d3a793c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:36.728584 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b17db-a49e-446b-a080-71647d3a793c admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:36.880685 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93739bd7-9c62-4bc3-813d-e315e0f3ad81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:36.881381 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93739bd7-9c62-4bc3-813d-e315e0f3ad81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:36.882294 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93739bd7-9c62-4bc3-813d-e315e0f3ad81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:36.882576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93739bd7-9c62-4bc3-813d-e315e0f3ad81 admin admin] PATH_INFO: `/v3/users/7baac643565344a1a99ff37a5da45d68` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:36.884523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93739bd7-9c62-4bc3-813d-e315e0f3ad81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7baac643565344a1a99ff37a5da45d68)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:36.888881 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93739bd7-9c62-4bc3-813d-e315e0f3ad81 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:37.055234 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-93739bd7-9c62-4bc3-813d-e315e0f3ad81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7baac643565344a1a99ff37a5da45d68'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:37.066924 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-93739bd7-9c62-4bc3-813d-e315e0f3ad81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7baac643565344a1a99ff37a5da45d68'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:37.089399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-93739bd7-9c62-4bc3-813d-e315e0f3ad81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7baac643565344a1a99ff37a5da45d68'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:37.091821 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-93739bd7-9c62-4bc3-813d-e315e0f3ad81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7baac643565344a1a99ff37a5da45d68'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:37.107527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-93739bd7-9c62-4bc3-813d-e315e0f3ad81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7baac643565344a1a99ff37a5da45d68'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:37.121835 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 740/1476] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:36 2022] DELETE /identity/v3/users/7baac643565344a1a99ff37a5da45d68 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:37.697578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d596972-36ec-4403-a1f4-ab5a099b95fc None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:37.698281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d596972-36ec-4403-a1f4-ab5a099b95fc None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:37.698281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d596972-36ec-4403-a1f4-ab5a099b95fc None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:37.700258 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 737/1477] 10.222.0.17 () {54 vars in 921 bytes} [Thu Oct 20 14:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:41:37.782459 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048946c-5a8d-4bde-836f-f5576ad08d41 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:37.783839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048946c-5a8d-4bde-836f-f5576ad08d41 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:37.783839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048946c-5a8d-4bde-836f-f5576ad08d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:37.845512 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-9048946c-5a8d-4bde-836f-f5576ad08d41 None None] MFA Rules not processed for user `172b859c0d774c8f8a98ce23bdc237d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:37.845512 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-9048946c-5a8d-4bde-836f-f5576ad08d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:38.005385 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:38.065456 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 741/1478] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Oct 20 14:41:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:38.229773 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d596972-36ec-4403-a1f4-ab5a099b95fc None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:38.236114 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048946c-5a8d-4bde-836f-f5576ad08d41 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:38.236257 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-2d596972-36ec-4403-a1f4-ab5a099b95fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:38.237482 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-9048946c-5a8d-4bde-836f-f5576ad08d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:38.325908 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d596972-36ec-4403-a1f4-ab5a099b95fc None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:38.331018 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42845e-8dbf-4ec8-a3a8-f7911800e210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:38.331718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42845e-8dbf-4ec8-a3a8-f7911800e210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:38.332391 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42845e-8dbf-4ec8-a3a8-f7911800e210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:38.332391 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42845e-8dbf-4ec8-a3a8-f7911800e210 admin admin] PATH_INFO: `/v3/users/a6ddba666dc145638a555c4a3fddf7a1` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:38.333798 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42845e-8dbf-4ec8-a3a8-f7911800e210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6ddba666dc145638a555c4a3fddf7a1)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:38.337252 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42845e-8dbf-4ec8-a3a8-f7911800e210 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:38.417639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-4b42845e-8dbf-4ec8-a3a8-f7911800e210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6ddba666dc145638a555c4a3fddf7a1'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:38.430845 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048946c-5a8d-4bde-836f-f5576ad08d41 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:38.440290 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-4b42845e-8dbf-4ec8-a3a8-f7911800e210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6ddba666dc145638a555c4a3fddf7a1'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:38.440961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-4b42845e-8dbf-4ec8-a3a8-f7911800e210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6ddba666dc145638a555c4a3fddf7a1'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:38.441601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-4b42845e-8dbf-4ec8-a3a8-f7911800e210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6ddba666dc145638a555c4a3fddf7a1'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:38.447183 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9d24e-477f-4913-ae70-94c41b1a232a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:38.448084 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9d24e-477f-4913-ae70-94c41b1a232a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:38.449211 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9d24e-477f-4913-ae70-94c41b1a232a admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:38.449662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9d24e-477f-4913-ae70-94c41b1a232a admin admin] PATH_INFO: `/v3/projects/d9251a1d77f349f895a1abd480ed0753` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:38.451103 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9d24e-477f-4913-ae70-94c41b1a232a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9251a1d77f349f895a1abd480ed0753)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:38.453277 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9d24e-477f-4913-ae70-94c41b1a232a admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:38.466059 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-4b42845e-8dbf-4ec8-a3a8-f7911800e210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6ddba666dc145638a555c4a3fddf7a1'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:38.513456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 738/1479] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:38 2022] DELETE /identity/v3/users/a6ddba666dc145638a555c4a3fddf7a1 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:38.524394 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3099214-521b-489e-966e-b893fc268a48 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:38.524394 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3099214-521b-489e-966e-b893fc268a48 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:38.524394 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3099214-521b-489e-966e-b893fc268a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:38.584136 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-aeb9d24e-477f-4913-ae70-94c41b1a232a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9251a1d77f349f895a1abd480ed0753', 'request_id': 'req-aeb9d24e-477f-4913-ae70-94c41b1a232a'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:38.599177 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-aeb9d24e-477f-4913-ae70-94c41b1a232a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9251a1d77f349f895a1abd480ed0753', 'request_id': 'req-aeb9d24e-477f-4913-ae70-94c41b1a232a'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:38.606962 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-b3099214-521b-489e-966e-b893fc268a48 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:38.609673 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-b3099214-521b-489e-966e-b893fc268a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:38.615034 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-aeb9d24e-477f-4913-ae70-94c41b1a232a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9251a1d77f349f895a1abd480ed0753', 'request_id': 'req-aeb9d24e-477f-4913-ae70-94c41b1a232a'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:38.638753 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-aeb9d24e-477f-4913-ae70-94c41b1a232a admin admin] The token cache is being invalidate because project d9251a1d77f349f895a1abd480ed0753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:38.641492 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-aeb9d24e-477f-4913-ae70-94c41b1a232a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:38.644043 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-aeb9d24e-477f-4913-ae70-94c41b1a232a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:38.649531 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 742/1480] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:38 2022] DELETE /identity/v3/projects/d9251a1d77f349f895a1abd480ed0753 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:41:38.651670 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9d24e-477f-4913-ae70-94c41b1a232a admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:38.655606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-aeb9d24e-477f-4913-ae70-94c41b1a232a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:38.709419 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 739/1481] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:38.710413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3099214-521b-489e-966e-b893fc268a48 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:38.715858 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-b3099214-521b-489e-966e-b893fc268a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:38.742428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:38.813707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9d24e-477f-4913-ae70-94c41b1a232a admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:38.828173 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ea3c0-d803-4d8d-8e30-d4742e63e7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:38.829035 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ea3c0-d803-4d8d-8e30-d4742e63e7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:38.829418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ea3c0-d803-4d8d-8e30-d4742e63e7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:38.830020 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ea3c0-d803-4d8d-8e30-d4742e63e7f3 admin admin] PATH_INFO: `/v3/projects/9ac0525d17cc4bae970d4a348dff79ca` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:38.836840 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ea3c0-d803-4d8d-8e30-d4742e63e7f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac0525d17cc4bae970d4a348dff79ca)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:38.838995 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ea3c0-d803-4d8d-8e30-d4742e63e7f3 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:38.869977 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:38.941521 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8e3ea3c0-d803-4d8d-8e30-d4742e63e7f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac0525d17cc4bae970d4a348dff79ca', 'request_id': 'req-8e3ea3c0-d803-4d8d-8e30-d4742e63e7f3'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:38.957344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3099214-521b-489e-966e-b893fc268a48 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:38.959956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8e3ea3c0-d803-4d8d-8e30-d4742e63e7f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac0525d17cc4bae970d4a348dff79ca', 'request_id': 'req-8e3ea3c0-d803-4d8d-8e30-d4742e63e7f3'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:38.974115 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8e3ea3c0-d803-4d8d-8e30-d4742e63e7f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac0525d17cc4bae970d4a348dff79ca', 'request_id': 'req-8e3ea3c0-d803-4d8d-8e30-d4742e63e7f3'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:38.997693 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8e3ea3c0-d803-4d8d-8e30-d4742e63e7f3 admin admin] The token cache is being invalidate because project 9ac0525d17cc4bae970d4a348dff79ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:38.998047 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8e3ea3c0-d803-4d8d-8e30-d4742e63e7f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:38.999705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8e3ea3c0-d803-4d8d-8e30-d4742e63e7f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:39.007816 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 743/1482] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:38 2022] DELETE /identity/v3/projects/9ac0525d17cc4bae970d4a348dff79ca => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:39.007816 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b4823-c1cc-4a57-842f-a3912e560cd3 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:39.007816 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b4823-c1cc-4a57-842f-a3912e560cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:39.009131 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b4823-c1cc-4a57-842f-a3912e560cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:39.056427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-670b4823-c1cc-4a57-842f-a3912e560cd3 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:39.058867 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-670b4823-c1cc-4a57-842f-a3912e560cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:39.145739 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32595b-842a-4ab2-a14b-8f5d57b8487e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:39.146410 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32595b-842a-4ab2-a14b-8f5d57b8487e service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:39.146689 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32595b-842a-4ab2-a14b-8f5d57b8487e service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:39.146961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32595b-842a-4ab2-a14b-8f5d57b8487e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:39.153635 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-cf32595b-842a-4ab2-a14b-8f5d57b8487e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:39.186915 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32595b-842a-4ab2-a14b-8f5d57b8487e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:39.188543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32595b-842a-4ab2-a14b-8f5d57b8487e service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:39.210474 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 744/1483] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:39.212024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b4823-c1cc-4a57-842f-a3912e560cd3 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:39.212199 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 740/1484] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:39.213902 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-670b4823-c1cc-4a57-842f-a3912e560cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:39.214655 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32595b-842a-4ab2-a14b-8f5d57b8487e service nova] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:39.221312 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-cf32595b-842a-4ab2-a14b-8f5d57b8487e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:39.234982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b4823-c1cc-4a57-842f-a3912e560cd3 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:39.257111 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3dc17-0aa2-4e61-9436-7a61b57742b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:39.260531 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3dc17-0aa2-4e61-9436-7a61b57742b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:39.263311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3dc17-0aa2-4e61-9436-7a61b57742b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:39.264310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3dc17-0aa2-4e61-9436-7a61b57742b4 admin admin] PATH_INFO: `/v3/projects/6ce161a668ce4bbda2765a77cab43f7f` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:39.267887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3dc17-0aa2-4e61-9436-7a61b57742b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce161a668ce4bbda2765a77cab43f7f)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:39.272534 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3dc17-0aa2-4e61-9436-7a61b57742b4 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:39.392563 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-efd3dc17-0aa2-4e61-9436-7a61b57742b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce161a668ce4bbda2765a77cab43f7f', 'request_id': 'req-efd3dc17-0aa2-4e61-9436-7a61b57742b4'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:39.400327 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32595b-842a-4ab2-a14b-8f5d57b8487e service nova] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:39.406610 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-efd3dc17-0aa2-4e61-9436-7a61b57742b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce161a668ce4bbda2765a77cab43f7f', 'request_id': 'req-efd3dc17-0aa2-4e61-9436-7a61b57742b4'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:39.425960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-efd3dc17-0aa2-4e61-9436-7a61b57742b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce161a668ce4bbda2765a77cab43f7f', 'request_id': 'req-efd3dc17-0aa2-4e61-9436-7a61b57742b4'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:39.447124 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-efd3dc17-0aa2-4e61-9436-7a61b57742b4 admin admin] The token cache is being invalidate because project 6ce161a668ce4bbda2765a77cab43f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:39.447421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-efd3dc17-0aa2-4e61-9436-7a61b57742b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:39.454444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-efd3dc17-0aa2-4e61-9436-7a61b57742b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:39.457368 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 745/1485] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:39 2022] DELETE /identity/v3/projects/6ce161a668ce4bbda2765a77cab43f7f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:39.462701 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acddd21-ddf7-4696-b28c-2ac85b8f8511 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:39.463105 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acddd21-ddf7-4696-b28c-2ac85b8f8511 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:39.463567 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acddd21-ddf7-4696-b28c-2ac85b8f8511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:39.512200 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-2acddd21-ddf7-4696-b28c-2ac85b8f8511 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:39.513453 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2acddd21-ddf7-4696-b28c-2ac85b8f8511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:39.515123 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:39.524912 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cd893-39a0-46dd-9817-6bcf18142c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:39.526277 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cd893-39a0-46dd-9817-6bcf18142c67 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:39.526759 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cd893-39a0-46dd-9817-6bcf18142c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:39.529952 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cd893-39a0-46dd-9817-6bcf18142c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:39.535165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-b77cd893-39a0-46dd-9817-6bcf18142c67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:39.567419 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:39.660816 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 746/1486] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:39.660816 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93652f33-d520-47e5-abf3-ff53ee8c2b35 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:39.660816 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93652f33-d520-47e5-abf3-ff53ee8c2b35 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:39.660816 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93652f33-d520-47e5-abf3-ff53ee8c2b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:39.687857 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cd893-39a0-46dd-9817-6bcf18142c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:39.689248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-93652f33-d520-47e5-abf3-ff53ee8c2b35 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:39.689726 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cd893-39a0-46dd-9817-6bcf18142c67 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:39.690639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-93652f33-d520-47e5-abf3-ff53ee8c2b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:39.705025 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 741/1487] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:39.705961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece092d9-f869-4eb4-abda-f74b2df39a88 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:39.706382 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece092d9-f869-4eb4-abda-f74b2df39a88 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:39.706499 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 747/1488] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:39.706908 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece092d9-f869-4eb4-abda-f74b2df39a88 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:39.708517 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 742/1489] 10.222.0.17 () {54 vars in 921 bytes} [Thu Oct 20 14:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:41:39.710019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d95fdc-cd22-4941-9e85-2c720a987291 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:39.710618 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d95fdc-cd22-4941-9e85-2c720a987291 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:39.710618 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d95fdc-cd22-4941-9e85-2c720a987291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:39.715888 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b144732-21e2-4b70-885b-8bdd91791841 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:39.716283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b144732-21e2-4b70-885b-8bdd91791841 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:39.716720 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b144732-21e2-4b70-885b-8bdd91791841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:39.738881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-e1d95fdc-cd22-4941-9e85-2c720a987291 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:39.739732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-9b144732-21e2-4b70-885b-8bdd91791841 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:39.740338 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e1d95fdc-cd22-4941-9e85-2c720a987291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:39.741883 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-9b144732-21e2-4b70-885b-8bdd91791841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:39.751321 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 743/1490] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:39.752141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d95fdc-cd22-4941-9e85-2c720a987291 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:39.765170 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 748/1491] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:39.765170 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2980f-2457-413f-b766-10c62b3893ad None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:39.765170 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2980f-2457-413f-b766-10c62b3893ad None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:39.765170 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2980f-2457-413f-b766-10c62b3893ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:39.773945 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d95fdc-cd22-4941-9e85-2c720a987291 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:39.782239 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cc62b-6bcc-41e3-bacf-3433903966d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:39.783809 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cc62b-6bcc-41e3-bacf-3433903966d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:39.784368 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-70d2980f-2457-413f-b766-10c62b3893ad None None] MFA Rules not processed for user `172b859c0d774c8f8a98ce23bdc237d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:39.784583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cc62b-6bcc-41e3-bacf-3433903966d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:39.785027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cc62b-6bcc-41e3-bacf-3433903966d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:39.785863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-70d2980f-2457-413f-b766-10c62b3893ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:39.786292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cc62b-6bcc-41e3-bacf-3433903966d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:41:39.786805 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cc62b-6bcc-41e3-bacf-3433903966d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:39.790343 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cc62b-6bcc-41e3-bacf-3433903966d7 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:39.818327 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 744/1492] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:41:39.818327 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cc62b-6bcc-41e3-bacf-3433903966d7 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:39.832814 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cc62b-6bcc-41e3-bacf-3433903966d7 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:39.838231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd153530-69c5-46ab-9003-ddf617894460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:39.838935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd153530-69c5-46ab-9003-ddf617894460 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:39.839227 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd153530-69c5-46ab-9003-ddf617894460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:39.839496 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd153530-69c5-46ab-9003-ddf617894460 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:39.840346 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd153530-69c5-46ab-9003-ddf617894460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:41:39.840659 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd153530-69c5-46ab-9003-ddf617894460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:39.842368 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd153530-69c5-46ab-9003-ddf617894460 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:39.863123 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 745/1493] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:41:39.864438 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925795cc-fd1a-455a-a5d0-7c46635f957e None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:39.867126 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925795cc-fd1a-455a-a5d0-7c46635f957e None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:39.867126 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925795cc-fd1a-455a-a5d0-7c46635f957e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:39.892733 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 749/1494] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Oct 20 14:41:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:39.894300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-925795cc-fd1a-455a-a5d0-7c46635f957e None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:39.895940 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-925795cc-fd1a-455a-a5d0-7c46635f957e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:39.901973 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2980f-2457-413f-b766-10c62b3893ad None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:39.910540 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 746/1495] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:39.910540 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925795cc-fd1a-455a-a5d0-7c46635f957e None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:39.922454 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925795cc-fd1a-455a-a5d0-7c46635f957e None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:39.923107 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2980f-2457-413f-b766-10c62b3893ad None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:39.927666 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399d099-0e57-4d04-9f75-75f11a1a3e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:39.927802 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55135b-aacf-44cb-940c-d7d560b58b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:39.928811 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399d099-0e57-4d04-9f75-75f11a1a3e62 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:39.929103 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399d099-0e57-4d04-9f75-75f11a1a3e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:39.929207 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55135b-aacf-44cb-940c-d7d560b58b47 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:39.929386 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399d099-0e57-4d04-9f75-75f11a1a3e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:39.929758 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55135b-aacf-44cb-940c-d7d560b58b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:39.930013 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399d099-0e57-4d04-9f75-75f11a1a3e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:39.930106 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55135b-aacf-44cb-940c-d7d560b58b47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:39.930897 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55135b-aacf-44cb-940c-d7d560b58b47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:39.931894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399d099-0e57-4d04-9f75-75f11a1a3e62 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:39.933329 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55135b-aacf-44cb-940c-d7d560b58b47 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:39.964587 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 747/1496] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:39 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:39.965498 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399d099-0e57-4d04-9f75-75f11a1a3e62 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:39.976809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 750/1497] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:39 2022] POST /identity/v3/projects => generated 393 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:39.978182 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55135b-aacf-44cb-940c-d7d560b58b47 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:40.074692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399d099-0e57-4d04-9f75-75f11a1a3e62 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:40.076946 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55135b-aacf-44cb-940c-d7d560b58b47 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:40.080757 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626d7d9-83c5-44b4-911b-172f7f85eec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:40.081450 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626d7d9-83c5-44b4-911b-172f7f85eec3 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:40.081800 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626d7d9-83c5-44b4-911b-172f7f85eec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:40.082447 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626d7d9-83c5-44b4-911b-172f7f85eec3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:40.083315 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b9d3c-97a2-4a4e-88d0-7fa0259d3f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:40.083448 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626d7d9-83c5-44b4-911b-172f7f85eec3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:41:40.083529 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626d7d9-83c5-44b4-911b-172f7f85eec3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:40.083667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b9d3c-97a2-4a4e-88d0-7fa0259d3f51 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:40.084134 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b9d3c-97a2-4a4e-88d0-7fa0259d3f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:40.085037 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b9d3c-97a2-4a4e-88d0-7fa0259d3f51 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:40.085925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626d7d9-83c5-44b4-911b-172f7f85eec3 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:40.086925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b9d3c-97a2-4a4e-88d0-7fa0259d3f51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:40.090280 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b9d3c-97a2-4a4e-88d0-7fa0259d3f51 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:40.102045 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 748/1498] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:41:40.104274 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626d7d9-83c5-44b4-911b-172f7f85eec3 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:40.125117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626d7d9-83c5-44b4-911b-172f7f85eec3 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:40.132093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 751/1499] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:39 2022] POST /identity/v3/users => generated 297 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:40.132093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b9d3c-97a2-4a4e-88d0-7fa0259d3f51 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:40.133445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea712947-64c8-4832-add2-728efd8990f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:40.134215 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea712947-64c8-4832-add2-728efd8990f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:40.134506 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea712947-64c8-4832-add2-728efd8990f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:40.134751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea712947-64c8-4832-add2-728efd8990f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:40.135452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea712947-64c8-4832-add2-728efd8990f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:40.137365 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea712947-64c8-4832-add2-728efd8990f1 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:40.143244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b9d3c-97a2-4a4e-88d0-7fa0259d3f51 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:40.152854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4cb3a-72e5-442c-a7d2-b1a905a7adae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:40.156477 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4cb3a-72e5-442c-a7d2-b1a905a7adae admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:40.156876 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4cb3a-72e5-442c-a7d2-b1a905a7adae admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:40.157660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4cb3a-72e5-442c-a7d2-b1a905a7adae admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:40.159447 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4cb3a-72e5-442c-a7d2-b1a905a7adae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:40.162156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4cb3a-72e5-442c-a7d2-b1a905a7adae admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:40.178092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 749/1500] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:40 2022] POST /identity/v3/users => generated 292 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:40.179593 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea712947-64c8-4832-add2-728efd8990f1 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:40.181355 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-ea712947-64c8-4832-add2-728efd8990f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:40.193269 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:40.199462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:40.217700 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 752/1501] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:40 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:40.218983 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4cb3a-72e5-442c-a7d2-b1a905a7adae admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:40.293104 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea712947-64c8-4832-add2-728efd8990f1 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:40.307615 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4cb3a-72e5-442c-a7d2-b1a905a7adae admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:40.316113 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049952d4-cc78-4ac4-b2e4-bec0e7f30cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:40.316866 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049952d4-cc78-4ac4-b2e4-bec0e7f30cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:40.317412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049952d4-cc78-4ac4-b2e4-bec0e7f30cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:40.317783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049952d4-cc78-4ac4-b2e4-bec0e7f30cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:40.319449 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049952d4-cc78-4ac4-b2e4-bec0e7f30cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:40.321380 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049952d4-cc78-4ac4-b2e4-bec0e7f30cd0 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:40.338854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 753/1502] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:40.340969 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049952d4-cc78-4ac4-b2e4-bec0e7f30cd0 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:40.357172 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049952d4-cc78-4ac4-b2e4-bec0e7f30cd0 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:40.366486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f0056-d952-4f1f-8cfc-4bdab614e658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:40.368015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f0056-d952-4f1f-8cfc-4bdab614e658 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:40.368439 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f0056-d952-4f1f-8cfc-4bdab614e658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:40.369075 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f0056-d952-4f1f-8cfc-4bdab614e658 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:40.369805 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f0056-d952-4f1f-8cfc-4bdab614e658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:40.371664 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f0056-d952-4f1f-8cfc-4bdab614e658 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:40.388256 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 754/1503] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:40.389280 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f0056-d952-4f1f-8cfc-4bdab614e658 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:40.408843 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f0056-d952-4f1f-8cfc-4bdab614e658 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:40.427393 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ce43e-de1d-41b8-9e2a-6cbc406d4826 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:40.430077 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ce43e-de1d-41b8-9e2a-6cbc406d4826 service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:40.430562 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ce43e-de1d-41b8-9e2a-6cbc406d4826 service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:40.431001 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ce43e-de1d-41b8-9e2a-6cbc406d4826 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:40.431101 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60597006-dcd6-4b4d-a7ca-7c012eb4ef3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:40.431711 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60597006-dcd6-4b4d-a7ca-7c012eb4ef3f admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:40.431976 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60597006-dcd6-4b4d-a7ca-7c012eb4ef3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:40.432248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60597006-dcd6-4b4d-a7ca-7c012eb4ef3f admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:40.435046 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60597006-dcd6-4b4d-a7ca-7c012eb4ef3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:40.439238 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60597006-dcd6-4b4d-a7ca-7c012eb4ef3f admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:40.443527 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ce43e-de1d-41b8-9e2a-6cbc406d4826 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:40.446614 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ce43e-de1d-41b8-9e2a-6cbc406d4826 service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:40.478384 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 750/1504] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:40.482540 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ce43e-de1d-41b8-9e2a-6cbc406d4826 service nova] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:40.506013 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 755/1505] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:40 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:40.510334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60597006-dcd6-4b4d-a7ca-7c012eb4ef3f admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:40.512322 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ce43e-de1d-41b8-9e2a-6cbc406d4826 service nova] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:40.539346 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc935ec9-afb0-42e5-a765-29ecef8588b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:40.540138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc935ec9-afb0-42e5-a765-29ecef8588b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:40.540410 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc935ec9-afb0-42e5-a765-29ecef8588b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:40.540790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc935ec9-afb0-42e5-a765-29ecef8588b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:40.541446 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc935ec9-afb0-42e5-a765-29ecef8588b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:40.544325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc935ec9-afb0-42e5-a765-29ecef8588b9 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:40.546035 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60597006-dcd6-4b4d-a7ca-7c012eb4ef3f admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:40.568731 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 751/1506] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:40.570300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc935ec9-afb0-42e5-a765-29ecef8588b9 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:40.570890 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10459a8e-2b50-4641-9b9a-75b0ef91f0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:40.571629 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10459a8e-2b50-4641-9b9a-75b0ef91f0da admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:40.571913 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10459a8e-2b50-4641-9b9a-75b0ef91f0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:40.573456 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10459a8e-2b50-4641-9b9a-75b0ef91f0da admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:40.574285 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10459a8e-2b50-4641-9b9a-75b0ef91f0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:40.593251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc935ec9-afb0-42e5-a765-29ecef8588b9 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:40.595150 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10459a8e-2b50-4641-9b9a-75b0ef91f0da admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:40.606678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c9231-739a-43c9-8320-d4b1134df4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:40.608372 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c9231-739a-43c9-8320-d4b1134df4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:40.608768 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c9231-739a-43c9-8320-d4b1134df4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:40.610156 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c9231-739a-43c9-8320-d4b1134df4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:40.612221 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c9231-739a-43c9-8320-d4b1134df4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:40.614636 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c9231-739a-43c9-8320-d4b1134df4f0 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:40.633744 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 756/1507] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:40.634637 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10459a8e-2b50-4641-9b9a-75b0ef91f0da admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:40.646464 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10459a8e-2b50-4641-9b9a-75b0ef91f0da admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:40.652710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17208a21-c947-48fa-bd0f-f042b6618fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:40.653400 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17208a21-c947-48fa-bd0f-f042b6618fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:40.653508 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 752/1508] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:40.653800 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17208a21-c947-48fa-bd0f-f042b6618fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:40.654181 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17208a21-c947-48fa-bd0f-f042b6618fa1 admin admin] PATH_INFO: `/v3/projects/a25655f5e54240dd8b269a6038fbe0bd/users/2456dff0ed104405b5967cbdee2a42df/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:40.657554 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c9231-739a-43c9-8320-d4b1134df4f0 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:40.680418 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c9231-739a-43c9-8320-d4b1134df4f0 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:40.688213 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17208a21-c947-48fa-bd0f-f042b6618fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a25655f5e54240dd8b269a6038fbe0bd, user_id=2456dff0ed104405b5967cbdee2a42df, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:40.694210 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17208a21-c947-48fa-bd0f-f042b6618fa1 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:40.696578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2f012-552e-4779-abdc-81f8df32e9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:40.698136 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2f012-552e-4779-abdc-81f8df32e9a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:40.699297 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2f012-552e-4779-abdc-81f8df32e9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:40.700205 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2f012-552e-4779-abdc-81f8df32e9a0 admin admin] PATH_INFO: `/v3/projects/0568e857c0474a739de126a306571071/users/d7af9484b15a461e82f073e3c1912174/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:40.732323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 757/1509] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:40 2022] PUT /identity/v3/projects/a25655f5e54240dd8b269a6038fbe0bd/users/2456dff0ed104405b5967cbdee2a42df/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:40.732323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17208a21-c947-48fa-bd0f-f042b6618fa1 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:40.741934 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d2f012-552e-4779-abdc-81f8df32e9a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0568e857c0474a739de126a306571071, user_id=d7af9484b15a461e82f073e3c1912174, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:40.745270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d2f012-552e-4779-abdc-81f8df32e9a0 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:40.769222 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 753/1510] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:40 2022] PUT /identity/v3/projects/0568e857c0474a739de126a306571071/users/d7af9484b15a461e82f073e3c1912174/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:40.771080 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699678c-a725-4407-b9ff-575e1fa6282c None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:40.771454 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699678c-a725-4407-b9ff-575e1fa6282c None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:40.771814 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699678c-a725-4407-b9ff-575e1fa6282c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:40.841389 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-1699678c-a725-4407-b9ff-575e1fa6282c None None] MFA Rules not processed for user `2456dff0ed104405b5967cbdee2a42df`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:40.843554 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-1699678c-a725-4407-b9ff-575e1fa6282c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:40.856197 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17208a21-c947-48fa-bd0f-f042b6618fa1 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:40.903715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:40.944273 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:40.954463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 754/1511] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:40.961184 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef48d3-6379-4ddf-b74a-c46beae7d0e1 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:40.963206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef48d3-6379-4ddf-b74a-c46beae7d0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:40.963641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef48d3-6379-4ddf-b74a-c46beae7d0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:40.988840 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d291cf8-fea0-411a-8be7-0703af764ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:40.989470 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d291cf8-fea0-411a-8be7-0703af764ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:40.990007 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d291cf8-fea0-411a-8be7-0703af764ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:40.990351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d291cf8-fea0-411a-8be7-0703af764ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:40.991319 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d291cf8-fea0-411a-8be7-0703af764ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:40.993129 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d291cf8-fea0-411a-8be7-0703af764ea0 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:41.008770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-e4ef48d3-6379-4ddf-b74a-c46beae7d0e1 None None] MFA Rules not processed for user `d7af9484b15a461e82f073e3c1912174`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:41.012503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e4ef48d3-6379-4ddf-b74a-c46beae7d0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:41.013761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 758/1512] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:41.015762 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d291cf8-fea0-411a-8be7-0703af764ea0 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:41.030308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d291cf8-fea0-411a-8be7-0703af764ea0 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:41.036855 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d415aa4-ed3f-49bd-91c4-7d114be14339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:41.037775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d415aa4-ed3f-49bd-91c4-7d114be14339 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:41.038177 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d415aa4-ed3f-49bd-91c4-7d114be14339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:41.038552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d415aa4-ed3f-49bd-91c4-7d114be14339 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:41.039518 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d415aa4-ed3f-49bd-91c4-7d114be14339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:41.041870 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d415aa4-ed3f-49bd-91c4-7d114be14339 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:41.094604 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 759/1513] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:41 2022] POST /identity/v3/projects => generated 393 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:41.096408 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d415aa4-ed3f-49bd-91c4-7d114be14339 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:41.118397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 755/1514] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:41.119447 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef48d3-6379-4ddf-b74a-c46beae7d0e1 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:41.149541 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef48d3-6379-4ddf-b74a-c46beae7d0e1 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:41.209241 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d415aa4-ed3f-49bd-91c4-7d114be14339 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:41.215880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a8d69-92dd-472d-bed5-d9a2b3232148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:41.217162 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a8d69-92dd-472d-bed5-d9a2b3232148 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:41.217785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a8d69-92dd-472d-bed5-d9a2b3232148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:41.218291 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a8d69-92dd-472d-bed5-d9a2b3232148 admin admin] PATH_INFO: `/v3/projects/4b4e03113e824b6db67b7d664606995c/users/790bd3b918e64f9d943625a3418177e0/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:41.238442 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a8d69-92dd-472d-bed5-d9a2b3232148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b4e03113e824b6db67b7d664606995c, user_id=790bd3b918e64f9d943625a3418177e0, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:41.243713 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a8d69-92dd-472d-bed5-d9a2b3232148 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:41.260253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60cacb-595b-4edc-a63d-dde99b87fe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:41.261123 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60cacb-595b-4edc-a63d-dde99b87fe49 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:41.261398 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60cacb-595b-4edc-a63d-dde99b87fe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:41.261668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60cacb-595b-4edc-a63d-dde99b87fe49 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:41.263854 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60cacb-595b-4edc-a63d-dde99b87fe49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:41.265815 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60cacb-595b-4edc-a63d-dde99b87fe49 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:41.280983 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 760/1515] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:41 2022] PUT /identity/v3/projects/4b4e03113e824b6db67b7d664606995c/users/790bd3b918e64f9d943625a3418177e0/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:41.280983 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a8d69-92dd-472d-bed5-d9a2b3232148 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:41.303409 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 756/1516] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:41 2022] POST /identity/v3/users => generated 303 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:41.304537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60cacb-595b-4edc-a63d-dde99b87fe49 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:41.306292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-5c60cacb-595b-4edc-a63d-dde99b87fe49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:41.320140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60cacb-595b-4edc-a63d-dde99b87fe49 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:41.406040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8726cd-2dcd-4a8a-b44d-c63f5dcbacee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:41.407081 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8726cd-2dcd-4a8a-b44d-c63f5dcbacee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:41.407373 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8726cd-2dcd-4a8a-b44d-c63f5dcbacee admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:41.407654 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8726cd-2dcd-4a8a-b44d-c63f5dcbacee admin admin] PATH_INFO: `/v3/projects/5b4c3c166b5249ccac5551f39d9452a1` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:41.408991 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8726cd-2dcd-4a8a-b44d-c63f5dcbacee admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b4c3c166b5249ccac5551f39d9452a1)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:41.413363 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8726cd-2dcd-4a8a-b44d-c63f5dcbacee admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:41.415534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:41.446363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a8d69-92dd-472d-bed5-d9a2b3232148 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:41.463799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec96631-8f82-43ba-ab6a-60775e838992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:41.464848 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec96631-8f82-43ba-ab6a-60775e838992 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:41.465311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec96631-8f82-43ba-ab6a-60775e838992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:41.465815 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec96631-8f82-43ba-ab6a-60775e838992 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:41.466779 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec96631-8f82-43ba-ab6a-60775e838992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:41.469100 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec96631-8f82-43ba-ab6a-60775e838992 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:41.508677 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 761/1517] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:41 2022] POST /identity/v3/projects => generated 381 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:41.511578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf26ad-a8f3-4089-ac97-c0edcbb0abaa None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:41.512282 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf26ad-a8f3-4089-ac97-c0edcbb0abaa None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:41.512758 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf26ad-a8f3-4089-ac97-c0edcbb0abaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:41.520073 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-6c8726cd-2dcd-4a8a-b44d-c63f5dcbacee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b4c3c166b5249ccac5551f39d9452a1', 'request_id': 'req-6c8726cd-2dcd-4a8a-b44d-c63f5dcbacee'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:41.541961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-6c8726cd-2dcd-4a8a-b44d-c63f5dcbacee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b4c3c166b5249ccac5551f39d9452a1', 'request_id': 'req-6c8726cd-2dcd-4a8a-b44d-c63f5dcbacee'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:41.583337 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-6c8726cd-2dcd-4a8a-b44d-c63f5dcbacee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b4c3c166b5249ccac5551f39d9452a1', 'request_id': 'req-6c8726cd-2dcd-4a8a-b44d-c63f5dcbacee'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:41.588701 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-fbdf26ad-a8f3-4089-ac97-c0edcbb0abaa None None] MFA Rules not processed for user `790bd3b918e64f9d943625a3418177e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:41.590426 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-fbdf26ad-a8f3-4089-ac97-c0edcbb0abaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:41.601184 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:41.614859 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-6c8726cd-2dcd-4a8a-b44d-c63f5dcbacee admin admin] The token cache is being invalidate because project 5b4c3c166b5249ccac5551f39d9452a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:41.615256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-6c8726cd-2dcd-4a8a-b44d-c63f5dcbacee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:41.620024 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-6c8726cd-2dcd-4a8a-b44d-c63f5dcbacee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:41.625674 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 757/1518] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:41 2022] DELETE /identity/v3/projects/5b4c3c166b5249ccac5551f39d9452a1 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:41.625674 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8726cd-2dcd-4a8a-b44d-c63f5dcbacee admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:41.630863 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-6c8726cd-2dcd-4a8a-b44d-c63f5dcbacee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:41.702691 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 762/1519] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:41.703892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf26ad-a8f3-4089-ac97-c0edcbb0abaa None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:41.717102 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-fbdf26ad-a8f3-4089-ac97-c0edcbb0abaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:41.731884 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8726cd-2dcd-4a8a-b44d-c63f5dcbacee admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:41.812946 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf26ad-a8f3-4089-ac97-c0edcbb0abaa None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:41.817835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a3016-2efb-4e83-8780-680009db2a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:41.818698 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a3016-2efb-4e83-8780-680009db2a39 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:41.819616 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a3016-2efb-4e83-8780-680009db2a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:41.820214 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a3016-2efb-4e83-8780-680009db2a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:41.821240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a3016-2efb-4e83-8780-680009db2a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:41.828696 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a3016-2efb-4e83-8780-680009db2a39 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:41.841250 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dadcf8-8df8-47fd-965f-a7cfca9a76b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:41.844303 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dadcf8-8df8-47fd-965f-a7cfca9a76b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:41.844603 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dadcf8-8df8-47fd-965f-a7cfca9a76b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:41.844886 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dadcf8-8df8-47fd-965f-a7cfca9a76b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:41.846864 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dadcf8-8df8-47fd-965f-a7cfca9a76b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:41.851571 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 758/1520] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:41.852477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a3016-2efb-4e83-8780-680009db2a39 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:41.853437 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dadcf8-8df8-47fd-965f-a7cfca9a76b1 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:41.856939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-2d5a3016-2efb-4e83-8780-680009db2a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:41.888358 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a3016-2efb-4e83-8780-680009db2a39 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:41.898845 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bed61-55d6-4130-ae81-4a9c627ac8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:41.899552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bed61-55d6-4130-ae81-4a9c627ac8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:41.900127 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bed61-55d6-4130-ae81-4a9c627ac8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:41.901175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bed61-55d6-4130-ae81-4a9c627ac8b5 admin admin] PATH_INFO: `/v3/users/996287bae64848df9e62e3157f7484c4` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:41.903699 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bed61-55d6-4130-ae81-4a9c627ac8b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=996287bae64848df9e62e3157f7484c4)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:41.907349 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bed61-55d6-4130-ae81-4a9c627ac8b5 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:41.916476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 763/1521] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:41 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:41.918335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dadcf8-8df8-47fd-965f-a7cfca9a76b1 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:41.920409 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-05dadcf8-8df8-47fd-965f-a7cfca9a76b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:41.946028 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:41.974867 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-cc4bed61-55d6-4130-ae81-4a9c627ac8b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '996287bae64848df9e62e3157f7484c4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:41.983235 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-cc4bed61-55d6-4130-ae81-4a9c627ac8b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '996287bae64848df9e62e3157f7484c4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:41.984620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-cc4bed61-55d6-4130-ae81-4a9c627ac8b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '996287bae64848df9e62e3157f7484c4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:41.985503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-cc4bed61-55d6-4130-ae81-4a9c627ac8b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '996287bae64848df9e62e3157f7484c4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:41.996336 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-cc4bed61-55d6-4130-ae81-4a9c627ac8b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '996287bae64848df9e62e3157f7484c4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:42.001134 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dadcf8-8df8-47fd-965f-a7cfca9a76b1 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:42.005448 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623c77c-7ace-4a84-8bbe-bc8ff4af8ad8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:42.006102 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623c77c-7ace-4a84-8bbe-bc8ff4af8ad8 service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:42.006897 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623c77c-7ace-4a84-8bbe-bc8ff4af8ad8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:42.007183 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623c77c-7ace-4a84-8bbe-bc8ff4af8ad8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:42.009062 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-6623c77c-7ace-4a84-8bbe-bc8ff4af8ad8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:42.024244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623c77c-7ace-4a84-8bbe-bc8ff4af8ad8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:42.025715 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623c77c-7ace-4a84-8bbe-bc8ff4af8ad8 service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:42.036492 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 764/1522] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:42.037309 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623c77c-7ace-4a84-8bbe-bc8ff4af8ad8 service cinder] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:42.040212 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-6623c77c-7ace-4a84-8bbe-bc8ff4af8ad8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:42.051777 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 759/1523] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:41 2022] DELETE /identity/v3/users/996287bae64848df9e62e3157f7484c4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:42.052994 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bed61-55d6-4130-ae81-4a9c627ac8b5 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:42.055586 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-cc4bed61-55d6-4130-ae81-4a9c627ac8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:42.073752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623c77c-7ace-4a84-8bbe-bc8ff4af8ad8 service cinder] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:42.124179 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:42.207550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5409bc-b74f-4f2f-9609-c847e5507a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:42.210723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5409bc-b74f-4f2f-9609-c847e5507a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:42.211001 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5409bc-b74f-4f2f-9609-c847e5507a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:42.211271 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5409bc-b74f-4f2f-9609-c847e5507a2c admin admin] PATH_INFO: `/v3/projects/3f6d30a9f83e408eac72ac2c00644d94/users/fbe263bfd3cb4308b2663fd5988705c0/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:42.226877 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bed61-55d6-4130-ae81-4a9c627ac8b5 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:42.236270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa323c3f-a1a0-45a5-b759-7dfaf3b8dfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:42.236905 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa323c3f-a1a0-45a5-b759-7dfaf3b8dfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:42.237187 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa323c3f-a1a0-45a5-b759-7dfaf3b8dfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:42.237459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa323c3f-a1a0-45a5-b759-7dfaf3b8dfa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:42.238168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa323c3f-a1a0-45a5-b759-7dfaf3b8dfa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:42.239764 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa323c3f-a1a0-45a5-b759-7dfaf3b8dfa2 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:42.248619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5409bc-b74f-4f2f-9609-c847e5507a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f6d30a9f83e408eac72ac2c00644d94, user_id=fbe263bfd3cb4308b2663fd5988705c0, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:42.257474 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5409bc-b74f-4f2f-9609-c847e5507a2c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:42.277108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 760/1524] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:42.285545 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa323c3f-a1a0-45a5-b759-7dfaf3b8dfa2 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:42.286651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 765/1525] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:42 2022] PUT /identity/v3/projects/3f6d30a9f83e408eac72ac2c00644d94/users/fbe263bfd3cb4308b2663fd5988705c0/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:42.288294 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5409bc-b74f-4f2f-9609-c847e5507a2c admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:42.304673 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa323c3f-a1a0-45a5-b759-7dfaf3b8dfa2 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:42.431356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc6c37-0c52-42f3-992e-6f6ec6da6de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:42.434743 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc6c37-0c52-42f3-992e-6f6ec6da6de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:42.435064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc6c37-0c52-42f3-992e-6f6ec6da6de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:42.435412 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc6c37-0c52-42f3-992e-6f6ec6da6de0 admin admin] PATH_INFO: `/v3/projects/5ac14b64b1fc4ad7b1e819496545ef8e/users/9ac00b1e9ead4bd3b8cd64b09b1706ae/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:42.454365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5409bc-b74f-4f2f-9609-c847e5507a2c admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:42.461281 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993d276-edf5-4a42-8378-a44ff292bc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:42.471351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993d276-edf5-4a42-8378-a44ff292bc30 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:42.472321 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993d276-edf5-4a42-8378-a44ff292bc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:42.472604 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993d276-edf5-4a42-8378-a44ff292bc30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:42.476175 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993d276-edf5-4a42-8378-a44ff292bc30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:42.483038 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993d276-edf5-4a42-8378-a44ff292bc30 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:42.515741 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 766/1526] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:42.521386 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993d276-edf5-4a42-8378-a44ff292bc30 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:42.524043 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc6c37-0c52-42f3-992e-6f6ec6da6de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ac14b64b1fc4ad7b1e819496545ef8e, user_id=9ac00b1e9ead4bd3b8cd64b09b1706ae, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:42.526807 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc6c37-0c52-42f3-992e-6f6ec6da6de0 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:42.544605 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993d276-edf5-4a42-8378-a44ff292bc30 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:42.567836 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 761/1527] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:42 2022] PUT /identity/v3/projects/5ac14b64b1fc4ad7b1e819496545ef8e/users/9ac00b1e9ead4bd3b8cd64b09b1706ae/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:42.572484 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc6c37-0c52-42f3-992e-6f6ec6da6de0 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:42.641444 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:42.680932 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9478d8a-425c-41f6-97c6-068532b9a492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:42.681773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9478d8a-425c-41f6-97c6-068532b9a492 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:42.682180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9478d8a-425c-41f6-97c6-068532b9a492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:42.682552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9478d8a-425c-41f6-97c6-068532b9a492 admin admin] PATH_INFO: `/v3/projects/3f6d30a9f83e408eac72ac2c00644d94/users/fbe263bfd3cb4308b2663fd5988705c0/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:42.687617 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9478d8a-425c-41f6-97c6-068532b9a492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f6d30a9f83e408eac72ac2c00644d94, user_id=fbe263bfd3cb4308b2663fd5988705c0, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:42.692500 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9478d8a-425c-41f6-97c6-068532b9a492 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:42.708949 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc6c37-0c52-42f3-992e-6f6ec6da6de0 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:42.730099 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 767/1528] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:42 2022] PUT /identity/v3/projects/3f6d30a9f83e408eac72ac2c00644d94/users/fbe263bfd3cb4308b2663fd5988705c0/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:42.732734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e784a-7eac-4a11-9d45-c240f9f3648f None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:42.733014 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e784a-7eac-4a11-9d45-c240f9f3648f None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:42.734065 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e784a-7eac-4a11-9d45-c240f9f3648f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:42.797889 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-b90e784a-7eac-4a11-9d45-c240f9f3648f None None] MFA Rules not processed for user `fbe263bfd3cb4308b2663fd5988705c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:42.799114 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b90e784a-7eac-4a11-9d45-c240f9f3648f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:42.852720 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d23f68-f4a0-44a4-9c4e-469e500aae23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:42.853388 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d23f68-f4a0-44a4-9c4e-469e500aae23 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:42.853674 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d23f68-f4a0-44a4-9c4e-469e500aae23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:42.854005 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d23f68-f4a0-44a4-9c4e-469e500aae23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:42.854672 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d23f68-f4a0-44a4-9c4e-469e500aae23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:42.856295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d23f68-f4a0-44a4-9c4e-469e500aae23 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:42.885812 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 762/1529] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:42.890376 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d23f68-f4a0-44a4-9c4e-469e500aae23 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:42.890640 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:42.917224 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d23f68-f4a0-44a4-9c4e-469e500aae23 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:42.923055 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b5198-5c10-41d5-b12c-7e5e52d37148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:42.923874 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b5198-5c10-41d5-b12c-7e5e52d37148 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:42.924164 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b5198-5c10-41d5-b12c-7e5e52d37148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:42.924449 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b5198-5c10-41d5-b12c-7e5e52d37148 admin admin] PATH_INFO: `/v3/projects/5ac14b64b1fc4ad7b1e819496545ef8e/users/9ac00b1e9ead4bd3b8cd64b09b1706ae/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:42.926458 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b5198-5c10-41d5-b12c-7e5e52d37148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ac14b64b1fc4ad7b1e819496545ef8e, user_id=9ac00b1e9ead4bd3b8cd64b09b1706ae, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:42.929230 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b5198-5c10-41d5-b12c-7e5e52d37148 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:42.941332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 768/1530] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:42 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:42.945903 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 763/1531] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:42 2022] PUT /identity/v3/projects/5ac14b64b1fc4ad7b1e819496545ef8e/users/9ac00b1e9ead4bd3b8cd64b09b1706ae/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:42.953251 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e784a-7eac-4a11-9d45-c240f9f3648f None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:42.954887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b90e784a-7eac-4a11-9d45-c240f9f3648f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:42.955805 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ebec8-f80e-4380-816c-3e26deeb48ab None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:42.956158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ebec8-f80e-4380-816c-3e26deeb48ab None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:42.956497 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ebec8-f80e-4380-816c-3e26deeb48ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:42.992218 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-d38ebec8-f80e-4380-816c-3e26deeb48ab None None] MFA Rules not processed for user `9ac00b1e9ead4bd3b8cd64b09b1706ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:42.993781 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d38ebec8-f80e-4380-816c-3e26deeb48ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:43.031355 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e784a-7eac-4a11-9d45-c240f9f3648f None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:43.098042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b267c-3e45-4aa0-a7ed-7dedbe10ce2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:43.098672 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b267c-3e45-4aa0-a7ed-7dedbe10ce2a service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:43.098954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b267c-3e45-4aa0-a7ed-7dedbe10ce2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:43.099230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b267c-3e45-4aa0-a7ed-7dedbe10ce2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:43.137864 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 764/1532] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:43.150739 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ebec8-f80e-4380-816c-3e26deeb48ab None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:43.167452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d38ebec8-f80e-4380-816c-3e26deeb48ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:43.200387 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ebec8-f80e-4380-816c-3e26deeb48ab None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:43.206696 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2b60d-45fc-4711-b4b2-0aa9d5c62fd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:43.207627 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2b60d-45fc-4711-b4b2-0aa9d5c62fd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:43.207927 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2b60d-45fc-4711-b4b2-0aa9d5c62fd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:43.208481 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2b60d-45fc-4711-b4b2-0aa9d5c62fd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:43.233267 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b267c-3e45-4aa0-a7ed-7dedbe10ce2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:43.234450 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2b60d-45fc-4711-b4b2-0aa9d5c62fd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:43.235050 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b267c-3e45-4aa0-a7ed-7dedbe10ce2a service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:43.236171 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2b60d-45fc-4711-b4b2-0aa9d5c62fd1 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:43.251431 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 765/1533] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:41:43.263050 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 769/1534] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:42 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:43.302865 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2b60d-45fc-4711-b4b2-0aa9d5c62fd1 service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:43.304577 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-bae2b60d-45fc-4711-b4b2-0aa9d5c62fd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:43.365027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:43.381825 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b267c-3e45-4aa0-a7ed-7dedbe10ce2a service cinder] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:43.392737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b267c-3e45-4aa0-a7ed-7dedbe10ce2a service cinder] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:43.397514 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7473b7-defb-4167-8bae-575cd890faf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:43.399421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7473b7-defb-4167-8bae-575cd890faf7 service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:43.399726 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7473b7-defb-4167-8bae-575cd890faf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:43.399984 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7473b7-defb-4167-8bae-575cd890faf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:43.402111 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-9e7473b7-defb-4167-8bae-575cd890faf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:43.440964 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2b60d-45fc-4711-b4b2-0aa9d5c62fd1 service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:43.454962 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6ab98-55c5-449e-85f0-bacbce1fcf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:43.455795 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6ab98-55c5-449e-85f0-bacbce1fcf00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:43.456075 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6ab98-55c5-449e-85f0-bacbce1fcf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:43.456341 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6ab98-55c5-449e-85f0-bacbce1fcf00 admin admin] PATH_INFO: `/v3/projects/00f6291de4eb4d7986f6afb7747ca4b1` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:43.457984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6ab98-55c5-449e-85f0-bacbce1fcf00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00f6291de4eb4d7986f6afb7747ca4b1)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:43.460402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6ab98-55c5-449e-85f0-bacbce1fcf00 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:43.467171 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:43.492272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7473b7-defb-4167-8bae-575cd890faf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:43.493815 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7473b7-defb-4167-8bae-575cd890faf7 service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:43.504958 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 770/1535] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:43 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:41:43.505943 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7473b7-defb-4167-8bae-575cd890faf7 service cinder] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:43.514168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7473b7-defb-4167-8bae-575cd890faf7 service cinder] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:43.529675 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-19b6ab98-55c5-449e-85f0-bacbce1fcf00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00f6291de4eb4d7986f6afb7747ca4b1', 'request_id': 'req-19b6ab98-55c5-449e-85f0-bacbce1fcf00'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:43.543180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-19b6ab98-55c5-449e-85f0-bacbce1fcf00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00f6291de4eb4d7986f6afb7747ca4b1', 'request_id': 'req-19b6ab98-55c5-449e-85f0-bacbce1fcf00'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:43.563190 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-19b6ab98-55c5-449e-85f0-bacbce1fcf00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00f6291de4eb4d7986f6afb7747ca4b1', 'request_id': 'req-19b6ab98-55c5-449e-85f0-bacbce1fcf00'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:43.579998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4723f-b469-4420-9d01-3590bd5b59dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:43.581035 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4723f-b469-4420-9d01-3590bd5b59dc service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:43.581514 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4723f-b469-4420-9d01-3590bd5b59dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:43.582182 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4723f-b469-4420-9d01-3590bd5b59dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:43.582601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-19b6ab98-55c5-449e-85f0-bacbce1fcf00 admin admin] The token cache is being invalidate because project 00f6291de4eb4d7986f6afb7747ca4b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:43.582901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-19b6ab98-55c5-449e-85f0-bacbce1fcf00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:43.583565 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-19b6ab98-55c5-449e-85f0-bacbce1fcf00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:43.585010 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e6e4723f-b469-4420-9d01-3590bd5b59dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:43.585675 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 766/1536] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:43 2022] DELETE /identity/v3/projects/00f6291de4eb4d7986f6afb7747ca4b1 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:43.590154 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91755d7a-1148-4513-89b4-2450c12b1270 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:43.591091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91755d7a-1148-4513-89b4-2450c12b1270 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:43.591593 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91755d7a-1148-4513-89b4-2450c12b1270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:43.621874 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-91755d7a-1148-4513-89b4-2450c12b1270 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:43.623157 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-91755d7a-1148-4513-89b4-2450c12b1270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:43.673869 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4723f-b469-4420-9d01-3590bd5b59dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:43.676611 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4723f-b469-4420-9d01-3590bd5b59dc service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:43.688868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 771/1537] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:43.706230 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 767/1538] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:43.714784 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa1601-1deb-46ef-801d-7cdd2b67de04 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:43.715065 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa1601-1deb-46ef-801d-7cdd2b67de04 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:43.715339 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa1601-1deb-46ef-801d-7cdd2b67de04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:43.760335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-fcfa1601-1deb-46ef-801d-7cdd2b67de04 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:43.763155 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-fcfa1601-1deb-46ef-801d-7cdd2b67de04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:43.782175 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 772/1539] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:43.786631 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91755d7a-1148-4513-89b4-2450c12b1270 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:43.798689 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91755d7a-1148-4513-89b4-2450c12b1270 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:43.808256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49480ec-71b6-45a0-87d3-1cd5c21e40d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:43.809261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49480ec-71b6-45a0-87d3-1cd5c21e40d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:43.809744 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49480ec-71b6-45a0-87d3-1cd5c21e40d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:43.810272 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49480ec-71b6-45a0-87d3-1cd5c21e40d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:43.811409 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49480ec-71b6-45a0-87d3-1cd5c21e40d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:41:43.811900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49480ec-71b6-45a0-87d3-1cd5c21e40d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:43.814264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49480ec-71b6-45a0-87d3-1cd5c21e40d2 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:43.849214 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 768/1540] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:41:43.854655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa1601-1deb-46ef-801d-7cdd2b67de04 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:43.868285 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa1601-1deb-46ef-801d-7cdd2b67de04 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:43.874512 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d9bf2-1492-454e-922d-020b9ce5fa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:43.875362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d9bf2-1492-454e-922d-020b9ce5fa88 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:43.875874 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d9bf2-1492-454e-922d-020b9ce5fa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:43.876217 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d9bf2-1492-454e-922d-020b9ce5fa88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:43.876956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d9bf2-1492-454e-922d-020b9ce5fa88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:43.879638 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d9bf2-1492-454e-922d-020b9ce5fa88 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:43.945229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 773/1541] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:43 2022] POST /identity/v3/projects => generated 369 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:43.946514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49480ec-71b6-45a0-87d3-1cd5c21e40d2 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:43.962025 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49480ec-71b6-45a0-87d3-1cd5c21e40d2 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:44.056971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:44.097679 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfdf18-501a-4187-aca2-87cbeb3dc012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:44.098725 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfdf18-501a-4187-aca2-87cbeb3dc012 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:44.099219 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfdf18-501a-4187-aca2-87cbeb3dc012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:44.101222 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfdf18-501a-4187-aca2-87cbeb3dc012 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:44.103021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfdf18-501a-4187-aca2-87cbeb3dc012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:44.105120 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfdf18-501a-4187-aca2-87cbeb3dc012 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:44.134816 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 769/1542] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:43 2022] POST /identity/v3/users => generated 285 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:44.138809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d9bf2-1492-454e-922d-020b9ce5fa88 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:44.152646 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d9bf2-1492-454e-922d-020b9ce5fa88 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:44.160610 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df748d-d9b8-40ff-8aac-73e85be8082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:44.161385 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df748d-d9b8-40ff-8aac-73e85be8082a admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:44.161673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df748d-d9b8-40ff-8aac-73e85be8082a admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:44.161980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df748d-d9b8-40ff-8aac-73e85be8082a admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:44.169082 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df748d-d9b8-40ff-8aac-73e85be8082a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:44.169082 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df748d-d9b8-40ff-8aac-73e85be8082a admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:44.233322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 774/1543] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:44.237976 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfdf18-501a-4187-aca2-87cbeb3dc012 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:44.257137 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfdf18-501a-4187-aca2-87cbeb3dc012 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:44.271161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71be1f-c5e5-4b1e-a917-27bb5be65ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:44.272704 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71be1f-c5e5-4b1e-a917-27bb5be65ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:44.272996 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71be1f-c5e5-4b1e-a917-27bb5be65ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:44.273268 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71be1f-c5e5-4b1e-a917-27bb5be65ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:44.274085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71be1f-c5e5-4b1e-a917-27bb5be65ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:44.280483 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71be1f-c5e5-4b1e-a917-27bb5be65ca6 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:44.330864 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 770/1544] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:44.335925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df748d-d9b8-40ff-8aac-73e85be8082a admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:44.368889 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df748d-d9b8-40ff-8aac-73e85be8082a admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:44.379067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cbe39-8a68-451e-9111-8aea12ae898f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:44.380051 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cbe39-8a68-451e-9111-8aea12ae898f admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:44.380538 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cbe39-8a68-451e-9111-8aea12ae898f admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:44.383121 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cbe39-8a68-451e-9111-8aea12ae898f admin admin] PATH_INFO: `/v3/projects/db951956b1c64435a96c2b0acb163686/users/97ecf8fad13645fba69b0b80611ab494/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:44.403583 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cbe39-8a68-451e-9111-8aea12ae898f admin admin] RBAC: Authorizing `identity:create_grant(project_id=db951956b1c64435a96c2b0acb163686, user_id=97ecf8fad13645fba69b0b80611ab494, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:44.407490 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cbe39-8a68-451e-9111-8aea12ae898f admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:44.435794 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 775/1545] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:44 2022] PUT /identity/v3/projects/db951956b1c64435a96c2b0acb163686/users/97ecf8fad13645fba69b0b80611ab494/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:44.446806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dc617-5f63-4d8e-a11b-221711ce3d7a None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:44.447084 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dc617-5f63-4d8e-a11b-221711ce3d7a None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:44.447355 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dc617-5f63-4d8e-a11b-221711ce3d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:44.479768 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-db6dc617-5f63-4d8e-a11b-221711ce3d7a None None] MFA Rules not processed for user `97ecf8fad13645fba69b0b80611ab494`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:44.481111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-db6dc617-5f63-4d8e-a11b-221711ce3d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:44.562130 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 771/1546] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:41:44.572836 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cbe39-8a68-451e-9111-8aea12ae898f admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:44.613797 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:44.651284 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cbe39-8a68-451e-9111-8aea12ae898f admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:44.656699 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc04cf1-20e9-4e05-93ca-53c3e81c7759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:44.657379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc04cf1-20e9-4e05-93ca-53c3e81c7759 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:44.657577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc04cf1-20e9-4e05-93ca-53c3e81c7759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:44.657884 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc04cf1-20e9-4e05-93ca-53c3e81c7759 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:44.658581 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc04cf1-20e9-4e05-93ca-53c3e81c7759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:44.660626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc04cf1-20e9-4e05-93ca-53c3e81c7759 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:44.691209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 776/1547] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:44 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:44.696050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dc617-5f63-4d8e-a11b-221711ce3d7a None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:44.708043 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dc617-5f63-4d8e-a11b-221711ce3d7a None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:44.768304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513d4c0-5983-4ad1-b91b-e7d3550c8e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:44.768916 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513d4c0-5983-4ad1-b91b-e7d3550c8e21 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:44.769197 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513d4c0-5983-4ad1-b91b-e7d3550c8e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:44.769462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513d4c0-5983-4ad1-b91b-e7d3550c8e21 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:44.770404 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513d4c0-5983-4ad1-b91b-e7d3550c8e21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:44.772514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513d4c0-5983-4ad1-b91b-e7d3550c8e21 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:44.795615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 772/1548] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:44 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:41:44.799779 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc04cf1-20e9-4e05-93ca-53c3e81c7759 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:44.812510 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc04cf1-20e9-4e05-93ca-53c3e81c7759 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:44.817836 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ca9e4-ce36-44a3-8264-f5e80328e517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:44.818875 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ca9e4-ce36-44a3-8264-f5e80328e517 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:44.819454 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ca9e4-ce36-44a3-8264-f5e80328e517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:44.819454 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ca9e4-ce36-44a3-8264-f5e80328e517 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:44.820190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ca9e4-ce36-44a3-8264-f5e80328e517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:44.822095 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ca9e4-ce36-44a3-8264-f5e80328e517 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:44.834507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 777/1549] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:44.842295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513d4c0-5983-4ad1-b91b-e7d3550c8e21 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:44.858134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513d4c0-5983-4ad1-b91b-e7d3550c8e21 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:44.864066 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7c8fe-e6ca-407d-8dcd-a2ebdc30a09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:44.864765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7c8fe-e6ca-407d-8dcd-a2ebdc30a09e admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:44.865150 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7c8fe-e6ca-407d-8dcd-a2ebdc30a09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:44.867449 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7c8fe-e6ca-407d-8dcd-a2ebdc30a09e admin admin] PATH_INFO: `/v3/projects/15d30cc1d8e641f28ac5b4bd934b2ccd/users/6a415574f6654630ba926567cd207520/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:44.890441 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7c8fe-e6ca-407d-8dcd-a2ebdc30a09e admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d30cc1d8e641f28ac5b4bd934b2ccd, user_id=6a415574f6654630ba926567cd207520, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:44.894008 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7c8fe-e6ca-407d-8dcd-a2ebdc30a09e admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:44.921982 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 773/1550] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:44 2022] PUT /identity/v3/projects/15d30cc1d8e641f28ac5b4bd934b2ccd/users/6a415574f6654630ba926567cd207520/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:44.926922 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ca9e4-ce36-44a3-8264-f5e80328e517 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:44.941461 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ca9e4-ce36-44a3-8264-f5e80328e517 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:45.023287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd6e8d-84b4-46ca-8b43-7bb266fbad59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:45.023927 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd6e8d-84b4-46ca-8b43-7bb266fbad59 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:45.024212 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd6e8d-84b4-46ca-8b43-7bb266fbad59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:45.024488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd6e8d-84b4-46ca-8b43-7bb266fbad59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:45.025133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd6e8d-84b4-46ca-8b43-7bb266fbad59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:45.026827 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd6e8d-84b4-46ca-8b43-7bb266fbad59 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:45.040092 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 778/1551] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:45.043527 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7c8fe-e6ca-407d-8dcd-a2ebdc30a09e admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:45.061879 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7c8fe-e6ca-407d-8dcd-a2ebdc30a09e admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:45.069393 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b4444-a8da-4ce9-a5cd-c9f1bd1c5669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:45.070118 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b4444-a8da-4ce9-a5cd-c9f1bd1c5669 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:45.070402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b4444-a8da-4ce9-a5cd-c9f1bd1c5669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:45.070680 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b4444-a8da-4ce9-a5cd-c9f1bd1c5669 admin admin] PATH_INFO: `/v3/projects/15d30cc1d8e641f28ac5b4bd934b2ccd/users/6a415574f6654630ba926567cd207520/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:45.072636 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b4444-a8da-4ce9-a5cd-c9f1bd1c5669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d30cc1d8e641f28ac5b4bd934b2ccd, user_id=6a415574f6654630ba926567cd207520, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:45.075732 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b4444-a8da-4ce9-a5cd-c9f1bd1c5669 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:45.102818 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 774/1552] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:45 2022] PUT /identity/v3/projects/15d30cc1d8e641f28ac5b4bd934b2ccd/users/6a415574f6654630ba926567cd207520/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:45.116255 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d277b-f930-4efc-b8f5-ec16fafac24e None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:45.116255 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d277b-f930-4efc-b8f5-ec16fafac24e None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:45.116970 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d277b-f930-4efc-b8f5-ec16fafac24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:45.156765 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-0d5d277b-f930-4efc-b8f5-ec16fafac24e None None] MFA Rules not processed for user `6a415574f6654630ba926567cd207520`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:45.158066 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-0d5d277b-f930-4efc-b8f5-ec16fafac24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:45.253978 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 779/1553] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:45.291775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b4444-a8da-4ce9-a5cd-c9f1bd1c5669 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:45.294230 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-3d8b4444-a8da-4ce9-a5cd-c9f1bd1c5669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:45.305370 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:45.367694 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b4444-a8da-4ce9-a5cd-c9f1bd1c5669 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:45.371799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cae50-cd3c-4e2e-9b2f-25bdc6b9bb4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:45.372623 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cae50-cd3c-4e2e-9b2f-25bdc6b9bb4a service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:45.373467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cae50-cd3c-4e2e-9b2f-25bdc6b9bb4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:45.373748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cae50-cd3c-4e2e-9b2f-25bdc6b9bb4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:45.384091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cae50-cd3c-4e2e-9b2f-25bdc6b9bb4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:45.385566 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cae50-cd3c-4e2e-9b2f-25bdc6b9bb4a service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:45.396892 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 775/1554] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:45.480479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d277b-f930-4efc-b8f5-ec16fafac24e None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:45.481952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-0d5d277b-f930-4efc-b8f5-ec16fafac24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:45.532683 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:45.586266 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d277b-f930-4efc-b8f5-ec16fafac24e None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:45.592667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c3b82-79f4-4f28-bff8-b7769474c793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:45.593093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c3b82-79f4-4f28-bff8-b7769474c793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:45.593374 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c3b82-79f4-4f28-bff8-b7769474c793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:45.593707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c3b82-79f4-4f28-bff8-b7769474c793 admin admin] PATH_INFO: `/v3/users/790bd3b918e64f9d943625a3418177e0` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:45.595037 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c3b82-79f4-4f28-bff8-b7769474c793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=790bd3b918e64f9d943625a3418177e0)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:45.597011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c3b82-79f4-4f28-bff8-b7769474c793 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:45.660768 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cae50-cd3c-4e2e-9b2f-25bdc6b9bb4a service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:45.663870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a62cae50-cd3c-4e2e-9b2f-25bdc6b9bb4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:45.668114 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-186c3b82-79f4-4f28-bff8-b7769474c793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '790bd3b918e64f9d943625a3418177e0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:45.679704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-186c3b82-79f4-4f28-bff8-b7769474c793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '790bd3b918e64f9d943625a3418177e0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:45.680712 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cae50-cd3c-4e2e-9b2f-25bdc6b9bb4a service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:45.686049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e107211-3bb9-4181-a683-c1884c72b168 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:45.686773 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e107211-3bb9-4181-a683-c1884c72b168 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:45.687059 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e107211-3bb9-4181-a683-c1884c72b168 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:45.687335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e107211-3bb9-4181-a683-c1884c72b168 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:45.704385 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-186c3b82-79f4-4f28-bff8-b7769474c793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '790bd3b918e64f9d943625a3418177e0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:45.706036 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-186c3b82-79f4-4f28-bff8-b7769474c793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '790bd3b918e64f9d943625a3418177e0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:45.720409 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-186c3b82-79f4-4f28-bff8-b7769474c793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '790bd3b918e64f9d943625a3418177e0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:45.730080 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 780/1555] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:45 2022] DELETE /identity/v3/users/790bd3b918e64f9d943625a3418177e0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:45.734959 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fcad1-6106-47b7-a629-813e18aa53e2 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:45.735557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fcad1-6106-47b7-a629-813e18aa53e2 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:45.736028 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fcad1-6106-47b7-a629-813e18aa53e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:45.765426 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-b08fcad1-6106-47b7-a629-813e18aa53e2 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:45.766450 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e107211-3bb9-4181-a683-c1884c72b168 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:45.767440 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b08fcad1-6106-47b7-a629-813e18aa53e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:45.768514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e107211-3bb9-4181-a683-c1884c72b168 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:45.780830 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 776/1556] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:45.876116 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 781/1557] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:45.888524 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e107211-3bb9-4181-a683-c1884c72b168 service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:45.891595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-1e107211-3bb9-4181-a683-c1884c72b168 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:45.987139 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e107211-3bb9-4181-a683-c1884c72b168 service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:46.068312 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a2826-c2ba-4a5b-bd20-139106d000e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:46.069264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a2826-c2ba-4a5b-bd20-139106d000e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:46.069682 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a2826-c2ba-4a5b-bd20-139106d000e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:46.070747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a2826-c2ba-4a5b-bd20-139106d000e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:46.085090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a2826-c2ba-4a5b-bd20-139106d000e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:46.086944 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a2826-c2ba-4a5b-bd20-139106d000e4 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:46.103136 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 777/1558] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:46.567848 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fcad1-6106-47b7-a629-813e18aa53e2 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:46.570861 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b08fcad1-6106-47b7-a629-813e18aa53e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:46.592691 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fcad1-6106-47b7-a629-813e18aa53e2 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:46.607804 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f12477-d7f2-4b77-bd95-82b26cc53145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:46.608574 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f12477-d7f2-4b77-bd95-82b26cc53145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:46.608859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f12477-d7f2-4b77-bd95-82b26cc53145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:46.609246 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f12477-d7f2-4b77-bd95-82b26cc53145 admin admin] PATH_INFO: `/v3/projects/4b4e03113e824b6db67b7d664606995c` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:46.611135 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f12477-d7f2-4b77-bd95-82b26cc53145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b4e03113e824b6db67b7d664606995c)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:46.613079 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f12477-d7f2-4b77-bd95-82b26cc53145 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:46.715888 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:46.725536 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-27f12477-d7f2-4b77-bd95-82b26cc53145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b4e03113e824b6db67b7d664606995c', 'request_id': 'req-27f12477-d7f2-4b77-bd95-82b26cc53145'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:46.734599 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-27f12477-d7f2-4b77-bd95-82b26cc53145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b4e03113e824b6db67b7d664606995c', 'request_id': 'req-27f12477-d7f2-4b77-bd95-82b26cc53145'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:46.751445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-27f12477-d7f2-4b77-bd95-82b26cc53145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b4e03113e824b6db67b7d664606995c', 'request_id': 'req-27f12477-d7f2-4b77-bd95-82b26cc53145'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:46.767904 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-27f12477-d7f2-4b77-bd95-82b26cc53145 admin admin] The token cache is being invalidate because project 4b4e03113e824b6db67b7d664606995c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:46.768440 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-27f12477-d7f2-4b77-bd95-82b26cc53145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:46.769402 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-27f12477-d7f2-4b77-bd95-82b26cc53145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:46.787910 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 782/1559] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:46 2022] DELETE /identity/v3/projects/4b4e03113e824b6db67b7d664606995c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:46.792998 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b023391-f5f0-44ff-921e-bc86482e6b71 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:46.793882 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b023391-f5f0-44ff-921e-bc86482e6b71 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:46.794341 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b023391-f5f0-44ff-921e-bc86482e6b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:46.822883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:46.846861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-1b023391-f5f0-44ff-921e-bc86482e6b71 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:46.848103 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-1b023391-f5f0-44ff-921e-bc86482e6b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:46.937641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 778/1560] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:46.947317 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf8f78-bdad-41b7-b458-5d3d825a4a19 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:46.947606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf8f78-bdad-41b7-b458-5d3d825a4a19 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:46.947887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf8f78-bdad-41b7-b458-5d3d825a4a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:46.970536 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-80bf8f78-bdad-41b7-b458-5d3d825a4a19 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:46.971758 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-80bf8f78-bdad-41b7-b458-5d3d825a4a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:46.981005 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 783/1561] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:46.986553 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b023391-f5f0-44ff-921e-bc86482e6b71 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:47.000307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b023391-f5f0-44ff-921e-bc86482e6b71 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:47.006519 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccfe0c3-ed17-40f6-afaa-fe2ea9e57a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:47.007254 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfe0c3-ed17-40f6-afaa-fe2ea9e57a8c admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:47.007534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfe0c3-ed17-40f6-afaa-fe2ea9e57a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:47.007846 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfe0c3-ed17-40f6-afaa-fe2ea9e57a8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:47.009437 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccfe0c3-ed17-40f6-afaa-fe2ea9e57a8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:41:47.009437 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccfe0c3-ed17-40f6-afaa-fe2ea9e57a8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:47.010674 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccfe0c3-ed17-40f6-afaa-fe2ea9e57a8c admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:47.025878 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 779/1562] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:41:47.029651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf8f78-bdad-41b7-b458-5d3d825a4a19 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:47.040373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf8f78-bdad-41b7-b458-5d3d825a4a19 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:47.047900 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c32b89-316d-416e-9ffc-b3cdf0ef9b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:47.049186 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c32b89-316d-416e-9ffc-b3cdf0ef9b88 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:47.049186 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c32b89-316d-416e-9ffc-b3cdf0ef9b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:47.049186 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c32b89-316d-416e-9ffc-b3cdf0ef9b88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:47.049684 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c32b89-316d-416e-9ffc-b3cdf0ef9b88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:47.051655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c32b89-316d-416e-9ffc-b3cdf0ef9b88 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:47.083665 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 784/1563] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:47 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:47.088572 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccfe0c3-ed17-40f6-afaa-fe2ea9e57a8c admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:47.098957 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccfe0c3-ed17-40f6-afaa-fe2ea9e57a8c admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:47.169332 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff503d-1e74-440f-a231-afa368ef89d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:47.170159 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff503d-1e74-440f-a231-afa368ef89d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:47.170895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff503d-1e74-440f-a231-afa368ef89d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:47.170895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff503d-1e74-440f-a231-afa368ef89d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:47.171638 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff503d-1e74-440f-a231-afa368ef89d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:47.173704 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff503d-1e74-440f-a231-afa368ef89d0 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:47.197687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 780/1564] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:47 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:41:47.201970 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c32b89-316d-416e-9ffc-b3cdf0ef9b88 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:47.214375 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c32b89-316d-416e-9ffc-b3cdf0ef9b88 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:47.219745 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07dcce2-4630-4277-a088-a7a882c1f9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:47.220626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07dcce2-4630-4277-a088-a7a882c1f9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:47.220747 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07dcce2-4630-4277-a088-a7a882c1f9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:47.221070 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07dcce2-4630-4277-a088-a7a882c1f9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:47.221804 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07dcce2-4630-4277-a088-a7a882c1f9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:47.223927 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07dcce2-4630-4277-a088-a7a882c1f9f5 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:47.237982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 785/1565] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:47.239161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff503d-1e74-440f-a231-afa368ef89d0 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:47.251002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff503d-1e74-440f-a231-afa368ef89d0 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:47.261876 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489e308-81f0-4a12-a946-780945269985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:47.261876 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489e308-81f0-4a12-a946-780945269985 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:47.261876 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489e308-81f0-4a12-a946-780945269985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:47.261876 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489e308-81f0-4a12-a946-780945269985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:47.262392 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489e308-81f0-4a12-a946-780945269985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:47.262392 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489e308-81f0-4a12-a946-780945269985 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:47.275481 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 781/1566] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:47.279353 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07dcce2-4630-4277-a088-a7a882c1f9f5 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:47.290250 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07dcce2-4630-4277-a088-a7a882c1f9f5 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:47.295503 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638bb8b-576a-4f8b-ba39-b6f41ea9e11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:47.296170 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638bb8b-576a-4f8b-ba39-b6f41ea9e11e admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:47.296444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638bb8b-576a-4f8b-ba39-b6f41ea9e11e admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:47.296710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638bb8b-576a-4f8b-ba39-b6f41ea9e11e admin admin] PATH_INFO: `/v3/projects/3706993deb3b4e968f985320241638b3/users/a5c371fd287d4df7a3825fd3c0d779ce/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:47.312185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638bb8b-576a-4f8b-ba39-b6f41ea9e11e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3706993deb3b4e968f985320241638b3, user_id=a5c371fd287d4df7a3825fd3c0d779ce, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:47.315048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638bb8b-576a-4f8b-ba39-b6f41ea9e11e admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:47.331942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 786/1567] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:47 2022] PUT /identity/v3/projects/3706993deb3b4e968f985320241638b3/users/a5c371fd287d4df7a3825fd3c0d779ce/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:47.343442 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45f6f4-f554-48ac-8fc8-70347cdcd173 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:47.343783 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45f6f4-f554-48ac-8fc8-70347cdcd173 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:47.344146 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45f6f4-f554-48ac-8fc8-70347cdcd173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:47.373955 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-5e45f6f4-f554-48ac-8fc8-70347cdcd173 None None] MFA Rules not processed for user `a5c371fd287d4df7a3825fd3c0d779ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:47.375188 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-5e45f6f4-f554-48ac-8fc8-70347cdcd173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:47.445080 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:47.449505 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 782/1568] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:47.461756 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638bb8b-576a-4f8b-ba39-b6f41ea9e11e admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:47.463661 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-8638bb8b-576a-4f8b-ba39-b6f41ea9e11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:47.563994 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45f6f4-f554-48ac-8fc8-70347cdcd173 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:47.565881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-5e45f6f4-f554-48ac-8fc8-70347cdcd173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:47.576584 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638bb8b-576a-4f8b-ba39-b6f41ea9e11e admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:47.581907 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e56f9-7a79-4c4e-9818-cc8916933cf3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '077f50ca034b4d12817543377815393b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:47.582548 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e56f9-7a79-4c4e-9818-cc8916933cf3 service glance] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:47.582851 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e56f9-7a79-4c4e-9818-cc8916933cf3 service glance] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:47.583545 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e56f9-7a79-4c4e-9818-cc8916933cf3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:47.614884 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e56f9-7a79-4c4e-9818-cc8916933cf3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:47.617352 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e56f9-7a79-4c4e-9818-cc8916933cf3 service glance] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:47.637291 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 787/1569] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:47.668542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45f6f4-f554-48ac-8fc8-70347cdcd173 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:47.673552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef636ab7-f1ec-422d-85b0-1ab310e9a9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:47.674318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef636ab7-f1ec-422d-85b0-1ab310e9a9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:47.674675 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef636ab7-f1ec-422d-85b0-1ab310e9a9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:47.675723 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef636ab7-f1ec-422d-85b0-1ab310e9a9f2 admin admin] PATH_INFO: `/v3/users/d7af9484b15a461e82f073e3c1912174` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:47.676256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef636ab7-f1ec-422d-85b0-1ab310e9a9f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7af9484b15a461e82f073e3c1912174)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:47.678976 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef636ab7-f1ec-422d-85b0-1ab310e9a9f2 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:47.742953 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ef636ab7-f1ec-422d-85b0-1ab310e9a9f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7af9484b15a461e82f073e3c1912174'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:47.754161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ef636ab7-f1ec-422d-85b0-1ab310e9a9f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7af9484b15a461e82f073e3c1912174'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:47.755030 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ef636ab7-f1ec-422d-85b0-1ab310e9a9f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7af9484b15a461e82f073e3c1912174'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:47.755685 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ef636ab7-f1ec-422d-85b0-1ab310e9a9f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7af9484b15a461e82f073e3c1912174'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:47.767710 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ef636ab7-f1ec-422d-85b0-1ab310e9a9f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7af9484b15a461e82f073e3c1912174'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:47.804677 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 783/1570] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:47 2022] DELETE /identity/v3/users/d7af9484b15a461e82f073e3c1912174 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:47.811120 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947d3f4-0deb-4423-9c26-36f51c3e8338 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:47.811684 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947d3f4-0deb-4423-9c26-36f51c3e8338 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:47.812269 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947d3f4-0deb-4423-9c26-36f51c3e8338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:47.838535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-8947d3f4-0deb-4423-9c26-36f51c3e8338 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:47.840065 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-8947d3f4-0deb-4423-9c26-36f51c3e8338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:47.909886 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:47.940743 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 788/1571] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:47.951252 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef636ab7-f1ec-422d-85b0-1ab310e9a9f2 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:47.952707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-ef636ab7-f1ec-422d-85b0-1ab310e9a9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:48.085174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef636ab7-f1ec-422d-85b0-1ab310e9a9f2 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:48.092981 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8082e4-facd-4fef-8b01-06153ff6ddee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:48.099200 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8082e4-facd-4fef-8b01-06153ff6ddee service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:48.100382 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8082e4-facd-4fef-8b01-06153ff6ddee service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:48.101123 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8082e4-facd-4fef-8b01-06153ff6ddee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:48.121016 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8082e4-facd-4fef-8b01-06153ff6ddee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:48.123998 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8082e4-facd-4fef-8b01-06153ff6ddee service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:48.139481 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 784/1572] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:48.509306 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947d3f4-0deb-4423-9c26-36f51c3e8338 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:48.511447 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-8947d3f4-0deb-4423-9c26-36f51c3e8338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:48.531432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947d3f4-0deb-4423-9c26-36f51c3e8338 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:48.544380 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56658bbd-7d3d-4e09-a3b9-9c280a2b5322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:48.545188 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56658bbd-7d3d-4e09-a3b9-9c280a2b5322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:48.545370 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56658bbd-7d3d-4e09-a3b9-9c280a2b5322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:48.545682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56658bbd-7d3d-4e09-a3b9-9c280a2b5322 admin admin] PATH_INFO: `/v3/users/2456dff0ed104405b5967cbdee2a42df` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:48.548096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56658bbd-7d3d-4e09-a3b9-9c280a2b5322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2456dff0ed104405b5967cbdee2a42df)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:48.550879 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56658bbd-7d3d-4e09-a3b9-9c280a2b5322 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:48.625431 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-56658bbd-7d3d-4e09-a3b9-9c280a2b5322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2456dff0ed104405b5967cbdee2a42df'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:48.633318 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-56658bbd-7d3d-4e09-a3b9-9c280a2b5322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2456dff0ed104405b5967cbdee2a42df'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:48.649033 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-56658bbd-7d3d-4e09-a3b9-9c280a2b5322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2456dff0ed104405b5967cbdee2a42df'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:48.650330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-56658bbd-7d3d-4e09-a3b9-9c280a2b5322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2456dff0ed104405b5967cbdee2a42df'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:48.661588 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-56658bbd-7d3d-4e09-a3b9-9c280a2b5322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2456dff0ed104405b5967cbdee2a42df'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:48.672786 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 789/1573] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:48 2022] DELETE /identity/v3/users/2456dff0ed104405b5967cbdee2a42df => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:41:48.677052 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9ba1a-e3f1-48f0-96bc-7d6f11bda1b4 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:48.677344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9ba1a-e3f1-48f0-96bc-7d6f11bda1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:48.677701 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9ba1a-e3f1-48f0-96bc-7d6f11bda1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:48.714762 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-30c9ba1a-e3f1-48f0-96bc-7d6f11bda1b4 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:48.716645 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-30c9ba1a-e3f1-48f0-96bc-7d6f11bda1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:48.736855 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:48.957124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 785/1574] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:48.974434 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56658bbd-7d3d-4e09-a3b9-9c280a2b5322 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:48.976246 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-56658bbd-7d3d-4e09-a3b9-9c280a2b5322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:49.055162 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56658bbd-7d3d-4e09-a3b9-9c280a2b5322 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:49.063246 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b0fd2-1400-410b-b62c-e09463bd8c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:49.064219 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b0fd2-1400-410b-b62c-e09463bd8c22 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:49.064660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b0fd2-1400-410b-b62c-e09463bd8c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:49.065590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b0fd2-1400-410b-b62c-e09463bd8c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:49.077559 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b0fd2-1400-410b-b62c-e09463bd8c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:49.079103 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b0fd2-1400-410b-b62c-e09463bd8c22 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:49.094862 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 790/1575] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:49.145884 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9ba1a-e3f1-48f0-96bc-7d6f11bda1b4 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:49.157171 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-30c9ba1a-e3f1-48f0-96bc-7d6f11bda1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:49.192819 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9ba1a-e3f1-48f0-96bc-7d6f11bda1b4 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:49.210694 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f6cd1-b164-4ee0-b80f-625a7d68ffa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:49.211237 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f6cd1-b164-4ee0-b80f-625a7d68ffa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:49.211643 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f6cd1-b164-4ee0-b80f-625a7d68ffa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:49.211895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f6cd1-b164-4ee0-b80f-625a7d68ffa4 admin admin] PATH_INFO: `/v3/projects/0568e857c0474a739de126a306571071` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:49.213315 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f6cd1-b164-4ee0-b80f-625a7d68ffa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0568e857c0474a739de126a306571071)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:49.217039 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f6cd1-b164-4ee0-b80f-625a7d68ffa4 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:49.399238 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-193f6cd1-b164-4ee0-b80f-625a7d68ffa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0568e857c0474a739de126a306571071', 'request_id': 'req-193f6cd1-b164-4ee0-b80f-625a7d68ffa4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:49.427059 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-193f6cd1-b164-4ee0-b80f-625a7d68ffa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0568e857c0474a739de126a306571071', 'request_id': 'req-193f6cd1-b164-4ee0-b80f-625a7d68ffa4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:49.436184 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-193f6cd1-b164-4ee0-b80f-625a7d68ffa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0568e857c0474a739de126a306571071', 'request_id': 'req-193f6cd1-b164-4ee0-b80f-625a7d68ffa4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:49.452428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-193f6cd1-b164-4ee0-b80f-625a7d68ffa4 admin admin] The token cache is being invalidate because project 0568e857c0474a739de126a306571071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:49.452730 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-193f6cd1-b164-4ee0-b80f-625a7d68ffa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:49.453382 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-193f6cd1-b164-4ee0-b80f-625a7d68ffa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:49.454931 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 786/1576] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:49 2022] DELETE /identity/v3/projects/0568e857c0474a739de126a306571071 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:49.459180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b0fd2-1400-410b-b62c-e09463bd8c22 service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:49.469637 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b0fd2-1400-410b-b62c-e09463bd8c22 service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:49.640682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707466f-d505-4a6f-a78d-b2d0719611d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:49.641436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707466f-d505-4a6f-a78d-b2d0719611d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:49.641686 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707466f-d505-4a6f-a78d-b2d0719611d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:49.642293 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707466f-d505-4a6f-a78d-b2d0719611d1 admin admin] PATH_INFO: `/v3/users/9ac00b1e9ead4bd3b8cd64b09b1706ae` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:49.643844 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707466f-d505-4a6f-a78d-b2d0719611d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ac00b1e9ead4bd3b8cd64b09b1706ae)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:49.650100 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707466f-d505-4a6f-a78d-b2d0719611d1 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:49.656332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:49.737726 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b707466f-d505-4a6f-a78d-b2d0719611d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ac00b1e9ead4bd3b8cd64b09b1706ae'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:49.752087 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b707466f-d505-4a6f-a78d-b2d0719611d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ac00b1e9ead4bd3b8cd64b09b1706ae'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:49.778808 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b707466f-d505-4a6f-a78d-b2d0719611d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ac00b1e9ead4bd3b8cd64b09b1706ae'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:49.782460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b707466f-d505-4a6f-a78d-b2d0719611d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ac00b1e9ead4bd3b8cd64b09b1706ae'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:49.797665 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b707466f-d505-4a6f-a78d-b2d0719611d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ac00b1e9ead4bd3b8cd64b09b1706ae'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:49.819105 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 791/1577] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:49 2022] DELETE /identity/v3/users/9ac00b1e9ead4bd3b8cd64b09b1706ae => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:50.214092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f6cd1-b164-4ee0-b80f-625a7d68ffa4 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:50.216319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-193f6cd1-b164-4ee0-b80f-625a7d68ffa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:50.232026 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707466f-d505-4a6f-a78d-b2d0719611d1 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:50.233695 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b707466f-d505-4a6f-a78d-b2d0719611d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:50.259702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f6cd1-b164-4ee0-b80f-625a7d68ffa4 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:50.386785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707466f-d505-4a6f-a78d-b2d0719611d1 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:50.392873 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbf4ab-6e60-42d0-a2f2-062e09f95858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:50.393541 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbf4ab-6e60-42d0-a2f2-062e09f95858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:50.393823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbf4ab-6e60-42d0-a2f2-062e09f95858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:50.394119 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbf4ab-6e60-42d0-a2f2-062e09f95858 admin admin] PATH_INFO: `/v3/users/97ecf8fad13645fba69b0b80611ab494` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:50.395596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbf4ab-6e60-42d0-a2f2-062e09f95858 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ecf8fad13645fba69b0b80611ab494)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:50.399309 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbf4ab-6e60-42d0-a2f2-062e09f95858 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:50.404528 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e279e9-1263-4975-9687-cc9b8b2d93dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:50.405317 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e279e9-1263-4975-9687-cc9b8b2d93dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:50.406168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e279e9-1263-4975-9687-cc9b8b2d93dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:50.408462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e279e9-1263-4975-9687-cc9b8b2d93dc admin admin] PATH_INFO: `/v3/projects/a25655f5e54240dd8b269a6038fbe0bd` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:50.411591 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e279e9-1263-4975-9687-cc9b8b2d93dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a25655f5e54240dd8b269a6038fbe0bd)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:50.414702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e279e9-1263-4975-9687-cc9b8b2d93dc admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:50.508839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-82cbf4ab-6e60-42d0-a2f2-062e09f95858 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ecf8fad13645fba69b0b80611ab494'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:50.524034 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-82cbf4ab-6e60-42d0-a2f2-062e09f95858 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ecf8fad13645fba69b0b80611ab494'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:50.525135 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:50.526776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-19e279e9-1263-4975-9687-cc9b8b2d93dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a25655f5e54240dd8b269a6038fbe0bd', 'request_id': 'req-19e279e9-1263-4975-9687-cc9b8b2d93dc'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:50.544458 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-19e279e9-1263-4975-9687-cc9b8b2d93dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a25655f5e54240dd8b269a6038fbe0bd', 'request_id': 'req-19e279e9-1263-4975-9687-cc9b8b2d93dc'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:50.551412 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-19e279e9-1263-4975-9687-cc9b8b2d93dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a25655f5e54240dd8b269a6038fbe0bd', 'request_id': 'req-19e279e9-1263-4975-9687-cc9b8b2d93dc'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:50.554265 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-82cbf4ab-6e60-42d0-a2f2-062e09f95858 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ecf8fad13645fba69b0b80611ab494'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:50.555220 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-82cbf4ab-6e60-42d0-a2f2-062e09f95858 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ecf8fad13645fba69b0b80611ab494'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:50.566302 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-82cbf4ab-6e60-42d0-a2f2-062e09f95858 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ecf8fad13645fba69b0b80611ab494'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:50.572410 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-19e279e9-1263-4975-9687-cc9b8b2d93dc admin admin] The token cache is being invalidate because project a25655f5e54240dd8b269a6038fbe0bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:50.572695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-19e279e9-1263-4975-9687-cc9b8b2d93dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:50.573373 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-19e279e9-1263-4975-9687-cc9b8b2d93dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:50.577688 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 787/1578] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:50 2022] DELETE /identity/v3/projects/a25655f5e54240dd8b269a6038fbe0bd => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:50.577869 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 792/1579] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:50 2022] DELETE /identity/v3/users/97ecf8fad13645fba69b0b80611ab494 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:41:50.577966 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e279e9-1263-4975-9687-cc9b8b2d93dc admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:50.578763 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbf4ab-6e60-42d0-a2f2-062e09f95858 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:50.579856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-19e279e9-1263-4975-9687-cc9b8b2d93dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:50.580164 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-82cbf4ab-6e60-42d0-a2f2-062e09f95858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:50.587134 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:50.669501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e279e9-1263-4975-9687-cc9b8b2d93dc admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:50.690840 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbf4ab-6e60-42d0-a2f2-062e09f95858 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:50.705312 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a514c9-f765-4266-adcc-478983654ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:50.706078 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a514c9-f765-4266-adcc-478983654ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:50.706352 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a514c9-f765-4266-adcc-478983654ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:50.706912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a514c9-f765-4266-adcc-478983654ec6 admin admin] PATH_INFO: `/v3/users/fbe263bfd3cb4308b2663fd5988705c0` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:50.708346 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a514c9-f765-4266-adcc-478983654ec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe263bfd3cb4308b2663fd5988705c0)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:50.711106 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a514c9-f765-4266-adcc-478983654ec6 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:50.750714 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627384c-5b3a-4bda-bb2e-975d31204734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:50.751302 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627384c-5b3a-4bda-bb2e-975d31204734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:50.751667 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627384c-5b3a-4bda-bb2e-975d31204734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:50.751984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627384c-5b3a-4bda-bb2e-975d31204734 admin admin] PATH_INFO: `/v3/projects/5ac14b64b1fc4ad7b1e819496545ef8e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:50.753597 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627384c-5b3a-4bda-bb2e-975d31204734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ac14b64b1fc4ad7b1e819496545ef8e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:50.758238 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627384c-5b3a-4bda-bb2e-975d31204734 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:50.795065 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-20a514c9-f765-4266-adcc-478983654ec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe263bfd3cb4308b2663fd5988705c0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:50.810389 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-20a514c9-f765-4266-adcc-478983654ec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe263bfd3cb4308b2663fd5988705c0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:50.828935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e627384c-5b3a-4bda-bb2e-975d31204734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ac14b64b1fc4ad7b1e819496545ef8e', 'request_id': 'req-e627384c-5b3a-4bda-bb2e-975d31204734'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:50.844074 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e627384c-5b3a-4bda-bb2e-975d31204734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ac14b64b1fc4ad7b1e819496545ef8e', 'request_id': 'req-e627384c-5b3a-4bda-bb2e-975d31204734'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:50.856200 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e627384c-5b3a-4bda-bb2e-975d31204734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ac14b64b1fc4ad7b1e819496545ef8e', 'request_id': 'req-e627384c-5b3a-4bda-bb2e-975d31204734'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:50.858279 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-20a514c9-f765-4266-adcc-478983654ec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe263bfd3cb4308b2663fd5988705c0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:50.859640 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-20a514c9-f765-4266-adcc-478983654ec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe263bfd3cb4308b2663fd5988705c0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:50.873499 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-20a514c9-f765-4266-adcc-478983654ec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe263bfd3cb4308b2663fd5988705c0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:50.886744 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 793/1580] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:50 2022] DELETE /identity/v3/users/fbe263bfd3cb4308b2663fd5988705c0 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:41:50.886939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e627384c-5b3a-4bda-bb2e-975d31204734 admin admin] The token cache is being invalidate because project 5ac14b64b1fc4ad7b1e819496545ef8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:50.886939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e627384c-5b3a-4bda-bb2e-975d31204734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:50.887129 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cf27b-430f-46a3-9fa7-525b6daa81c9 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:50.888085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e627384c-5b3a-4bda-bb2e-975d31204734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:50.895484 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 788/1581] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:50 2022] DELETE /identity/v3/projects/5ac14b64b1fc4ad7b1e819496545ef8e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:50.911428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ebecd-3801-4d8e-af25-6c25434bf2f6 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:50.911428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ebecd-3801-4d8e-af25-6c25434bf2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:50.911428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ebecd-3801-4d8e-af25-6c25434bf2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:50.917618 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cf27b-430f-46a3-9fa7-525b6daa81c9 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:50.919099 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cf27b-430f-46a3-9fa7-525b6daa81c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:50.957956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-1b6ebecd-3801-4d8e-af25-6c25434bf2f6 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:50.959124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-1b6ebecd-3801-4d8e-af25-6c25434bf2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:50.984490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:51.043654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-9a4cf27b-430f-46a3-9fa7-525b6daa81c9 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:51.045531 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-9a4cf27b-430f-46a3-9fa7-525b6daa81c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:51.165304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 789/1582] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:51.173402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d56631-cae1-44af-a271-5a36e5b004fc None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:51.173708 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d56631-cae1-44af-a271-5a36e5b004fc None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:51.173991 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d56631-cae1-44af-a271-5a36e5b004fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:51.224003 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 794/1583] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:51.227251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-a9d56631-cae1-44af-a271-5a36e5b004fc None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:51.229241 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a9d56631-cae1-44af-a271-5a36e5b004fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:51.240429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 790/1584] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:51.245016 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cf27b-430f-46a3-9fa7-525b6daa81c9 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:51.261984 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cf27b-430f-46a3-9fa7-525b6daa81c9 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:51.265987 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d56631-cae1-44af-a271-5a36e5b004fc None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:51.267701 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a9d56631-cae1-44af-a271-5a36e5b004fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:51.279088 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72142662-6acb-4a4a-b8d1-17ea6bb5fe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:51.279900 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72142662-6acb-4a4a-b8d1-17ea6bb5fe14 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:51.280812 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72142662-6acb-4a4a-b8d1-17ea6bb5fe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:51.281225 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72142662-6acb-4a4a-b8d1-17ea6bb5fe14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:51.288625 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72142662-6acb-4a4a-b8d1-17ea6bb5fe14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:41:51.289103 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72142662-6acb-4a4a-b8d1-17ea6bb5fe14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:51.291166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72142662-6acb-4a4a-b8d1-17ea6bb5fe14 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:51.315608 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 795/1585] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:41:51.321568 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72142662-6acb-4a4a-b8d1-17ea6bb5fe14 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:51.336963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72142662-6acb-4a4a-b8d1-17ea6bb5fe14 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:51.343374 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe1fd3-baa3-41c9-9aff-d1965f94ae12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:51.344187 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe1fd3-baa3-41c9-9aff-d1965f94ae12 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:51.345389 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe1fd3-baa3-41c9-9aff-d1965f94ae12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:51.345687 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe1fd3-baa3-41c9-9aff-d1965f94ae12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:51.346524 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe1fd3-baa3-41c9-9aff-d1965f94ae12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:51.348779 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe1fd3-baa3-41c9-9aff-d1965f94ae12 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:51.359390 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d56631-cae1-44af-a271-5a36e5b004fc None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:51.359828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:51.363898 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbbd42-8a5e-41da-b56b-fb6e70ddddbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:51.364668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbbd42-8a5e-41da-b56b-fb6e70ddddbd service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:51.365534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbbd42-8a5e-41da-b56b-fb6e70ddddbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:51.365897 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbbd42-8a5e-41da-b56b-fb6e70ddddbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:51.404730 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 796/1586] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:51 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:51.405259 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbbd42-8a5e-41da-b56b-fb6e70ddddbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:51.406816 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbbd42-8a5e-41da-b56b-fb6e70ddddbd service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:51.408702 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe1fd3-baa3-41c9-9aff-d1965f94ae12 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:51.430013 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 791/1587] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:41:51.531704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe1fd3-baa3-41c9-9aff-d1965f94ae12 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:51.537746 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac90b0-0380-4cd9-97e4-09d6fad422f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:51.538740 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac90b0-0380-4cd9-97e4-09d6fad422f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:51.539148 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac90b0-0380-4cd9-97e4-09d6fad422f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:51.539555 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac90b0-0380-4cd9-97e4-09d6fad422f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:51.540457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac90b0-0380-4cd9-97e4-09d6fad422f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:51.543091 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac90b0-0380-4cd9-97e4-09d6fad422f7 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:51.598690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 797/1588] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:51 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:51.600266 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbbd42-8a5e-41da-b56b-fb6e70ddddbd service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:51.617987 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbbd42-8a5e-41da-b56b-fb6e70ddddbd service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:51.620593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac90b0-0380-4cd9-97e4-09d6fad422f7 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:51.622649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-f8ac90b0-0380-4cd9-97e4-09d6fad422f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:51.644289 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f5593-02e5-47a4-a624-2f49abebf9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:51.645282 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f5593-02e5-47a4-a624-2f49abebf9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:51.645565 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f5593-02e5-47a4-a624-2f49abebf9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:51.645836 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f5593-02e5-47a4-a624-2f49abebf9c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:51.646796 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac90b0-0380-4cd9-97e4-09d6fad422f7 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:51.647829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f5593-02e5-47a4-a624-2f49abebf9c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:51.657251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f5593-02e5-47a4-a624-2f49abebf9c7 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:51.659808 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a12b1-6008-41f0-8198-2a0951878efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:51.660728 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a12b1-6008-41f0-8198-2a0951878efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:51.662301 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a12b1-6008-41f0-8198-2a0951878efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:51.667810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a12b1-6008-41f0-8198-2a0951878efc admin admin] PATH_INFO: `/v3/projects/3f6d30a9f83e408eac72ac2c00644d94` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:51.670495 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a12b1-6008-41f0-8198-2a0951878efc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f6d30a9f83e408eac72ac2c00644d94)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:51.683484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a12b1-6008-41f0-8198-2a0951878efc admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:51.686094 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 792/1589] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:41:51.690097 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f5593-02e5-47a4-a624-2f49abebf9c7 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:51.713397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f5593-02e5-47a4-a624-2f49abebf9c7 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:51.728129 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8a6d9-409a-4b04-8098-41b1685c2664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:51.728771 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8a6d9-409a-4b04-8098-41b1685c2664 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:51.729095 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8a6d9-409a-4b04-8098-41b1685c2664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:51.729374 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8a6d9-409a-4b04-8098-41b1685c2664 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:51.730061 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8a6d9-409a-4b04-8098-41b1685c2664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:51.733949 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8a6d9-409a-4b04-8098-41b1685c2664 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:51.756714 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 793/1590] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:51.764154 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8a6d9-409a-4b04-8098-41b1685c2664 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:51.786722 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-173a12b1-6008-41f0-8198-2a0951878efc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f6d30a9f83e408eac72ac2c00644d94', 'request_id': 'req-173a12b1-6008-41f0-8198-2a0951878efc'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:51.788376 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8a6d9-409a-4b04-8098-41b1685c2664 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:51.797698 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-173a12b1-6008-41f0-8198-2a0951878efc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f6d30a9f83e408eac72ac2c00644d94', 'request_id': 'req-173a12b1-6008-41f0-8198-2a0951878efc'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:51.808862 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-173a12b1-6008-41f0-8198-2a0951878efc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f6d30a9f83e408eac72ac2c00644d94', 'request_id': 'req-173a12b1-6008-41f0-8198-2a0951878efc'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:51.867418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-173a12b1-6008-41f0-8198-2a0951878efc admin admin] The token cache is being invalidate because project 3f6d30a9f83e408eac72ac2c00644d94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:51.867418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-173a12b1-6008-41f0-8198-2a0951878efc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:51.868559 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-173a12b1-6008-41f0-8198-2a0951878efc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:51.874038 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 798/1591] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:51 2022] DELETE /identity/v3/projects/3f6d30a9f83e408eac72ac2c00644d94 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:51.880269 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95110673-fefd-48c7-9169-3b27b653d31f None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:51.881440 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95110673-fefd-48c7-9169-3b27b653d31f None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:51.881753 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95110673-fefd-48c7-9169-3b27b653d31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:51.919781 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba693f-9f8a-4d0b-9105-86816c2e5fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:51.920458 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba693f-9f8a-4d0b-9105-86816c2e5fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:51.920726 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba693f-9f8a-4d0b-9105-86816c2e5fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:51.921008 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba693f-9f8a-4d0b-9105-86816c2e5fdc admin admin] PATH_INFO: `/v3/projects/7ae905b0cc5e4ac381633120a6659b10/users/e8106cd9cc3b41b09064f148bf655057/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:51.949211 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-95110673-fefd-48c7-9169-3b27b653d31f None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:51.950121 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-95110673-fefd-48c7-9169-3b27b653d31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:51.974842 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 799/1592] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:41:51.975897 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95110673-fefd-48c7-9169-3b27b653d31f None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:51.977396 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-95110673-fefd-48c7-9169-3b27b653d31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:51.992732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95110673-fefd-48c7-9169-3b27b653d31f None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:51.998332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4caf4a-37b8-45fb-8b3a-f18caba73586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:51.999538 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4caf4a-37b8-45fb-8b3a-f18caba73586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:51.999995 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4caf4a-37b8-45fb-8b3a-f18caba73586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:52.000390 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4caf4a-37b8-45fb-8b3a-f18caba73586 admin admin] PATH_INFO: `/v3/projects/db951956b1c64435a96c2b0acb163686` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:52.001878 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4caf4a-37b8-45fb-8b3a-f18caba73586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db951956b1c64435a96c2b0acb163686)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:52.004244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4caf4a-37b8-45fb-8b3a-f18caba73586 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:52.027322 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba693f-9f8a-4d0b-9105-86816c2e5fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ae905b0cc5e4ac381633120a6659b10, user_id=e8106cd9cc3b41b09064f148bf655057, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:52.040407 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba693f-9f8a-4d0b-9105-86816c2e5fdc admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:52.100257 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 794/1593] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:51 2022] PUT /identity/v3/projects/7ae905b0cc5e4ac381633120a6659b10/users/e8106cd9cc3b41b09064f148bf655057/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:52.109464 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe584c-6552-4026-8c2f-43665f16c0f9 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:52.109464 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe584c-6552-4026-8c2f-43665f16c0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:52.111410 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe584c-6552-4026-8c2f-43665f16c0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:52.123002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=84,keystone:INSERT=5,keystone:DELETE=11 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:52.124260 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-ea4caf4a-37b8-45fb-8b3a-f18caba73586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db951956b1c64435a96c2b0acb163686', 'request_id': 'req-ea4caf4a-37b8-45fb-8b3a-f18caba73586'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:52.147974 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-ea4caf4a-37b8-45fb-8b3a-f18caba73586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db951956b1c64435a96c2b0acb163686', 'request_id': 'req-ea4caf4a-37b8-45fb-8b3a-f18caba73586'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:52.164450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-ea4caf4a-37b8-45fb-8b3a-f18caba73586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db951956b1c64435a96c2b0acb163686', 'request_id': 'req-ea4caf4a-37b8-45fb-8b3a-f18caba73586'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:52.174179 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-7afe584c-6552-4026-8c2f-43665f16c0f9 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:52.192061 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-7afe584c-6552-4026-8c2f-43665f16c0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:52.194636 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-ea4caf4a-37b8-45fb-8b3a-f18caba73586 admin admin] The token cache is being invalidate because project db951956b1c64435a96c2b0acb163686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:52.195133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-ea4caf4a-37b8-45fb-8b3a-f18caba73586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:52.197153 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-ea4caf4a-37b8-45fb-8b3a-f18caba73586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:52.199803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:52.204891 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 800/1594] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:51 2022] DELETE /identity/v3/projects/db951956b1c64435a96c2b0acb163686 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:52.204891 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ddc23-6f48-437b-a697-04a01cc66d32 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:52.204891 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ddc23-6f48-437b-a697-04a01cc66d32 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:52.204891 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ddc23-6f48-437b-a697-04a01cc66d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:52.259472 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-c61ddc23-6f48-437b-a697-04a01cc66d32 None None] MFA Rules not processed for user `e8106cd9cc3b41b09064f148bf655057`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:52.261002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-c61ddc23-6f48-437b-a697-04a01cc66d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:52.330041 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 795/1595] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:52.332586 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe584c-6552-4026-8c2f-43665f16c0f9 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:52.335276 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-7afe584c-6552-4026-8c2f-43665f16c0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:52.358110 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe584c-6552-4026-8c2f-43665f16c0f9 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:52.363827 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b38e3-1e9e-4789-801a-f47f2eab5891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:52.365563 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b38e3-1e9e-4789-801a-f47f2eab5891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:52.366046 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b38e3-1e9e-4789-801a-f47f2eab5891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:52.366540 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b38e3-1e9e-4789-801a-f47f2eab5891 admin admin] PATH_INFO: `/v3/users/6a415574f6654630ba926567cd207520` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:52.367991 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b38e3-1e9e-4789-801a-f47f2eab5891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a415574f6654630ba926567cd207520)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:52.370550 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b38e3-1e9e-4789-801a-f47f2eab5891 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:52.387142 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 801/1596] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:52.388072 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ddc23-6f48-437b-a697-04a01cc66d32 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:52.401030 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ddc23-6f48-437b-a697-04a01cc66d32 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:52.407713 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7051d8a-4045-418a-acb2-3e3bf8f3c037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:52.408581 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7051d8a-4045-418a-acb2-3e3bf8f3c037 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:52.409039 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7051d8a-4045-418a-acb2-3e3bf8f3c037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:52.410236 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7051d8a-4045-418a-acb2-3e3bf8f3c037 admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:52.410908 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7051d8a-4045-418a-acb2-3e3bf8f3c037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:41:52.411214 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7051d8a-4045-418a-acb2-3e3bf8f3c037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:52.413460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7051d8a-4045-418a-acb2-3e3bf8f3c037 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:52.438524 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 802/1597] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:41:52.441297 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7051d8a-4045-418a-acb2-3e3bf8f3c037 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:52.446539 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a7051d8a-4045-418a-acb2-3e3bf8f3c037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:52.466932 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8e5b38e3-1e9e-4789-801a-f47f2eab5891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a415574f6654630ba926567cd207520'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:52.476666 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8e5b38e3-1e9e-4789-801a-f47f2eab5891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a415574f6654630ba926567cd207520'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:52.477662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8e5b38e3-1e9e-4789-801a-f47f2eab5891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a415574f6654630ba926567cd207520'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:52.478509 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8e5b38e3-1e9e-4789-801a-f47f2eab5891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a415574f6654630ba926567cd207520'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:52.494210 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8e5b38e3-1e9e-4789-801a-f47f2eab5891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a415574f6654630ba926567cd207520'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:52.542828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7051d8a-4045-418a-acb2-3e3bf8f3c037 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:52.547965 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aebf0f-a4e1-48f8-abaf-e09677c4ed54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:52.548471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aebf0f-a4e1-48f8-abaf-e09677c4ed54 service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:52.548733 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aebf0f-a4e1-48f8-abaf-e09677c4ed54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:52.549007 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aebf0f-a4e1-48f8-abaf-e09677c4ed54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:52.550891 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-89aebf0f-a4e1-48f8-abaf-e09677c4ed54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:52.555824 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 796/1598] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:52 2022] DELETE /identity/v3/users/6a415574f6654630ba926567cd207520 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:52.556895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b38e3-1e9e-4789-801a-f47f2eab5891 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:52.559465 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-8e5b38e3-1e9e-4789-801a-f47f2eab5891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:52.587401 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aebf0f-a4e1-48f8-abaf-e09677c4ed54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:52.592018 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aebf0f-a4e1-48f8-abaf-e09677c4ed54 service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:52.623218 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 803/1599] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:52.647835 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aebf0f-a4e1-48f8-abaf-e09677c4ed54 service cinder] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:52.651241 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-89aebf0f-a4e1-48f8-abaf-e09677c4ed54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:52.674416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aebf0f-a4e1-48f8-abaf-e09677c4ed54 service cinder] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:52.756227 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b38e3-1e9e-4789-801a-f47f2eab5891 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:52.764152 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89854cfa-0aad-47e5-88fe-4e084db9020e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:52.765274 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89854cfa-0aad-47e5-88fe-4e084db9020e admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:52.765768 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89854cfa-0aad-47e5-88fe-4e084db9020e admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:52.766245 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89854cfa-0aad-47e5-88fe-4e084db9020e admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:52.767446 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89854cfa-0aad-47e5-88fe-4e084db9020e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:52.771494 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89854cfa-0aad-47e5-88fe-4e084db9020e admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:52.771726 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:52.785642 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8e1a8-0efe-42c0-9f99-43980bdc3c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:52.787593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8e1a8-0efe-42c0-9f99-43980bdc3c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:52.788152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8e1a8-0efe-42c0-9f99-43980bdc3c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:52.788245 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8e1a8-0efe-42c0-9f99-43980bdc3c42 admin admin] PATH_INFO: `/v3/users/e8106cd9cc3b41b09064f148bf655057` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:52.789420 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8e1a8-0efe-42c0-9f99-43980bdc3c42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8106cd9cc3b41b09064f148bf655057)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:52.792007 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8e1a8-0efe-42c0-9f99-43980bdc3c42 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:52.821112 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 797/1600] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:52 2022] POST /identity/v3/projects => generated 409 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:52.825234 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89854cfa-0aad-47e5-88fe-4e084db9020e admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:52.842928 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:52.891936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-68d8e1a8-0efe-42c0-9f99-43980bdc3c42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8106cd9cc3b41b09064f148bf655057'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:52.901366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-68d8e1a8-0efe-42c0-9f99-43980bdc3c42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8106cd9cc3b41b09064f148bf655057'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:52.917557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-68d8e1a8-0efe-42c0-9f99-43980bdc3c42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8106cd9cc3b41b09064f148bf655057'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:52.919361 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-68d8e1a8-0efe-42c0-9f99-43980bdc3c42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8106cd9cc3b41b09064f148bf655057'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:52.920864 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89854cfa-0aad-47e5-88fe-4e084db9020e admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:52.929362 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14698c15-f381-4244-9c61-cb55d281e53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:52.929685 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-68d8e1a8-0efe-42c0-9f99-43980bdc3c42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8106cd9cc3b41b09064f148bf655057'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:52.930109 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14698c15-f381-4244-9c61-cb55d281e53f admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:52.930393 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14698c15-f381-4244-9c61-cb55d281e53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:52.930674 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14698c15-f381-4244-9c61-cb55d281e53f admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:52.931509 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14698c15-f381-4244-9c61-cb55d281e53f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:52.933386 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14698c15-f381-4244-9c61-cb55d281e53f admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:52.938028 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 804/1601] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:52 2022] DELETE /identity/v3/users/e8106cd9cc3b41b09064f148bf655057 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:52.942028 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7057e-3736-4bb6-8f47-168d26a7c4b2 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:52.942383 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7057e-3736-4bb6-8f47-168d26a7c4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:52.942753 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7057e-3736-4bb6-8f47-168d26a7c4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:52.971113 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 798/1602] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:52 2022] POST /identity/v3/users => generated 305 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:41:52.972120 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-86b7057e-3736-4bb6-8f47-168d26a7c4b2 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:52.973452 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-86b7057e-3736-4bb6-8f47-168d26a7c4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:52.973549 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14698c15-f381-4244-9c61-cb55d281e53f admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:52.976446 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-14698c15-f381-4244-9c61-cb55d281e53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:52.988880 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14698c15-f381-4244-9c61-cb55d281e53f admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:53.072886 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 805/1603] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:41:53.076133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7057e-3736-4bb6-8f47-168d26a7c4b2 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:53.076133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-86b7057e-3736-4bb6-8f47-168d26a7c4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:53.082534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7246d-2d30-422e-a4d4-64ac37781282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:53.083172 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7246d-2d30-422e-a4d4-64ac37781282 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:53.084132 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7246d-2d30-422e-a4d4-64ac37781282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:53.084599 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7246d-2d30-422e-a4d4-64ac37781282 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:53.085276 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7246d-2d30-422e-a4d4-64ac37781282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:53.086922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7246d-2d30-422e-a4d4-64ac37781282 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:53.088421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7057e-3736-4bb6-8f47-168d26a7c4b2 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:53.093079 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ba17f-4809-42c9-bb14-76b03a8910c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:53.093711 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ba17f-4809-42c9-bb14-76b03a8910c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:53.094043 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ba17f-4809-42c9-bb14-76b03a8910c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:53.094308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ba17f-4809-42c9-bb14-76b03a8910c2 admin admin] PATH_INFO: `/v3/projects/15d30cc1d8e641f28ac5b4bd934b2ccd` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:53.095428 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ba17f-4809-42c9-bb14-76b03a8910c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15d30cc1d8e641f28ac5b4bd934b2ccd)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:53.097331 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 799/1604] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:53.097443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ba17f-4809-42c9-bb14-76b03a8910c2 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:53.098167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7246d-2d30-422e-a4d4-64ac37781282 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:53.099989 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-36d7246d-2d30-422e-a4d4-64ac37781282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:53.169044 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-9e2ba17f-4809-42c9-bb14-76b03a8910c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15d30cc1d8e641f28ac5b4bd934b2ccd', 'request_id': 'req-9e2ba17f-4809-42c9-bb14-76b03a8910c2'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:53.173363 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7246d-2d30-422e-a4d4-64ac37781282 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:53.179939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-9e2ba17f-4809-42c9-bb14-76b03a8910c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15d30cc1d8e641f28ac5b4bd934b2ccd', 'request_id': 'req-9e2ba17f-4809-42c9-bb14-76b03a8910c2'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:53.189495 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-9e2ba17f-4809-42c9-bb14-76b03a8910c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15d30cc1d8e641f28ac5b4bd934b2ccd', 'request_id': 'req-9e2ba17f-4809-42c9-bb14-76b03a8910c2'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:53.199307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:53.208014 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-9e2ba17f-4809-42c9-bb14-76b03a8910c2 admin admin] The token cache is being invalidate because project 15d30cc1d8e641f28ac5b4bd934b2ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:53.209548 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-9e2ba17f-4809-42c9-bb14-76b03a8910c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:53.215167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-9e2ba17f-4809-42c9-bb14-76b03a8910c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:53.217436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 806/1605] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:53 2022] DELETE /identity/v3/projects/15d30cc1d8e641f28ac5b4bd934b2ccd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:53.219082 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ba17f-4809-42c9-bb14-76b03a8910c2 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:53.221614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-9e2ba17f-4809-42c9-bb14-76b03a8910c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:53.257834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22872bd3-7752-40b6-873f-f5ca8f6f1744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:53.258641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22872bd3-7752-40b6-873f-f5ca8f6f1744 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:53.259345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22872bd3-7752-40b6-873f-f5ca8f6f1744 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:53.259702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22872bd3-7752-40b6-873f-f5ca8f6f1744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:53.264271 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-22872bd3-7752-40b6-873f-f5ca8f6f1744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:53.274282 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:53.344288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ba17f-4809-42c9-bb14-76b03a8910c2 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:53.349661 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ed76f-d52d-4d6a-9934-ed550636877e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:53.350499 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ed76f-d52d-4d6a-9934-ed550636877e admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:53.350783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ed76f-d52d-4d6a-9934-ed550636877e admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:53.351056 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ed76f-d52d-4d6a-9934-ed550636877e admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:53.351770 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ed76f-d52d-4d6a-9934-ed550636877e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:53.353388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ed76f-d52d-4d6a-9934-ed550636877e admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:53.366936 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22872bd3-7752-40b6-873f-f5ca8f6f1744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:53.369133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22872bd3-7752-40b6-873f-f5ca8f6f1744 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:53.374629 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 807/1606] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:53.374629 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7dc4f-9567-490b-a872-15761450fdaa None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:53.374629 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7dc4f-9567-490b-a872-15761450fdaa None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:53.374629 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7dc4f-9567-490b-a872-15761450fdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:53.383196 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 800/1607] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:53.395347 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22872bd3-7752-40b6-873f-f5ca8f6f1744 service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:53.403682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-7be7dc4f-9567-490b-a872-15761450fdaa None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:53.405208 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-7be7dc4f-9567-490b-a872-15761450fdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:53.410027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22872bd3-7752-40b6-873f-f5ca8f6f1744 service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:53.421400 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 808/1608] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:53.421583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b389226-d44e-46f6-8414-0ca59c79dfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:53.421583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b389226-d44e-46f6-8414-0ca59c79dfd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:53.421583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b389226-d44e-46f6-8414-0ca59c79dfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:53.421583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b389226-d44e-46f6-8414-0ca59c79dfd8 admin admin] PATH_INFO: `/v3/projects/d4b5b097b4774da796cf58112b12d563/users/9cf19b9f0a684041a439765000dcb6c2/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:53.424960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae953b-14f6-4475-8dc9-358f52c4f550 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:53.425365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae953b-14f6-4475-8dc9-358f52c4f550 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:53.425649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae953b-14f6-4475-8dc9-358f52c4f550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:53.437120 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b389226-d44e-46f6-8414-0ca59c79dfd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b5b097b4774da796cf58112b12d563, user_id=9cf19b9f0a684041a439765000dcb6c2, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:53.443685 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b389226-d44e-46f6-8414-0ca59c79dfd8 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:53.466878 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-47ae953b-14f6-4475-8dc9-358f52c4f550 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:53.469153 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-47ae953b-14f6-4475-8dc9-358f52c4f550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:53.477656 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 801/1609] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:53 2022] PUT /identity/v3/projects/d4b5b097b4774da796cf58112b12d563/users/9cf19b9f0a684041a439765000dcb6c2/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:53.488502 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda933c-4f67-4ad9-93f0-dccf1570dfaa None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:53.492459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda933c-4f67-4ad9-93f0-dccf1570dfaa None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:53.492459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda933c-4f67-4ad9-93f0-dccf1570dfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:53.526534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-dfda933c-4f67-4ad9-93f0-dccf1570dfaa None None] MFA Rules not processed for user `9cf19b9f0a684041a439765000dcb6c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:53.527970 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-dfda933c-4f67-4ad9-93f0-dccf1570dfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:53.558705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 809/1610] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:53.562895 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae953b-14f6-4475-8dc9-358f52c4f550 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:53.577432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae953b-14f6-4475-8dc9-358f52c4f550 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:53.582503 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510aca65-718d-4b4d-8d23-e36bb512c35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:53.583239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510aca65-718d-4b4d-8d23-e36bb512c35d admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:53.584235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510aca65-718d-4b4d-8d23-e36bb512c35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:53.584235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510aca65-718d-4b4d-8d23-e36bb512c35d admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:53.585326 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510aca65-718d-4b4d-8d23-e36bb512c35d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:41:53.585733 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510aca65-718d-4b4d-8d23-e36bb512c35d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:53.587817 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510aca65-718d-4b4d-8d23-e36bb512c35d admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:53.604356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 810/1611] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:41:53.605400 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510aca65-718d-4b4d-8d23-e36bb512c35d admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:53.619613 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510aca65-718d-4b4d-8d23-e36bb512c35d admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:53.624857 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317adb3f-a353-4d14-8692-9d57e61fcb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:53.625749 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317adb3f-a353-4d14-8692-9d57e61fcb82 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:53.626162 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317adb3f-a353-4d14-8692-9d57e61fcb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:53.626538 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317adb3f-a353-4d14-8692-9d57e61fcb82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:53.627295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317adb3f-a353-4d14-8692-9d57e61fcb82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:53.629341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317adb3f-a353-4d14-8692-9d57e61fcb82 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:53.640881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 802/1612] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:53 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:53.642115 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda933c-4f67-4ad9-93f0-dccf1570dfaa None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:53.657587 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda933c-4f67-4ad9-93f0-dccf1570dfaa None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:53.663533 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093598c-b7e8-4cd1-9efc-b7b25390a56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:53.664201 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093598c-b7e8-4cd1-9efc-b7b25390a56f admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:53.664484 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093598c-b7e8-4cd1-9efc-b7b25390a56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:53.664753 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093598c-b7e8-4cd1-9efc-b7b25390a56f admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:53.665397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093598c-b7e8-4cd1-9efc-b7b25390a56f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:53.667720 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093598c-b7e8-4cd1-9efc-b7b25390a56f admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:53.673177 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 811/1613] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:53 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:53.674851 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317adb3f-a353-4d14-8692-9d57e61fcb82 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:53.709092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 803/1614] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:53 2022] POST /identity/v3/projects => generated 407 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:53.723595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093598c-b7e8-4cd1-9efc-b7b25390a56f admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:53.746757 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:53.763287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317adb3f-a353-4d14-8692-9d57e61fcb82 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:53.800925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:53.843612 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093598c-b7e8-4cd1-9efc-b7b25390a56f admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:53.850468 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e2507-de14-40c6-a060-0e365b772f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:53.851090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e2507-de14-40c6-a060-0e365b772f08 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:53.851497 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e2507-de14-40c6-a060-0e365b772f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:53.851773 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e2507-de14-40c6-a060-0e365b772f08 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:53.852417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e2507-de14-40c6-a060-0e365b772f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:53.854011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3d40e-1c75-481a-93a3-021ce8ef444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:53.854466 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e2507-de14-40c6-a060-0e365b772f08 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:53.854949 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3d40e-1c75-481a-93a3-021ce8ef444d admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:53.855318 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3d40e-1c75-481a-93a3-021ce8ef444d admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:53.855682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3d40e-1c75-481a-93a3-021ce8ef444d admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:53.856407 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3d40e-1c75-481a-93a3-021ce8ef444d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:53.858876 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3d40e-1c75-481a-93a3-021ce8ef444d admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:53.886643 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 804/1615] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:53 2022] POST /identity/v3/users => generated 310 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:53.886643 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e2507-de14-40c6-a060-0e365b772f08 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:53.886643 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-ca0e2507-de14-40c6-a060-0e365b772f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:53.890368 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 812/1616] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:53 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:53.891558 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3d40e-1c75-481a-93a3-021ce8ef444d admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:53.903615 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3d40e-1c75-481a-93a3-021ce8ef444d admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:53.906501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e2507-de14-40c6-a060-0e365b772f08 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:53.909827 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d63b60-2c58-4281-b031-3b6c54bc8d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:53.911000 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d63b60-2c58-4281-b031-3b6c54bc8d7b admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:53.911000 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d63b60-2c58-4281-b031-3b6c54bc8d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:53.911562 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d63b60-2c58-4281-b031-3b6c54bc8d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:53.912651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d63b60-2c58-4281-b031-3b6c54bc8d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:53.914067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982806ec-4e89-4de8-bbda-68577de214f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:53.914611 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d63b60-2c58-4281-b031-3b6c54bc8d7b admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:53.915066 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982806ec-4e89-4de8-bbda-68577de214f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:53.915438 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982806ec-4e89-4de8-bbda-68577de214f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:53.916000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982806ec-4e89-4de8-bbda-68577de214f3 admin admin] PATH_INFO: `/v3/projects/7ae905b0cc5e4ac381633120a6659b10` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:53.917365 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982806ec-4e89-4de8-bbda-68577de214f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ae905b0cc5e4ac381633120a6659b10)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:53.920126 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982806ec-4e89-4de8-bbda-68577de214f3 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:53.930142 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 813/1617] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:53.931299 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d63b60-2c58-4281-b031-3b6c54bc8d7b admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:53.942372 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d63b60-2c58-4281-b031-3b6c54bc8d7b admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:53.947631 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06f568-868d-4cf3-b4e0-508df2d165f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:53.948230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06f568-868d-4cf3-b4e0-508df2d165f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:53.948523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06f568-868d-4cf3-b4e0-508df2d165f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:53.948765 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06f568-868d-4cf3-b4e0-508df2d165f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:53.949529 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06f568-868d-4cf3-b4e0-508df2d165f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:53.951287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06f568-868d-4cf3-b4e0-508df2d165f8 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:53.967234 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 814/1618] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:53.967234 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06f568-868d-4cf3-b4e0-508df2d165f8 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:53.979117 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06f568-868d-4cf3-b4e0-508df2d165f8 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:53.982567 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-982806ec-4e89-4de8-bbda-68577de214f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ae905b0cc5e4ac381633120a6659b10', 'request_id': 'req-982806ec-4e89-4de8-bbda-68577de214f3'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:53.992866 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-982806ec-4e89-4de8-bbda-68577de214f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ae905b0cc5e4ac381633120a6659b10', 'request_id': 'req-982806ec-4e89-4de8-bbda-68577de214f3'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:53.999324 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-982806ec-4e89-4de8-bbda-68577de214f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ae905b0cc5e4ac381633120a6659b10', 'request_id': 'req-982806ec-4e89-4de8-bbda-68577de214f3'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:54.011431 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-982806ec-4e89-4de8-bbda-68577de214f3 admin admin] The token cache is being invalidate because project 7ae905b0cc5e4ac381633120a6659b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:54.011843 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-982806ec-4e89-4de8-bbda-68577de214f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:54.012612 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-982806ec-4e89-4de8-bbda-68577de214f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:54.014563 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 805/1619] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:53 2022] DELETE /identity/v3/projects/7ae905b0cc5e4ac381633120a6659b10 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:54.015461 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982806ec-4e89-4de8-bbda-68577de214f3 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:54.016889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-982806ec-4e89-4de8-bbda-68577de214f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:54.046749 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016c0ca-e5e0-48b0-a982-e1e404c5adb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:54.047425 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016c0ca-e5e0-48b0-a982-e1e404c5adb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:54.047709 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016c0ca-e5e0-48b0-a982-e1e404c5adb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:54.047986 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016c0ca-e5e0-48b0-a982-e1e404c5adb1 admin admin] PATH_INFO: `/v3/projects/6257957ab8db4b25b3f598dde66a1c97/users/94e3e06318e045fbaeda9c5063bf18d2/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:54.064930 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016c0ca-e5e0-48b0-a982-e1e404c5adb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6257957ab8db4b25b3f598dde66a1c97, user_id=94e3e06318e045fbaeda9c5063bf18d2, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:54.068808 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016c0ca-e5e0-48b0-a982-e1e404c5adb1 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:54.089273 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 815/1620] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:53 2022] PUT /identity/v3/projects/6257957ab8db4b25b3f598dde66a1c97/users/94e3e06318e045fbaeda9c5063bf18d2/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:54.090651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4afcb-ed25-493c-a214-a699a1b21207 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:54.090930 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4afcb-ed25-493c-a214-a699a1b21207 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:54.091198 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4afcb-ed25-493c-a214-a699a1b21207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:54.096703 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982806ec-4e89-4de8-bbda-68577de214f3 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:54.112720 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-5ec4afcb-ed25-493c-a214-a699a1b21207 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:54.114161 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-5ec4afcb-ed25-493c-a214-a699a1b21207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:54.163529 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:54.163761 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6d886-8d07-4d59-bc13-ddcff87b74e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:54.164200 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6d886-8d07-4d59-bc13-ddcff87b74e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:54.164484 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6d886-8d07-4d59-bc13-ddcff87b74e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:54.164756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6d886-8d07-4d59-bc13-ddcff87b74e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:54.165576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6d886-8d07-4d59-bc13-ddcff87b74e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:54.167142 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6d886-8d07-4d59-bc13-ddcff87b74e4 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:54.172969 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:54.179213 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 806/1621] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:54.180655 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6d886-8d07-4d59-bc13-ddcff87b74e4 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:54.184045 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-33e6d886-8d07-4d59-bc13-ddcff87b74e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:54.195548 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 816/1622] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:54.196624 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4afcb-ed25-493c-a214-a699a1b21207 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:54.198518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6d886-8d07-4d59-bc13-ddcff87b74e4 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:54.203276 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be6787-3d65-4516-ba77-3029a3ac0246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:54.203891 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be6787-3d65-4516-ba77-3029a3ac0246 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:54.204167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be6787-3d65-4516-ba77-3029a3ac0246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:54.204437 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be6787-3d65-4516-ba77-3029a3ac0246 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:54.205078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be6787-3d65-4516-ba77-3029a3ac0246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:54.206696 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be6787-3d65-4516-ba77-3029a3ac0246 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:54.206983 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4afcb-ed25-493c-a214-a699a1b21207 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:54.212247 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20423e8d-e3f3-490d-9ccd-3eacb0be0587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:54.212908 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20423e8d-e3f3-490d-9ccd-3eacb0be0587 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:54.213216 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20423e8d-e3f3-490d-9ccd-3eacb0be0587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:54.213490 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20423e8d-e3f3-490d-9ccd-3eacb0be0587 admin admin] PATH_INFO: `/v3/projects/aa50754cce364512b1e8d3e1f05bfe5e/users/6a70aa6752674f8480cae59eed9103ab/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:54.217419 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 807/1623] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:54.218825 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5ebaa-dc98-41a4-90f6-44223c447c1e None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:54.219069 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5ebaa-dc98-41a4-90f6-44223c447c1e None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:54.219346 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5ebaa-dc98-41a4-90f6-44223c447c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:54.232375 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20423e8d-e3f3-490d-9ccd-3eacb0be0587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa50754cce364512b1e8d3e1f05bfe5e, user_id=6a70aa6752674f8480cae59eed9103ab, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:54.235156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20423e8d-e3f3-490d-9ccd-3eacb0be0587 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:54.238728 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-7eb5ebaa-dc98-41a4-90f6-44223c447c1e None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:54.240590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-7eb5ebaa-dc98-41a4-90f6-44223c447c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:54.251414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 817/1624] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:54 2022] PUT /identity/v3/projects/aa50754cce364512b1e8d3e1f05bfe5e/users/6a70aa6752674f8480cae59eed9103ab/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:54.251580 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 808/1625] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:54.251684 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20423e8d-e3f3-490d-9ccd-3eacb0be0587 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:54.253334 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5ebaa-dc98-41a4-90f6-44223c447c1e None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:54.263596 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5ebaa-dc98-41a4-90f6-44223c447c1e None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:54.325944 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520abd8a-d641-4546-ac9a-ce60fe0e0c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:54.326558 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520abd8a-d641-4546-ac9a-ce60fe0e0c26 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:54.326838 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520abd8a-d641-4546-ac9a-ce60fe0e0c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:54.327107 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520abd8a-d641-4546-ac9a-ce60fe0e0c26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:54.327754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520abd8a-d641-4546-ac9a-ce60fe0e0c26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:41:54.328059 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520abd8a-d641-4546-ac9a-ce60fe0e0c26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:54.329651 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520abd8a-d641-4546-ac9a-ce60fe0e0c26 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:54.330552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20423e8d-e3f3-490d-9ccd-3eacb0be0587 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:54.337417 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acecd6-12f7-4f78-83ad-d4e0c19908bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:54.338121 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acecd6-12f7-4f78-83ad-d4e0c19908bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:54.338400 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acecd6-12f7-4f78-83ad-d4e0c19908bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:54.338671 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acecd6-12f7-4f78-83ad-d4e0c19908bd admin admin] PATH_INFO: `/v3/projects/6257957ab8db4b25b3f598dde66a1c97/users/94e3e06318e045fbaeda9c5063bf18d2/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:54.341129 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acecd6-12f7-4f78-83ad-d4e0c19908bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6257957ab8db4b25b3f598dde66a1c97, user_id=94e3e06318e045fbaeda9c5063bf18d2, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:54.343099 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 809/1626] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:41:54.344640 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51d7fe-40c3-47f1-8ee2-d2f18f7e9ad1 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:54.345016 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51d7fe-40c3-47f1-8ee2-d2f18f7e9ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:54.345383 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51d7fe-40c3-47f1-8ee2-d2f18f7e9ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:54.347942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acecd6-12f7-4f78-83ad-d4e0c19908bd admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:54.369877 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 818/1627] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:54 2022] PUT /identity/v3/projects/6257957ab8db4b25b3f598dde66a1c97/users/94e3e06318e045fbaeda9c5063bf18d2/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:54.369877 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acecd6-12f7-4f78-83ad-d4e0c19908bd admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:54.378617 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-7d51d7fe-40c3-47f1-8ee2-d2f18f7e9ad1 None None] MFA Rules not processed for user `6a70aa6752674f8480cae59eed9103ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:54.381293 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-7d51d7fe-40c3-47f1-8ee2-d2f18f7e9ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:54.450626 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 810/1628] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:54.452113 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c393cc-cad1-4023-b908-a92a2a3d9c0c None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:54.452403 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c393cc-cad1-4023-b908-a92a2a3d9c0c None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:54.452673 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c393cc-cad1-4023-b908-a92a2a3d9c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:54.468788 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acecd6-12f7-4f78-83ad-d4e0c19908bd admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:54.476134 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e1c08-c792-453b-bc8f-09522b160ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:54.476795 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e1c08-c792-453b-bc8f-09522b160ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:54.477026 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e1c08-c792-453b-bc8f-09522b160ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:54.477306 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e1c08-c792-453b-bc8f-09522b160ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:54.478338 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e1c08-c792-453b-bc8f-09522b160ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:54.482667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e1c08-c792-453b-bc8f-09522b160ca4 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:54.493526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-93c393cc-cad1-4023-b908-a92a2a3d9c0c None None] MFA Rules not processed for user `94e3e06318e045fbaeda9c5063bf18d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:54.495080 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-93c393cc-cad1-4023-b908-a92a2a3d9c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:54.539227 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 819/1629] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:54 2022] POST /identity/v3/projects => generated 359 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:54.540592 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e1c08-c792-453b-bc8f-09522b160ca4 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:54.572318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:54.597408 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 811/1630] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:54.599859 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c393cc-cad1-4023-b908-a92a2a3d9c0c None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:54.614354 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:54.617925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c393cc-cad1-4023-b908-a92a2a3d9c0c None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:54.636152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e1c08-c792-453b-bc8f-09522b160ca4 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:54.641544 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91072c03-94f1-4dc4-8660-3b88253732c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:54.642340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91072c03-94f1-4dc4-8660-3b88253732c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:54.642721 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91072c03-94f1-4dc4-8660-3b88253732c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:54.643092 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91072c03-94f1-4dc4-8660-3b88253732c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:54.643868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91072c03-94f1-4dc4-8660-3b88253732c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:54.646845 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91072c03-94f1-4dc4-8660-3b88253732c2 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:54.687552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 820/1631] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:54 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:54.692086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91072c03-94f1-4dc4-8660-3b88253732c2 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:54.695351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-91072c03-94f1-4dc4-8660-3b88253732c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:54.697712 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1246521-3abb-4d22-ba0b-b729250e03c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:54.698425 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1246521-3abb-4d22-ba0b-b729250e03c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:54.698713 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1246521-3abb-4d22-ba0b-b729250e03c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:54.698983 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1246521-3abb-4d22-ba0b-b729250e03c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:54.699625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1246521-3abb-4d22-ba0b-b729250e03c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:54.704772 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1246521-3abb-4d22-ba0b-b729250e03c5 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:54.738671 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 812/1632] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:54 2022] POST /identity/v3/users => generated 280 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:54.743170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1246521-3abb-4d22-ba0b-b729250e03c5 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:54.755765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1246521-3abb-4d22-ba0b-b729250e03c5 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:54.783790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91072c03-94f1-4dc4-8660-3b88253732c2 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:54.791947 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4a51e-b27a-464c-8a40-7f69460511eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:54.792729 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4a51e-b27a-464c-8a40-7f69460511eb service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:54.793188 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4a51e-b27a-464c-8a40-7f69460511eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:54.793564 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4a51e-b27a-464c-8a40-7f69460511eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:54.844980 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8391c-8ae1-4b01-8de8-1abe4164c7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:54.845613 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8391c-8ae1-4b01-8de8-1abe4164c7aa admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:54.845927 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8391c-8ae1-4b01-8de8-1abe4164c7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:54.846200 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8391c-8ae1-4b01-8de8-1abe4164c7aa admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:54.846843 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8391c-8ae1-4b01-8de8-1abe4164c7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:54.851424 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8391c-8ae1-4b01-8de8-1abe4164c7aa admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:54.887824 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 813/1633] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:54 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:54.891497 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8391c-8ae1-4b01-8de8-1abe4164c7aa admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:54.903875 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8391c-8ae1-4b01-8de8-1abe4164c7aa admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:54.909831 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ca918-3e0e-4b22-b4f2-cd8b82640b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:54.910618 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ca918-3e0e-4b22-b4f2-cd8b82640b32 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:54.911050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ca918-3e0e-4b22-b4f2-cd8b82640b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:54.912709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ca918-3e0e-4b22-b4f2-cd8b82640b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:54.913832 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ca918-3e0e-4b22-b4f2-cd8b82640b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:54.915921 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ca918-3e0e-4b22-b4f2-cd8b82640b32 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:54.934225 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4a51e-b27a-464c-8a40-7f69460511eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:54.934791 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 814/1634] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:54.934791 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ca918-3e0e-4b22-b4f2-cd8b82640b32 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:54.936199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4a51e-b27a-464c-8a40-7f69460511eb service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:54.948705 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ca918-3e0e-4b22-b4f2-cd8b82640b32 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:54.952658 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 821/1635] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:54 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:54.954132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4a51e-b27a-464c-8a40-7f69460511eb service cinder] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:54.954950 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2bd79-5820-4076-9446-1b843e3bf598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:54.956449 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2bd79-5820-4076-9446-1b843e3bf598 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:54.957452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2bd79-5820-4076-9446-1b843e3bf598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:54.957738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2bd79-5820-4076-9446-1b843e3bf598 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:54.959324 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2bd79-5820-4076-9446-1b843e3bf598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:54.962366 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2bd79-5820-4076-9446-1b843e3bf598 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:54.968738 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4a51e-b27a-464c-8a40-7f69460511eb service cinder] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:54.977343 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 815/1636] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:54.978736 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7e34a-8efc-41e8-9c0c-54c626a6aba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:54.979375 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7e34a-8efc-41e8-9c0c-54c626a6aba2 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:54.979654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7e34a-8efc-41e8-9c0c-54c626a6aba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:54.979931 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7e34a-8efc-41e8-9c0c-54c626a6aba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:54.980415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2bd79-5820-4076-9446-1b843e3bf598 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:54.980614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7e34a-8efc-41e8-9c0c-54c626a6aba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:54.982693 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7e34a-8efc-41e8-9c0c-54c626a6aba2 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:55.000137 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2bd79-5820-4076-9446-1b843e3bf598 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:55.001621 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 822/1637] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:55.004995 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7e34a-8efc-41e8-9c0c-54c626a6aba2 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:55.007394 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b19fc1-f0b0-4065-84c5-9d4e3204b316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:55.009056 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b19fc1-f0b0-4065-84c5-9d4e3204b316 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:55.009472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b19fc1-f0b0-4065-84c5-9d4e3204b316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:55.010259 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b19fc1-f0b0-4065-84c5-9d4e3204b316 admin admin] PATH_INFO: `/v3/projects/e23d03126eac46558dcf0cb6a2c8677d/users/faffed76d5d74e2dad410387dfed9fae/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:55.026511 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7e34a-8efc-41e8-9c0c-54c626a6aba2 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:55.039762 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17f9bc-cc27-4edb-bc0b-d840d868431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:55.040496 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17f9bc-cc27-4edb-bc0b-d840d868431e admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:55.041383 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17f9bc-cc27-4edb-bc0b-d840d868431e admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:55.042224 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17f9bc-cc27-4edb-bc0b-d840d868431e admin admin] PATH_INFO: `/v3/projects/42340a4d148e42a484fdf56e250b8670/users/2bc748aea3f84780813cf0362f6ad2c4/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:55.044374 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b19fc1-f0b0-4065-84c5-9d4e3204b316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23d03126eac46558dcf0cb6a2c8677d, user_id=faffed76d5d74e2dad410387dfed9fae, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:55.056330 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b19fc1-f0b0-4065-84c5-9d4e3204b316 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:55.064805 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17f9bc-cc27-4edb-bc0b-d840d868431e admin admin] RBAC: Authorizing `identity:create_grant(project_id=42340a4d148e42a484fdf56e250b8670, user_id=2bc748aea3f84780813cf0362f6ad2c4, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:55.069903 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17f9bc-cc27-4edb-bc0b-d840d868431e admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:55.089457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 823/1638] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:55 2022] PUT /identity/v3/projects/42340a4d148e42a484fdf56e250b8670/users/2bc748aea3f84780813cf0362f6ad2c4/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:41:55.090020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 816/1639] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:54 2022] PUT /identity/v3/projects/e23d03126eac46558dcf0cb6a2c8677d/users/faffed76d5d74e2dad410387dfed9fae/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:55.100751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad3be9-fae9-4d2b-b169-b19d59ac80b8 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:55.101173 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad3be9-fae9-4d2b-b169-b19d59ac80b8 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:55.101549 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad3be9-fae9-4d2b-b169-b19d59ac80b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:55.103617 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b19fc1-f0b0-4065-84c5-9d4e3204b316 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:55.148919 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:55.187653 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-2aad3be9-fae9-4d2b-b169-b19d59ac80b8 None None] MFA Rules not processed for user `2bc748aea3f84780813cf0362f6ad2c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:55.189061 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2aad3be9-fae9-4d2b-b169-b19d59ac80b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:55.231686 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b19fc1-f0b0-4065-84c5-9d4e3204b316 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:55.253529 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:55.289107 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 824/1640] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:55.290192 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad3be9-fae9-4d2b-b169-b19d59ac80b8 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:55.306666 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a13b38-c470-4b53-9a59-0770943f3aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:55.307931 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a13b38-c470-4b53-9a59-0770943f3aea admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:55.308285 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a13b38-c470-4b53-9a59-0770943f3aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:55.308622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a13b38-c470-4b53-9a59-0770943f3aea admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:55.309431 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a13b38-c470-4b53-9a59-0770943f3aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:55.311097 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a13b38-c470-4b53-9a59-0770943f3aea admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:55.323207 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 817/1641] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:55.327344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a13b38-c470-4b53-9a59-0770943f3aea admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:55.338853 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a13b38-c470-4b53-9a59-0770943f3aea admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:55.344215 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349aff74-e6bb-48fc-9222-66cff3cf9d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:55.345884 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349aff74-e6bb-48fc-9222-66cff3cf9d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:55.345884 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349aff74-e6bb-48fc-9222-66cff3cf9d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:55.345884 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349aff74-e6bb-48fc-9222-66cff3cf9d66 admin admin] PATH_INFO: `/v3/projects/e23d03126eac46558dcf0cb6a2c8677d/users/faffed76d5d74e2dad410387dfed9fae/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:55.347422 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349aff74-e6bb-48fc-9222-66cff3cf9d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23d03126eac46558dcf0cb6a2c8677d, user_id=faffed76d5d74e2dad410387dfed9fae, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:55.350944 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349aff74-e6bb-48fc-9222-66cff3cf9d66 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:55.363047 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 818/1642] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:55 2022] PUT /identity/v3/projects/e23d03126eac46558dcf0cb6a2c8677d/users/faffed76d5d74e2dad410387dfed9fae/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:41:55.363848 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349aff74-e6bb-48fc-9222-66cff3cf9d66 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:55.365470 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad3be9-fae9-4d2b-b169-b19d59ac80b8 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:55.373184 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-349aff74-e6bb-48fc-9222-66cff3cf9d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:55.427642 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c1bc4-1a58-490b-be34-0862a5964355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:55.428530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c1bc4-1a58-490b-be34-0862a5964355 service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:55.428903 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c1bc4-1a58-490b-be34-0862a5964355 service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:55.429250 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c1bc4-1a58-490b-be34-0862a5964355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:55.431235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-cb5c1bc4-1a58-490b-be34-0862a5964355 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:55.446460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349aff74-e6bb-48fc-9222-66cff3cf9d66 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:55.450536 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e11916-5bf1-482c-a282-2dc54e7388a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:55.450965 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e11916-5bf1-482c-a282-2dc54e7388a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:55.451276 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e11916-5bf1-482c-a282-2dc54e7388a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:55.451549 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e11916-5bf1-482c-a282-2dc54e7388a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:55.505201 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c1bc4-1a58-490b-be34-0862a5964355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:55.506696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c1bc4-1a58-490b-be34-0862a5964355 service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:55.518293 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 825/1643] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:55 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:55.519946 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15842d2f-7c04-433e-bd03-1e16a3130545 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:55.520294 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15842d2f-7c04-433e-bd03-1e16a3130545 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:55.520573 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15842d2f-7c04-433e-bd03-1e16a3130545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:55.529978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e11916-5bf1-482c-a282-2dc54e7388a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:55.531669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e11916-5bf1-482c-a282-2dc54e7388a0 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:55.546581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 819/1644] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:55 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:55.550157 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-15842d2f-7c04-433e-bd03-1e16a3130545 None None] MFA Rules not processed for user `faffed76d5d74e2dad410387dfed9fae`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:55.551801 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-15842d2f-7c04-433e-bd03-1e16a3130545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:55.566459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e11916-5bf1-482c-a282-2dc54e7388a0 service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:55.579979 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:55.601698 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:55.658751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 826/1645] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:55.664258 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e11916-5bf1-482c-a282-2dc54e7388a0 service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:55.673203 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea16998-d948-476d-8bd4-51aa4447c90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:55.673891 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea16998-d948-476d-8bd4-51aa4447c90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:55.674303 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea16998-d948-476d-8bd4-51aa4447c90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:55.674589 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea16998-d948-476d-8bd4-51aa4447c90f admin admin] PATH_INFO: `/v3/users/2bc748aea3f84780813cf0362f6ad2c4` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:55.675838 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea16998-d948-476d-8bd4-51aa4447c90f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc748aea3f84780813cf0362f6ad2c4)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:55.678710 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea16998-d948-476d-8bd4-51aa4447c90f admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:55.679250 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15842d2f-7c04-433e-bd03-1e16a3130545 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:55.690570 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15842d2f-7c04-433e-bd03-1e16a3130545 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:55.696337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb0f55-ce75-47ff-a417-7bfbbee97c9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:55.696958 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb0f55-ce75-47ff-a417-7bfbbee97c9e service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:55.697242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb0f55-ce75-47ff-a417-7bfbbee97c9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:55.697657 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb0f55-ce75-47ff-a417-7bfbbee97c9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:55.765263 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0ea16998-d948-476d-8bd4-51aa4447c90f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc748aea3f84780813cf0362f6ad2c4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:55.776240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0ea16998-d948-476d-8bd4-51aa4447c90f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc748aea3f84780813cf0362f6ad2c4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:55.776240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0ea16998-d948-476d-8bd4-51aa4447c90f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc748aea3f84780813cf0362f6ad2c4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:55.776240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0ea16998-d948-476d-8bd4-51aa4447c90f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc748aea3f84780813cf0362f6ad2c4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:55.787779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0ea16998-d948-476d-8bd4-51aa4447c90f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc748aea3f84780813cf0362f6ad2c4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:55.800300 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb0f55-ce75-47ff-a417-7bfbbee97c9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:55.803651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb0f55-ce75-47ff-a417-7bfbbee97c9e service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:55.814405 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 820/1646] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:41:55 2022] DELETE /identity/v3/users/2bc748aea3f84780813cf0362f6ad2c4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:55.820010 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f30239-0180-4300-865a-d3e19ee5b694 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:55.820573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f30239-0180-4300-865a-d3e19ee5b694 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:55.820973 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f30239-0180-4300-865a-d3e19ee5b694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:55.837646 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 827/1647] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:41:55.847621 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-a7f30239-0180-4300-865a-d3e19ee5b694 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:55.849126 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a7f30239-0180-4300-865a-d3e19ee5b694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:55.971091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 821/1648] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:55.978850 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb0f55-ce75-47ff-a417-7bfbbee97c9e service cinder] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:55.980749 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-75eb0f55-ce75-47ff-a417-7bfbbee97c9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:56.086140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb0f55-ce75-47ff-a417-7bfbbee97c9e service cinder] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:56.156471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5129b6-9aa5-4963-8723-f78f6155b967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:56.157755 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5129b6-9aa5-4963-8723-f78f6155b967 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:56.158265 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5129b6-9aa5-4963-8723-f78f6155b967 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:56.158740 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5129b6-9aa5-4963-8723-f78f6155b967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:56.189415 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5129b6-9aa5-4963-8723-f78f6155b967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:56.192027 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5129b6-9aa5-4963-8723-f78f6155b967 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:56.204945 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 828/1649] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:56.621576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f30239-0180-4300-865a-d3e19ee5b694 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:56.623302 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a7f30239-0180-4300-865a-d3e19ee5b694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:56.642606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f30239-0180-4300-865a-d3e19ee5b694 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:56.648965 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170ff90-aed9-44c6-aaa4-e36a62b9369b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:56.649596 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170ff90-aed9-44c6-aaa4-e36a62b9369b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:56.649958 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170ff90-aed9-44c6-aaa4-e36a62b9369b admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:56.650159 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170ff90-aed9-44c6-aaa4-e36a62b9369b admin admin] PATH_INFO: `/v3/projects/42340a4d148e42a484fdf56e250b8670` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:56.651473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170ff90-aed9-44c6-aaa4-e36a62b9369b admin admin] RBAC: Authorizing `identity:delete_project(project_id=42340a4d148e42a484fdf56e250b8670)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:56.653385 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170ff90-aed9-44c6-aaa4-e36a62b9369b admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:56.681706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:56.713471 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8170ff90-aed9-44c6-aaa4-e36a62b9369b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42340a4d148e42a484fdf56e250b8670', 'request_id': 'req-8170ff90-aed9-44c6-aaa4-e36a62b9369b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:56.721250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8170ff90-aed9-44c6-aaa4-e36a62b9369b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42340a4d148e42a484fdf56e250b8670', 'request_id': 'req-8170ff90-aed9-44c6-aaa4-e36a62b9369b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:56.730344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8170ff90-aed9-44c6-aaa4-e36a62b9369b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42340a4d148e42a484fdf56e250b8670', 'request_id': 'req-8170ff90-aed9-44c6-aaa4-e36a62b9369b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:56.742239 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8170ff90-aed9-44c6-aaa4-e36a62b9369b admin admin] The token cache is being invalidate because project 42340a4d148e42a484fdf56e250b8670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:41:56.742538 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8170ff90-aed9-44c6-aaa4-e36a62b9369b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:56.743194 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8170ff90-aed9-44c6-aaa4-e36a62b9369b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:41:56.744656 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 822/1650] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:41:56 2022] DELETE /identity/v3/projects/42340a4d148e42a484fdf56e250b8670 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:56.749558 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f490ec1-3091-4107-b748-7cc71c853d3a None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:56.749860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f490ec1-3091-4107-b748-7cc71c853d3a None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:56.750182 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f490ec1-3091-4107-b748-7cc71c853d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:56.771260 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-9f490ec1-3091-4107-b748-7cc71c853d3a None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:56.772494 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-9f490ec1-3091-4107-b748-7cc71c853d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:56.800385 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:56.837868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 829/1651] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:56.845973 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef835f-a2b3-4c59-b72f-0d347a082ebb None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:56.846449 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef835f-a2b3-4c59-b72f-0d347a082ebb None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:56.846727 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef835f-a2b3-4c59-b72f-0d347a082ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:56.867725 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-35ef835f-a2b3-4c59-b72f-0d347a082ebb None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:56.868922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-35ef835f-a2b3-4c59-b72f-0d347a082ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:56.876882 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 823/1652] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:56.881247 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f490ec1-3091-4107-b748-7cc71c853d3a None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:56.891125 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f490ec1-3091-4107-b748-7cc71c853d3a None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:56.896111 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8488ca-f6af-4f38-95c3-6099c5bd77bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:56.896909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8488ca-f6af-4f38-95c3-6099c5bd77bd admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:56.897021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8488ca-f6af-4f38-95c3-6099c5bd77bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:56.897256 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8488ca-f6af-4f38-95c3-6099c5bd77bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:56.897956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8488ca-f6af-4f38-95c3-6099c5bd77bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:41:56.898261 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8488ca-f6af-4f38-95c3-6099c5bd77bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:56.900058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8488ca-f6af-4f38-95c3-6099c5bd77bd admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:56.918243 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 830/1653] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:41:56.921325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef835f-a2b3-4c59-b72f-0d347a082ebb None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:56.935208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef835f-a2b3-4c59-b72f-0d347a082ebb None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:56.939903 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0ca4d-44bf-4188-9dc8-83a4715f631c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:56.940511 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0ca4d-44bf-4188-9dc8-83a4715f631c admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:56.940784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0ca4d-44bf-4188-9dc8-83a4715f631c admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:56.941053 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0ca4d-44bf-4188-9dc8-83a4715f631c admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:56.941680 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0ca4d-44bf-4188-9dc8-83a4715f631c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:56.943796 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0ca4d-44bf-4188-9dc8-83a4715f631c admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:56.977107 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 824/1654] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:41:56 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:56.978292 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8488ca-f6af-4f38-95c3-6099c5bd77bd admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:56.989226 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8488ca-f6af-4f38-95c3-6099c5bd77bd admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:57.176507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a775bea-cffd-4c3c-9548-8b4323cec2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:57.177654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a775bea-cffd-4c3c-9548-8b4323cec2da admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:57.177974 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a775bea-cffd-4c3c-9548-8b4323cec2da admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:57.178243 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a775bea-cffd-4c3c-9548-8b4323cec2da admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:57.178897 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a775bea-cffd-4c3c-9548-8b4323cec2da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:57.180840 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a775bea-cffd-4c3c-9548-8b4323cec2da admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:57.214537 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 831/1655] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:41:56 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:41:57.215733 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0ca4d-44bf-4188-9dc8-83a4715f631c admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:57.238968 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0ca4d-44bf-4188-9dc8-83a4715f631c admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:57.247081 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd02bf-9998-4819-8860-342997d039f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:57.247894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd02bf-9998-4819-8860-342997d039f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:57.248262 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd02bf-9998-4819-8860-342997d039f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:57.248674 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd02bf-9998-4819-8860-342997d039f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:57.249539 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd02bf-9998-4819-8860-342997d039f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:57.251488 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd02bf-9998-4819-8860-342997d039f3 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:57.268774 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 825/1656] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:57.273527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a775bea-cffd-4c3c-9548-8b4323cec2da admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:57.292004 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a775bea-cffd-4c3c-9548-8b4323cec2da admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:57.300647 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87637941-4c2a-4dde-a129-e2fcb7bf4f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:57.301453 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87637941-4c2a-4dde-a129-e2fcb7bf4f4e admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:57.302069 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87637941-4c2a-4dde-a129-e2fcb7bf4f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:57.302449 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87637941-4c2a-4dde-a129-e2fcb7bf4f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:57.303465 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87637941-4c2a-4dde-a129-e2fcb7bf4f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:57.305644 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87637941-4c2a-4dde-a129-e2fcb7bf4f4e admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:57.338588 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 832/1657] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:41:57.341971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd02bf-9998-4819-8860-342997d039f3 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:57.372407 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd02bf-9998-4819-8860-342997d039f3 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:57.396362 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee18cf0-7349-4e61-8ba8-e5445783f439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:57.397509 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee18cf0-7349-4e61-8ba8-e5445783f439 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:57.397982 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee18cf0-7349-4e61-8ba8-e5445783f439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:57.398605 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee18cf0-7349-4e61-8ba8-e5445783f439 admin admin] PATH_INFO: `/v3/projects/472237e6dfa74f2ea65e7f935c797ace/users/8ed7e68f243f44f4886ccf366b49ae6a/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:57.427016 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee18cf0-7349-4e61-8ba8-e5445783f439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=472237e6dfa74f2ea65e7f935c797ace, user_id=8ed7e68f243f44f4886ccf366b49ae6a, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:57.430366 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee18cf0-7349-4e61-8ba8-e5445783f439 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:57.453526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 826/1658] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:41:57 2022] PUT /identity/v3/projects/472237e6dfa74f2ea65e7f935c797ace/users/8ed7e68f243f44f4886ccf366b49ae6a/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:41:57.463208 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8a855-128c-4ffc-80fd-3f7acfe0c329 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:57.463495 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8a855-128c-4ffc-80fd-3f7acfe0c329 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:57.463759 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8a855-128c-4ffc-80fd-3f7acfe0c329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:57.478922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee18cf0-7349-4e61-8ba8-e5445783f439 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:57.480634 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-aee18cf0-7349-4e61-8ba8-e5445783f439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:57.483556 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-03b8a855-128c-4ffc-80fd-3f7acfe0c329 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:57.484715 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-03b8a855-128c-4ffc-80fd-3f7acfe0c329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:57.553222 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 833/1659] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:57.559191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee18cf0-7349-4e61-8ba8-e5445783f439 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:57.560028 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8a855-128c-4ffc-80fd-3f7acfe0c329 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:57.561591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-03b8a855-128c-4ffc-80fd-3f7acfe0c329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:57.563110 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0328247-61b1-4ec2-9633-e5d7f4c1e2fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:57.563962 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0328247-61b1-4ec2-9633-e5d7f4c1e2fa service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:57.564419 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0328247-61b1-4ec2-9633-e5d7f4c1e2fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:57.564719 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0328247-61b1-4ec2-9633-e5d7f4c1e2fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:57.566714 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a0328247-61b1-4ec2-9633-e5d7f4c1e2fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:57.610555 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:57.635282 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8a855-128c-4ffc-80fd-3f7acfe0c329 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:57.639789 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a0448-f7c8-4293-bdd0-d67bbd97069a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:57.640611 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a0448-f7c8-4293-bdd0-d67bbd97069a service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:57.641072 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a0448-f7c8-4293-bdd0-d67bbd97069a service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:57.641377 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a0448-f7c8-4293-bdd0-d67bbd97069a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:57.650851 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0328247-61b1-4ec2-9633-e5d7f4c1e2fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:57.652300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0328247-61b1-4ec2-9633-e5d7f4c1e2fa service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:57.657443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a0448-f7c8-4293-bdd0-d67bbd97069a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:57.659017 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a0448-f7c8-4293-bdd0-d67bbd97069a service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:57.660819 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:57.680615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 827/1660] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:41:57.686066 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 834/1661] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:41:58.457753 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d949fdf-61fc-4c23-9c7d-2426fc2a7906 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:58.458105 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d949fdf-61fc-4c23-9c7d-2426fc2a7906 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:58.458784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d949fdf-61fc-4c23-9c7d-2426fc2a7906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:58.499600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-8d949fdf-61fc-4c23-9c7d-2426fc2a7906 None None] MFA Rules not processed for user `8ed7e68f243f44f4886ccf366b49ae6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:41:58.504430 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-8d949fdf-61fc-4c23-9c7d-2426fc2a7906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:58.643742 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 828/1662] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:41:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:41:58.663659 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a0448-f7c8-4293-bdd0-d67bbd97069a service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:41:58.665376 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-c65a0448-f7c8-4293-bdd0-d67bbd97069a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:41:58.688027 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a0448-f7c8-4293-bdd0-d67bbd97069a service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:41:58.695703 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeddf81-9854-4803-ad46-c722d5a19d3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:41:58.696444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeddf81-9854-4803-ad46-c722d5a19d3f service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:41:58.696822 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeddf81-9854-4803-ad46-c722d5a19d3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:41:58.697185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeddf81-9854-4803-ad46-c722d5a19d3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:41:58.709591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeddf81-9854-4803-ad46-c722d5a19d3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:41:58.712365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeddf81-9854-4803-ad46-c722d5a19d3f service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:41:58.738022 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 835/1663] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:41:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:00.326921 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66150c83-084e-416d-b0b1-48ff8c5e19d2 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:00.327418 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66150c83-084e-416d-b0b1-48ff8c5e19d2 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:00.327418 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66150c83-084e-416d-b0b1-48ff8c5e19d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:00.355877 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-66150c83-084e-416d-b0b1-48ff8c5e19d2 None None] MFA Rules not processed for user `8ed7e68f243f44f4886ccf366b49ae6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:00.357469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-66150c83-084e-416d-b0b1-48ff8c5e19d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:00.367646 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 829/1664] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:01.768703 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeddf81-9854-4803-ad46-c722d5a19d3f service cinder] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:01.770811 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-eeeddf81-9854-4803-ad46-c722d5a19d3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:01.798883 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeddf81-9854-4803-ad46-c722d5a19d3f service cinder] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:01.813015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf786212-4469-4bc3-ad1d-e02bd77d5b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:01.813948 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf786212-4469-4bc3-ad1d-e02bd77d5b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:01.814398 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf786212-4469-4bc3-ad1d-e02bd77d5b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:01.814799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf786212-4469-4bc3-ad1d-e02bd77d5b26 admin admin] PATH_INFO: `/v3/users/9cf19b9f0a684041a439765000dcb6c2` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:01.818620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf786212-4469-4bc3-ad1d-e02bd77d5b26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cf19b9f0a684041a439765000dcb6c2)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:01.821056 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf786212-4469-4bc3-ad1d-e02bd77d5b26 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:01.860823 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66150c83-084e-416d-b0b1-48ff8c5e19d2 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:01.867446 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-66150c83-084e-416d-b0b1-48ff8c5e19d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:01.891519 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66150c83-084e-416d-b0b1-48ff8c5e19d2 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:01.901224 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450c9ce-baf1-43db-9de5-30d87e5742bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:01.902113 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450c9ce-baf1-43db-9de5-30d87e5742bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:01.902564 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450c9ce-baf1-43db-9de5-30d87e5742bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:01.903003 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450c9ce-baf1-43db-9de5-30d87e5742bd admin admin] PATH_INFO: `/v3/users/6a70aa6752674f8480cae59eed9103ab` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:01.904365 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450c9ce-baf1-43db-9de5-30d87e5742bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a70aa6752674f8480cae59eed9103ab)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:01.906572 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450c9ce-baf1-43db-9de5-30d87e5742bd admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:01.921277 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-cf786212-4469-4bc3-ad1d-e02bd77d5b26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cf19b9f0a684041a439765000dcb6c2'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:01.935860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-cf786212-4469-4bc3-ad1d-e02bd77d5b26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cf19b9f0a684041a439765000dcb6c2'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:01.955549 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-cf786212-4469-4bc3-ad1d-e02bd77d5b26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cf19b9f0a684041a439765000dcb6c2'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:01.956300 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-cf786212-4469-4bc3-ad1d-e02bd77d5b26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cf19b9f0a684041a439765000dcb6c2'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:01.972883 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-cf786212-4469-4bc3-ad1d-e02bd77d5b26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cf19b9f0a684041a439765000dcb6c2'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:01.985314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 836/1665] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:01 2022] DELETE /identity/v3/users/9cf19b9f0a684041a439765000dcb6c2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:01.989796 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7196db-b2b1-42f1-a728-44ae3cbf49d9 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:01.990161 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7196db-b2b1-42f1-a728-44ae3cbf49d9 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:01.990532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7196db-b2b1-42f1-a728-44ae3cbf49d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:02.013450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-7b7196db-b2b1-42f1-a728-44ae3cbf49d9 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:02.014825 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-7b7196db-b2b1-42f1-a728-44ae3cbf49d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:02.022656 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1450c9ce-baf1-43db-9de5-30d87e5742bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a70aa6752674f8480cae59eed9103ab'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:02.042484 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1450c9ce-baf1-43db-9de5-30d87e5742bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a70aa6752674f8480cae59eed9103ab'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:02.043609 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1450c9ce-baf1-43db-9de5-30d87e5742bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a70aa6752674f8480cae59eed9103ab'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:02.046002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1450c9ce-baf1-43db-9de5-30d87e5742bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a70aa6752674f8480cae59eed9103ab'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:02.073680 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1450c9ce-baf1-43db-9de5-30d87e5742bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a70aa6752674f8480cae59eed9103ab'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:02.102472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 830/1666] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:01 2022] DELETE /identity/v3/users/6a70aa6752674f8480cae59eed9103ab => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:02.106994 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ec3de-c063-41fc-a334-94e143e007bf None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:02.107703 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ec3de-c063-41fc-a334-94e143e007bf None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:02.109188 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ec3de-c063-41fc-a334-94e143e007bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:02.127026 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 837/1667] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:02.137246 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-921ec3de-c063-41fc-a334-94e143e007bf None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:02.138474 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-921ec3de-c063-41fc-a334-94e143e007bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:02.141802 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7196db-b2b1-42f1-a728-44ae3cbf49d9 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:02.143245 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-7b7196db-b2b1-42f1-a728-44ae3cbf49d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:02.220337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:02.225478 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:02.245283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7196db-b2b1-42f1-a728-44ae3cbf49d9 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:02.249122 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 831/1668] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:02.256590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ec3de-c063-41fc-a334-94e143e007bf None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:02.341336 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568c84c-a146-4e6c-90c0-b957a7848974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:02.342222 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568c84c-a146-4e6c-90c0-b957a7848974 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:02.342315 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568c84c-a146-4e6c-90c0-b957a7848974 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:02.342571 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568c84c-a146-4e6c-90c0-b957a7848974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:02.353455 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568c84c-a146-4e6c-90c0-b957a7848974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:02.357094 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568c84c-a146-4e6c-90c0-b957a7848974 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:02.361394 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ec3de-c063-41fc-a334-94e143e007bf None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:02.366860 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a5f75-636c-4c34-9ff4-af4f3a77e8b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:02.367969 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a5f75-636c-4c34-9ff4-af4f3a77e8b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:02.368494 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a5f75-636c-4c34-9ff4-af4f3a77e8b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:02.368933 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a5f75-636c-4c34-9ff4-af4f3a77e8b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:02.378068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 838/1669] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:02.380986 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a5f75-636c-4c34-9ff4-af4f3a77e8b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:02.382532 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a5f75-636c-4c34-9ff4-af4f3a77e8b7 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:02.432143 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 832/1670] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:02.905292 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568c84c-a146-4e6c-90c0-b957a7848974 service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:02.906925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-8568c84c-a146-4e6c-90c0-b957a7848974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:02.931841 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568c84c-a146-4e6c-90c0-b957a7848974 service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:02.941768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85835a84-dc47-4cd7-9fd9-018d573454b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:02.943202 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85835a84-dc47-4cd7-9fd9-018d573454b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:02.943588 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85835a84-dc47-4cd7-9fd9-018d573454b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:02.944073 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85835a84-dc47-4cd7-9fd9-018d573454b9 admin admin] PATH_INFO: `/v3/projects/d4b5b097b4774da796cf58112b12d563` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:02.945767 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85835a84-dc47-4cd7-9fd9-018d573454b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b5b097b4774da796cf58112b12d563)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:02.948817 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85835a84-dc47-4cd7-9fd9-018d573454b9 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:02.967699 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a5f75-636c-4c34-9ff4-af4f3a77e8b7 service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:02.969662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-ce6a5f75-636c-4c34-9ff4-af4f3a77e8b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:03.011232 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a5f75-636c-4c34-9ff4-af4f3a77e8b7 service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:03.025809 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928cd87-b53d-4c38-bb42-542b5d1817fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:03.027883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928cd87-b53d-4c38-bb42-542b5d1817fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:03.028877 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928cd87-b53d-4c38-bb42-542b5d1817fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:03.029288 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928cd87-b53d-4c38-bb42-542b5d1817fe admin admin] PATH_INFO: `/v3/projects/aa50754cce364512b1e8d3e1f05bfe5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:03.032932 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928cd87-b53d-4c38-bb42-542b5d1817fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa50754cce364512b1e8d3e1f05bfe5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:03.044639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928cd87-b53d-4c38-bb42-542b5d1817fe admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:03.066416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-85835a84-dc47-4cd7-9fd9-018d573454b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b5b097b4774da796cf58112b12d563', 'request_id': 'req-85835a84-dc47-4cd7-9fd9-018d573454b9'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:03.100003 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-85835a84-dc47-4cd7-9fd9-018d573454b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b5b097b4774da796cf58112b12d563', 'request_id': 'req-85835a84-dc47-4cd7-9fd9-018d573454b9'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:03.113393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-85835a84-dc47-4cd7-9fd9-018d573454b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b5b097b4774da796cf58112b12d563', 'request_id': 'req-85835a84-dc47-4cd7-9fd9-018d573454b9'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:03.129197 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d928cd87-b53d-4c38-bb42-542b5d1817fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa50754cce364512b1e8d3e1f05bfe5e', 'request_id': 'req-d928cd87-b53d-4c38-bb42-542b5d1817fe'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:03.135935 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-85835a84-dc47-4cd7-9fd9-018d573454b9 admin admin] The token cache is being invalidate because project d4b5b097b4774da796cf58112b12d563 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:03.136357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-85835a84-dc47-4cd7-9fd9-018d573454b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:03.137014 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-85835a84-dc47-4cd7-9fd9-018d573454b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:03.142032 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 839/1671] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:02 2022] DELETE /identity/v3/projects/d4b5b097b4774da796cf58112b12d563 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:03.143689 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85835a84-dc47-4cd7-9fd9-018d573454b9 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:03.146690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-85835a84-dc47-4cd7-9fd9-018d573454b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:03.158642 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d928cd87-b53d-4c38-bb42-542b5d1817fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa50754cce364512b1e8d3e1f05bfe5e', 'request_id': 'req-d928cd87-b53d-4c38-bb42-542b5d1817fe'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:03.189354 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d928cd87-b53d-4c38-bb42-542b5d1817fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa50754cce364512b1e8d3e1f05bfe5e', 'request_id': 'req-d928cd87-b53d-4c38-bb42-542b5d1817fe'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:03.206277 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d928cd87-b53d-4c38-bb42-542b5d1817fe admin admin] The token cache is being invalidate because project aa50754cce364512b1e8d3e1f05bfe5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:03.206865 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d928cd87-b53d-4c38-bb42-542b5d1817fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:03.209030 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d928cd87-b53d-4c38-bb42-542b5d1817fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:03.211252 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 833/1672] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:02 2022] DELETE /identity/v3/projects/aa50754cce364512b1e8d3e1f05bfe5e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:42:03.215087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928cd87-b53d-4c38-bb42-542b5d1817fe admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:03.217864 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d928cd87-b53d-4c38-bb42-542b5d1817fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:03.264047 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85835a84-dc47-4cd7-9fd9-018d573454b9 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:03.297329 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:03.306600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928cd87-b53d-4c38-bb42-542b5d1817fe admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:03.312566 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacb721-59af-4103-b361-1accd2d62004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:03.313544 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacb721-59af-4103-b361-1accd2d62004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:03.314134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacb721-59af-4103-b361-1accd2d62004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:03.314679 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacb721-59af-4103-b361-1accd2d62004 admin admin] PATH_INFO: `/v3/users/faffed76d5d74e2dad410387dfed9fae` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:03.316071 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aacb721-59af-4103-b361-1accd2d62004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faffed76d5d74e2dad410387dfed9fae)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:03.319171 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aacb721-59af-4103-b361-1accd2d62004 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:03.335110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9d8a8-8137-4db4-96fa-93896d2fd58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:03.335747 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9d8a8-8137-4db4-96fa-93896d2fd58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:03.336027 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9d8a8-8137-4db4-96fa-93896d2fd58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:03.336301 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9d8a8-8137-4db4-96fa-93896d2fd58e admin admin] PATH_INFO: `/v3/users/94e3e06318e045fbaeda9c5063bf18d2` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:03.337434 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9d8a8-8137-4db4-96fa-93896d2fd58e admin admin] RBAC: Authorizing `identity:delete_user(user_id=94e3e06318e045fbaeda9c5063bf18d2)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:03.339396 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9d8a8-8137-4db4-96fa-93896d2fd58e admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:03.350890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:03.384618 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1aacb721-59af-4103-b361-1accd2d62004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faffed76d5d74e2dad410387dfed9fae'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:03.394584 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1aacb721-59af-4103-b361-1accd2d62004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faffed76d5d74e2dad410387dfed9fae'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:03.395561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-d9c9d8a8-8137-4db4-96fa-93896d2fd58e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94e3e06318e045fbaeda9c5063bf18d2'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:03.395862 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1aacb721-59af-4103-b361-1accd2d62004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faffed76d5d74e2dad410387dfed9fae'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:03.396493 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1aacb721-59af-4103-b361-1accd2d62004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faffed76d5d74e2dad410387dfed9fae'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:03.404684 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-d9c9d8a8-8137-4db4-96fa-93896d2fd58e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94e3e06318e045fbaeda9c5063bf18d2'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:03.407411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1aacb721-59af-4103-b361-1accd2d62004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faffed76d5d74e2dad410387dfed9fae'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:03.422250 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-d9c9d8a8-8137-4db4-96fa-93896d2fd58e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94e3e06318e045fbaeda9c5063bf18d2'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:03.422956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-d9c9d8a8-8137-4db4-96fa-93896d2fd58e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94e3e06318e045fbaeda9c5063bf18d2'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:03.436006 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 834/1673] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:03 2022] DELETE /identity/v3/users/faffed76d5d74e2dad410387dfed9fae => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:42:03.443416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-d9c9d8a8-8137-4db4-96fa-93896d2fd58e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94e3e06318e045fbaeda9c5063bf18d2'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:03.450983 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 840/1674] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:03 2022] DELETE /identity/v3/users/94e3e06318e045fbaeda9c5063bf18d2 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:03.758845 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacb721-59af-4103-b361-1accd2d62004 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:03.760403 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-1aacb721-59af-4103-b361-1accd2d62004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:03.838865 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacb721-59af-4103-b361-1accd2d62004 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:03.897640 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7988c-b321-4137-8133-b7b3820b7d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:03.898623 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7988c-b321-4137-8133-b7b3820b7d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:03.898999 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7988c-b321-4137-8133-b7b3820b7d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:03.899467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7988c-b321-4137-8133-b7b3820b7d9c admin admin] PATH_INFO: `/v3/projects/6257957ab8db4b25b3f598dde66a1c97` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:03.901109 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7988c-b321-4137-8133-b7b3820b7d9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6257957ab8db4b25b3f598dde66a1c97)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:03.904359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7988c-b321-4137-8133-b7b3820b7d9c admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:03.983280 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:03.989919 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a4a7988c-b321-4137-8133-b7b3820b7d9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6257957ab8db4b25b3f598dde66a1c97', 'request_id': 'req-a4a7988c-b321-4137-8133-b7b3820b7d9c'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:04.024800 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a4a7988c-b321-4137-8133-b7b3820b7d9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6257957ab8db4b25b3f598dde66a1c97', 'request_id': 'req-a4a7988c-b321-4137-8133-b7b3820b7d9c'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:04.041550 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a4a7988c-b321-4137-8133-b7b3820b7d9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6257957ab8db4b25b3f598dde66a1c97', 'request_id': 'req-a4a7988c-b321-4137-8133-b7b3820b7d9c'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:04.059927 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a4a7988c-b321-4137-8133-b7b3820b7d9c admin admin] The token cache is being invalidate because project 6257957ab8db4b25b3f598dde66a1c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:04.060248 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a4a7988c-b321-4137-8133-b7b3820b7d9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:04.061472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a4a7988c-b321-4137-8133-b7b3820b7d9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:04.063591 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 835/1675] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:03 2022] DELETE /identity/v3/projects/6257957ab8db4b25b3f598dde66a1c97 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:04.069067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b6fd4-8075-41c5-828b-020b0f61bf5b None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:04.069557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b6fd4-8075-41c5-828b-020b0f61bf5b None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:04.069632 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b6fd4-8075-41c5-828b-020b0f61bf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:04.105999 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-103b6fd4-8075-41c5-828b-020b0f61bf5b None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:04.107925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-103b6fd4-8075-41c5-828b-020b0f61bf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:04.168414 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7988c-b321-4137-8133-b7b3820b7d9c admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:04.171622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a4a7988c-b321-4137-8133-b7b3820b7d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:04.289793 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 841/1676] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:04.294127 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9601acc-bcc6-4a93-8aaf-2cf81a3d17e6 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:04.294420 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9601acc-bcc6-4a93-8aaf-2cf81a3d17e6 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:04.294702 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9601acc-bcc6-4a93-8aaf-2cf81a3d17e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:04.320448 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-b9601acc-bcc6-4a93-8aaf-2cf81a3d17e6 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:04.321748 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b9601acc-bcc6-4a93-8aaf-2cf81a3d17e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:04.335139 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 842/1677] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:04.336445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9601acc-bcc6-4a93-8aaf-2cf81a3d17e6 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:04.343487 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7988c-b321-4137-8133-b7b3820b7d9c admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:04.352451 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9601acc-bcc6-4a93-8aaf-2cf81a3d17e6 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:04.354939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb8603-6017-4530-9a40-b60b45f686d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:04.355622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb8603-6017-4530-9a40-b60b45f686d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:04.356000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb8603-6017-4530-9a40-b60b45f686d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:04.356275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb8603-6017-4530-9a40-b60b45f686d3 admin admin] PATH_INFO: `/v3/projects/e23d03126eac46558dcf0cb6a2c8677d` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:04.359184 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c17482-b093-4710-a0ce-d28360d497b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:04.359289 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb8603-6017-4530-9a40-b60b45f686d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e23d03126eac46558dcf0cb6a2c8677d)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:04.359971 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c17482-b093-4710-a0ce-d28360d497b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:04.360254 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c17482-b093-4710-a0ce-d28360d497b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:04.360525 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c17482-b093-4710-a0ce-d28360d497b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:04.361170 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c17482-b093-4710-a0ce-d28360d497b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:42:04.361469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c17482-b093-4710-a0ce-d28360d497b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:04.363198 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c17482-b093-4710-a0ce-d28360d497b3 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:04.366087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb8603-6017-4530-9a40-b60b45f686d3 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:04.380303 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 843/1678] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:42:04.388411 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c17482-b093-4710-a0ce-d28360d497b3 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:04.403247 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c17482-b093-4710-a0ce-d28360d497b3 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:04.409883 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a0cd3-d851-4b5f-a5b6-3951e59f6a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:04.410504 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a0cd3-d851-4b5f-a5b6-3951e59f6a4e admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:04.411740 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a0cd3-d851-4b5f-a5b6-3951e59f6a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:04.412023 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a0cd3-d851-4b5f-a5b6-3951e59f6a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:04.412826 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a0cd3-d851-4b5f-a5b6-3951e59f6a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:04.414901 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a0cd3-d851-4b5f-a5b6-3951e59f6a4e admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:04.451798 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a2fb8603-6017-4530-9a40-b60b45f686d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e23d03126eac46558dcf0cb6a2c8677d', 'request_id': 'req-a2fb8603-6017-4530-9a40-b60b45f686d3'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:04.466779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a2fb8603-6017-4530-9a40-b60b45f686d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e23d03126eac46558dcf0cb6a2c8677d', 'request_id': 'req-a2fb8603-6017-4530-9a40-b60b45f686d3'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:04.480471 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a2fb8603-6017-4530-9a40-b60b45f686d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e23d03126eac46558dcf0cb6a2c8677d', 'request_id': 'req-a2fb8603-6017-4530-9a40-b60b45f686d3'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:04.480590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 844/1679] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:04 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:04.487060 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a0cd3-d851-4b5f-a5b6-3951e59f6a4e admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:04.507064 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:04.521715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a2fb8603-6017-4530-9a40-b60b45f686d3 admin admin] The token cache is being invalidate because project e23d03126eac46558dcf0cb6a2c8677d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:04.522039 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a2fb8603-6017-4530-9a40-b60b45f686d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:04.525131 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a2fb8603-6017-4530-9a40-b60b45f686d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:04.526837 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 836/1680] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:04 2022] DELETE /identity/v3/projects/e23d03126eac46558dcf0cb6a2c8677d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:04.531715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66008dad-0ce1-45a1-b243-132ffddac145 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:04.532125 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66008dad-0ce1-45a1-b243-132ffddac145 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:04.534436 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66008dad-0ce1-45a1-b243-132ffddac145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:04.597460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-66008dad-0ce1-45a1-b243-132ffddac145 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:04.601997 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-66008dad-0ce1-45a1-b243-132ffddac145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:04.652143 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a0cd3-d851-4b5f-a5b6-3951e59f6a4e admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:04.659733 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299527f-ec3a-49ef-bdb9-da372a55c38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:04.660473 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299527f-ec3a-49ef-bdb9-da372a55c38b admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:04.662263 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299527f-ec3a-49ef-bdb9-da372a55c38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:04.662720 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299527f-ec3a-49ef-bdb9-da372a55c38b admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:04.664627 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299527f-ec3a-49ef-bdb9-da372a55c38b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:04.673334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299527f-ec3a-49ef-bdb9-da372a55c38b admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:04.718204 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 845/1681] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:04 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:42:04.727267 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299527f-ec3a-49ef-bdb9-da372a55c38b admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:04.733038 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2299527f-ec3a-49ef-bdb9-da372a55c38b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:04.771465 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299527f-ec3a-49ef-bdb9-da372a55c38b admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:04.802148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 837/1682] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:04.806173 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bbb83-055d-48c9-bb5a-b644955c9932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:04.806792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bbb83-055d-48c9-bb5a-b644955c9932 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:04.807137 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bbb83-055d-48c9-bb5a-b644955c9932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:04.807353 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bbb83-055d-48c9-bb5a-b644955c9932 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:04.808417 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bbb83-055d-48c9-bb5a-b644955c9932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:04.810881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7beed-13a6-435e-9a0b-9394b9ef3081 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:04.811163 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7beed-13a6-435e-9a0b-9394b9ef3081 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:04.811433 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7beed-13a6-435e-9a0b-9394b9ef3081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:04.818972 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bbb83-055d-48c9-bb5a-b644955c9932 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:04.843879 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:04.851813 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 846/1683] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:04.859886 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bbb83-055d-48c9-bb5a-b644955c9932 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:04.861765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-e7c7beed-13a6-435e-9a0b-9394b9ef3081 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:04.863237 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e7c7beed-13a6-435e-9a0b-9394b9ef3081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:04.877512 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 838/1684] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:04.878563 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7beed-13a6-435e-9a0b-9394b9ef3081 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:04.882784 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bbb83-055d-48c9-bb5a-b644955c9932 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:04.889516 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1db88e-0e2f-4379-a23d-5d7e16fd8263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:04.890286 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1db88e-0e2f-4379-a23d-5d7e16fd8263 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:04.890656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1db88e-0e2f-4379-a23d-5d7e16fd8263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:04.891345 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1db88e-0e2f-4379-a23d-5d7e16fd8263 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:04.891748 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1db88e-0e2f-4379-a23d-5d7e16fd8263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:04.893991 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1db88e-0e2f-4379-a23d-5d7e16fd8263 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:04.904110 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7beed-13a6-435e-9a0b-9394b9ef3081 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:04.910727 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 847/1685] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:04.911565 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52dc8a-6a14-487d-a537-bac1c1654dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:04.912418 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52dc8a-6a14-487d-a537-bac1c1654dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:04.912836 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52dc8a-6a14-487d-a537-bac1c1654dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:04.913242 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52dc8a-6a14-487d-a537-bac1c1654dd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:04.914059 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52dc8a-6a14-487d-a537-bac1c1654dd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:42:04.914493 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52dc8a-6a14-487d-a537-bac1c1654dd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:04.915382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1db88e-0e2f-4379-a23d-5d7e16fd8263 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:04.916713 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52dc8a-6a14-487d-a537-bac1c1654dd3 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:04.930155 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1db88e-0e2f-4379-a23d-5d7e16fd8263 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:04.937653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 839/1686] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:42:04.938864 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52dc8a-6a14-487d-a537-bac1c1654dd3 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:04.940182 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060e87b-c0e2-494e-b663-3753f50f7263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:04.941028 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060e87b-c0e2-494e-b663-3753f50f7263 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:04.941408 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060e87b-c0e2-494e-b663-3753f50f7263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:04.941869 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060e87b-c0e2-494e-b663-3753f50f7263 admin admin] PATH_INFO: `/v3/projects/4ac4fb804af24fd49a84789ae5f85363/users/54b051e517c14de3b64b59183fb68957/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:04.960827 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060e87b-c0e2-494e-b663-3753f50f7263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac4fb804af24fd49a84789ae5f85363, user_id=54b051e517c14de3b64b59183fb68957, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:04.964190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060e87b-c0e2-494e-b663-3753f50f7263 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:04.965777 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52dc8a-6a14-487d-a537-bac1c1654dd3 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:04.983140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6565a6-f402-478b-8bf6-275da7f6ca47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:04.983972 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 848/1687] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:04 2022] PUT /identity/v3/projects/4ac4fb804af24fd49a84789ae5f85363/users/54b051e517c14de3b64b59183fb68957/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:04.984090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6565a6-f402-478b-8bf6-275da7f6ca47 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:04.984503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6565a6-f402-478b-8bf6-275da7f6ca47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:04.984503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6565a6-f402-478b-8bf6-275da7f6ca47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:04.985154 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6565a6-f402-478b-8bf6-275da7f6ca47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:04.994111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6565a6-f402-478b-8bf6-275da7f6ca47 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:04.995779 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb142a8-28c7-4f56-8b20-c53f720a3bd1 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:04.996186 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb142a8-28c7-4f56-8b20-c53f720a3bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:04.996746 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb142a8-28c7-4f56-8b20-c53f720a3bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:05.031927 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-fbb142a8-28c7-4f56-8b20-c53f720a3bd1 None None] MFA Rules not processed for user `54b051e517c14de3b64b59183fb68957`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:05.032783 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 840/1688] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:04 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:05.033452 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-fbb142a8-28c7-4f56-8b20-c53f720a3bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:05.037285 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6565a6-f402-478b-8bf6-275da7f6ca47 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:05.134758 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6565a6-f402-478b-8bf6-275da7f6ca47 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:05.142263 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7c381-dba1-4d7d-b13c-d73a1055debc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:05.143208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7c381-dba1-4d7d-b13c-d73a1055debc admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:05.143622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7c381-dba1-4d7d-b13c-d73a1055debc admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:05.143992 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7c381-dba1-4d7d-b13c-d73a1055debc admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:05.145203 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7c381-dba1-4d7d-b13c-d73a1055debc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:05.147850 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7c381-dba1-4d7d-b13c-d73a1055debc admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:05.163096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 849/1689] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:05.171126 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb142a8-28c7-4f56-8b20-c53f720a3bd1 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:05.188673 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 841/1690] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:05 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:05.193245 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7c381-dba1-4d7d-b13c-d73a1055debc admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:05.195736 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb142a8-28c7-4f56-8b20-c53f720a3bd1 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:05.210457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7c381-dba1-4d7d-b13c-d73a1055debc admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:05.211396 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40700463-358f-4528-9bb3-465b50845367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:05.212229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40700463-358f-4528-9bb3-465b50845367 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:05.212651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40700463-358f-4528-9bb3-465b50845367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:05.213114 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40700463-358f-4528-9bb3-465b50845367 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:05.213941 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40700463-358f-4528-9bb3-465b50845367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:05.216102 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40700463-358f-4528-9bb3-465b50845367 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:05.225745 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5439ac2-b992-47e4-91b7-6b799a3943db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:05.226537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5439ac2-b992-47e4-91b7-6b799a3943db admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:05.226884 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5439ac2-b992-47e4-91b7-6b799a3943db admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:05.227229 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5439ac2-b992-47e4-91b7-6b799a3943db admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:05.228851 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5439ac2-b992-47e4-91b7-6b799a3943db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:05.231210 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5439ac2-b992-47e4-91b7-6b799a3943db admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:05.253258 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 850/1691] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:05 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:05.253726 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 842/1692] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:05.258706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5439ac2-b992-47e4-91b7-6b799a3943db admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:05.263342 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40700463-358f-4528-9bb3-465b50845367 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:05.274488 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5439ac2-b992-47e4-91b7-6b799a3943db admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:05.292997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:05.350143 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d56ba2-7266-458e-883d-a59862a7c9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:05.350908 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d56ba2-7266-458e-883d-a59862a7c9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:05.351212 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d56ba2-7266-458e-883d-a59862a7c9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:05.351634 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d56ba2-7266-458e-883d-a59862a7c9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:05.352291 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d56ba2-7266-458e-883d-a59862a7c9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:05.355196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40700463-358f-4528-9bb3-465b50845367 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:05.356827 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d56ba2-7266-458e-883d-a59862a7c9d2 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:05.360772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499310e-bee4-4890-b25c-6ebc0d7ff80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:05.361657 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499310e-bee4-4890-b25c-6ebc0d7ff80b admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:05.361768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499310e-bee4-4890-b25c-6ebc0d7ff80b admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:05.362034 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499310e-bee4-4890-b25c-6ebc0d7ff80b admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:05.362675 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499310e-bee4-4890-b25c-6ebc0d7ff80b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:05.365760 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499310e-bee4-4890-b25c-6ebc0d7ff80b admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:05.373899 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 843/1693] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:42:05.375150 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d56ba2-7266-458e-883d-a59862a7c9d2 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:05.386090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d56ba2-7266-458e-883d-a59862a7c9d2 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:05.390932 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e92ea-4905-4275-81f4-0a8698d54dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:05.391596 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e92ea-4905-4275-81f4-0a8698d54dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:05.391874 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e92ea-4905-4275-81f4-0a8698d54dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:05.392144 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e92ea-4905-4275-81f4-0a8698d54dd4 admin admin] PATH_INFO: `/v3/projects/5a6f58e35e66431891b9de452a8682d8/users/fec8f3e8e08c4abb97374732c6524f3a/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:05.400377 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 851/1694] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:05 2022] POST /identity/v3/users => generated 300 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:42:05.400377 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499310e-bee4-4890-b25c-6ebc0d7ff80b admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:05.415347 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499310e-bee4-4890-b25c-6ebc0d7ff80b admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:05.423519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842b852-da7b-4f82-a5a8-9f45b165b53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:05.423519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842b852-da7b-4f82-a5a8-9f45b165b53a admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:05.423519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842b852-da7b-4f82-a5a8-9f45b165b53a admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:05.423519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842b852-da7b-4f82-a5a8-9f45b165b53a admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:05.423976 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842b852-da7b-4f82-a5a8-9f45b165b53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:05.425077 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842b852-da7b-4f82-a5a8-9f45b165b53a admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:05.426729 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e92ea-4905-4275-81f4-0a8698d54dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6f58e35e66431891b9de452a8682d8, user_id=fec8f3e8e08c4abb97374732c6524f3a, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:05.431729 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e92ea-4905-4275-81f4-0a8698d54dd4 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:05.441370 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 852/1695] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:42:05.446951 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842b852-da7b-4f82-a5a8-9f45b165b53a admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:05.456161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 844/1696] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:05 2022] PUT /identity/v3/projects/5a6f58e35e66431891b9de452a8682d8/users/fec8f3e8e08c4abb97374732c6524f3a/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:05.460029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842b852-da7b-4f82-a5a8-9f45b165b53a admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:05.468862 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74247a4-ad4b-40de-8833-19b1eb582b0b None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:05.469153 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74247a4-ad4b-40de-8833-19b1eb582b0b None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:05.469433 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74247a4-ad4b-40de-8833-19b1eb582b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:05.504020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-e74247a4-ad4b-40de-8833-19b1eb582b0b None None] MFA Rules not processed for user `fec8f3e8e08c4abb97374732c6524f3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:05.505646 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e74247a4-ad4b-40de-8833-19b1eb582b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:05.510425 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:05.586878 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a45f5-ee95-42b6-8f83-5e3e3ad98815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:05.587835 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a45f5-ee95-42b6-8f83-5e3e3ad98815 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:05.591732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a45f5-ee95-42b6-8f83-5e3e3ad98815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:05.592020 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a45f5-ee95-42b6-8f83-5e3e3ad98815 admin admin] PATH_INFO: `/v3/projects/18ebfae0c4f1490bb085fed5cec1af6e/users/9eaf5c3060c64846a0e7a68fd6cfb2db/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:05.616571 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a45f5-ee95-42b6-8f83-5e3e3ad98815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18ebfae0c4f1490bb085fed5cec1af6e, user_id=9eaf5c3060c64846a0e7a68fd6cfb2db, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:05.617351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 845/1697] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:05.623882 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a45f5-ee95-42b6-8f83-5e3e3ad98815 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:05.632520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74247a4-ad4b-40de-8833-19b1eb582b0b None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:05.634506 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e74247a4-ad4b-40de-8833-19b1eb582b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:05.656094 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 853/1698] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:05 2022] PUT /identity/v3/projects/18ebfae0c4f1490bb085fed5cec1af6e/users/9eaf5c3060c64846a0e7a68fd6cfb2db/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:05.657417 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a45f5-ee95-42b6-8f83-5e3e3ad98815 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:05.746447 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a45f5-ee95-42b6-8f83-5e3e3ad98815 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:05.756001 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74247a4-ad4b-40de-8833-19b1eb582b0b None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:05.759496 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32f55b-68d0-467a-ba3d-32a074b45944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:05.760135 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32f55b-68d0-467a-ba3d-32a074b45944 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:05.760787 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32f55b-68d0-467a-ba3d-32a074b45944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:05.760787 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32f55b-68d0-467a-ba3d-32a074b45944 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:05.761592 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32f55b-68d0-467a-ba3d-32a074b45944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:05.765810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32f55b-68d0-467a-ba3d-32a074b45944 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:05.805012 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 854/1699] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:05.821335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32f55b-68d0-467a-ba3d-32a074b45944 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:05.844483 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94831880-8e32-401e-9842-b3c6b5c47105 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:05.847185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32f55b-68d0-467a-ba3d-32a074b45944 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:05.852487 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94831880-8e32-401e-9842-b3c6b5c47105 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:05.852850 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94831880-8e32-401e-9842-b3c6b5c47105 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:05.853135 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94831880-8e32-401e-9842-b3c6b5c47105 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:05.863117 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af43f1-e10d-46af-b3a5-0248207f42d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:05.863908 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af43f1-e10d-46af-b3a5-0248207f42d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:05.864223 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af43f1-e10d-46af-b3a5-0248207f42d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:05.864595 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af43f1-e10d-46af-b3a5-0248207f42d6 admin admin] PATH_INFO: `/v3/projects/18ebfae0c4f1490bb085fed5cec1af6e/users/9eaf5c3060c64846a0e7a68fd6cfb2db/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:05.875154 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af43f1-e10d-46af-b3a5-0248207f42d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18ebfae0c4f1490bb085fed5cec1af6e, user_id=9eaf5c3060c64846a0e7a68fd6cfb2db, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:05.880089 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af43f1-e10d-46af-b3a5-0248207f42d6 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:05.902210 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:05.940073 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 855/1700] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:05 2022] PUT /identity/v3/projects/18ebfae0c4f1490bb085fed5cec1af6e/users/9eaf5c3060c64846a0e7a68fd6cfb2db/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:05.953422 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a9a25-8910-4ee7-8cb1-02977fdbe89d None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:05.953736 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a9a25-8910-4ee7-8cb1-02977fdbe89d None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:05.955176 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a9a25-8910-4ee7-8cb1-02977fdbe89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:06.046032 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-089a9a25-8910-4ee7-8cb1-02977fdbe89d None None] MFA Rules not processed for user `9eaf5c3060c64846a0e7a68fd6cfb2db`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:06.047477 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-089a9a25-8910-4ee7-8cb1-02977fdbe89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:06.053738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94831880-8e32-401e-9842-b3c6b5c47105 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:06.056684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94831880-8e32-401e-9842-b3c6b5c47105 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:06.087480 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 846/1701] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:42:06.335603 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 856/1702] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:06.524354 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94831880-8e32-401e-9842-b3c6b5c47105 service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:06.526130 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-94831880-8e32-401e-9842-b3c6b5c47105 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:06.543777 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94831880-8e32-401e-9842-b3c6b5c47105 service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:06.571990 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:06.713667 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320aa00-a3eb-42ea-98b4-5c359ea2de79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:06.715162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320aa00-a3eb-42ea-98b4-5c359ea2de79 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:06.716339 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320aa00-a3eb-42ea-98b4-5c359ea2de79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:06.716717 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320aa00-a3eb-42ea-98b4-5c359ea2de79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:06.741590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320aa00-a3eb-42ea-98b4-5c359ea2de79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:06.743282 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320aa00-a3eb-42ea-98b4-5c359ea2de79 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:06.762061 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 847/1703] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:07.629603 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a9a25-8910-4ee7-8cb1-02977fdbe89d None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:07.744519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a9a25-8910-4ee7-8cb1-02977fdbe89d None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:07.760478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d398f-7b28-4208-93a5-172e35ad0732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:07.761136 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d398f-7b28-4208-93a5-172e35ad0732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:07.761440 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d398f-7b28-4208-93a5-172e35ad0732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:07.761942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d398f-7b28-4208-93a5-172e35ad0732 admin admin] PATH_INFO: `/v3/users/54b051e517c14de3b64b59183fb68957` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:07.762893 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d398f-7b28-4208-93a5-172e35ad0732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54b051e517c14de3b64b59183fb68957)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:07.764981 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d398f-7b28-4208-93a5-172e35ad0732 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:07.847937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e81d398f-7b28-4208-93a5-172e35ad0732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54b051e517c14de3b64b59183fb68957'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:07.867015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e81d398f-7b28-4208-93a5-172e35ad0732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54b051e517c14de3b64b59183fb68957'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:07.890209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e81d398f-7b28-4208-93a5-172e35ad0732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54b051e517c14de3b64b59183fb68957'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:07.892582 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e81d398f-7b28-4208-93a5-172e35ad0732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54b051e517c14de3b64b59183fb68957'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:07.903387 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e81d398f-7b28-4208-93a5-172e35ad0732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54b051e517c14de3b64b59183fb68957'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:07.913161 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 857/1704] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:07 2022] DELETE /identity/v3/users/54b051e517c14de3b64b59183fb68957 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:07.918895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc22674-fd04-418b-9088-88a6be9881b7 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:07.918895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc22674-fd04-418b-9088-88a6be9881b7 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:07.920244 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc22674-fd04-418b-9088-88a6be9881b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:07.962099 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-9bc22674-fd04-418b-9088-88a6be9881b7 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:07.963693 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-9bc22674-fd04-418b-9088-88a6be9881b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:08.088064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 848/1705] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:08.098670 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d398f-7b28-4208-93a5-172e35ad0732 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:08.100424 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e81d398f-7b28-4208-93a5-172e35ad0732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:08.107738 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:08.187984 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d398f-7b28-4208-93a5-172e35ad0732 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:08.192256 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a543c6-1805-4d5a-80fc-582f8944cae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:08.192913 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a543c6-1805-4d5a-80fc-582f8944cae7 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:08.193280 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a543c6-1805-4d5a-80fc-582f8944cae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:08.193553 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a543c6-1805-4d5a-80fc-582f8944cae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:08.202898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a543c6-1805-4d5a-80fc-582f8944cae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:08.204457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a543c6-1805-4d5a-80fc-582f8944cae7 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:08.216447 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 858/1706] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:08.258411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b284a7-2335-4474-9bd4-568fb8b1cb83 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:08.258705 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b284a7-2335-4474-9bd4-568fb8b1cb83 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:08.258940 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b284a7-2335-4474-9bd4-568fb8b1cb83 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:08.260973 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 849/1707] 10.222.0.17 () {54 vars in 921 bytes} [Thu Oct 20 14:42:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:42:08.277077 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8fa83-7cc7-4caf-a125-0dab999624a6 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:08.277649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8fa83-7cc7-4caf-a125-0dab999624a6 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:08.278132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8fa83-7cc7-4caf-a125-0dab999624a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:08.324901 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-92a8fa83-7cc7-4caf-a125-0dab999624a6 None None] MFA Rules not processed for user `1e94a60e43914cf38a5f2f88b182083f`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:08.326564 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-92a8fa83-7cc7-4caf-a125-0dab999624a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:08.375944 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b284a7-2335-4474-9bd4-568fb8b1cb83 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:08.377796 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-46b284a7-2335-4474-9bd4-568fb8b1cb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:08.396240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b284a7-2335-4474-9bd4-568fb8b1cb83 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:08.402832 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f69de-4bdf-4c80-a2a6-8995d92f4f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:08.403355 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f69de-4bdf-4c80-a2a6-8995d92f4f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:08.403635 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f69de-4bdf-4c80-a2a6-8995d92f4f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:08.403905 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f69de-4bdf-4c80-a2a6-8995d92f4f98 admin admin] PATH_INFO: `/v3/users/218e5a1ab3a948079eed1592c8867bd2` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:08.405139 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f69de-4bdf-4c80-a2a6-8995d92f4f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=218e5a1ab3a948079eed1592c8867bd2)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:08.407113 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f69de-4bdf-4c80-a2a6-8995d92f4f98 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:08.412180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 859/1708] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Oct 20 14:42:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:08.423525 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8fa83-7cc7-4caf-a125-0dab999624a6 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:08.425441 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-92a8fa83-7cc7-4caf-a125-0dab999624a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:08.440349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8fa83-7cc7-4caf-a125-0dab999624a6 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:08.447021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12275c0e-b602-46a9-80aa-913135fc3691 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e94a60e43914cf38a5f2f88b182083f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:08.447724 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12275c0e-b602-46a9-80aa-913135fc3691 service placement] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:08.448005 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12275c0e-b602-46a9-80aa-913135fc3691 service placement] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:08.448268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12275c0e-b602-46a9-80aa-913135fc3691 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:08.458834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12275c0e-b602-46a9-80aa-913135fc3691 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:08.460649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12275c0e-b602-46a9-80aa-913135fc3691 service placement] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:08.471713 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d33f69de-4bdf-4c80-a2a6-8995d92f4f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '218e5a1ab3a948079eed1592c8867bd2'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:08.482284 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 860/1709] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:42:08.483672 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d33f69de-4bdf-4c80-a2a6-8995d92f4f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '218e5a1ab3a948079eed1592c8867bd2'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:08.484512 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d33f69de-4bdf-4c80-a2a6-8995d92f4f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '218e5a1ab3a948079eed1592c8867bd2'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:08.485240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d33f69de-4bdf-4c80-a2a6-8995d92f4f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '218e5a1ab3a948079eed1592c8867bd2'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:08.496199 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d33f69de-4bdf-4c80-a2a6-8995d92f4f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '218e5a1ab3a948079eed1592c8867bd2'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:08.525113 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 850/1710] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:08 2022] DELETE /identity/v3/users/218e5a1ab3a948079eed1592c8867bd2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:42:08.699058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12275c0e-b602-46a9-80aa-913135fc3691 service placement] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:08.700444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-12275c0e-b602-46a9-80aa-913135fc3691 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:08.716362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12275c0e-b602-46a9-80aa-913135fc3691 service placement] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:08.787645 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486944a-6e09-4e6f-85b1-a5ff44964cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:08.788455 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486944a-6e09-4e6f-85b1-a5ff44964cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:08.788743 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486944a-6e09-4e6f-85b1-a5ff44964cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:08.789011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486944a-6e09-4e6f-85b1-a5ff44964cc5 admin admin] PATH_INFO: `/v3/projects/4ac4fb804af24fd49a84789ae5f85363` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:08.791234 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486944a-6e09-4e6f-85b1-a5ff44964cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac4fb804af24fd49a84789ae5f85363)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:08.793442 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486944a-6e09-4e6f-85b1-a5ff44964cc5 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:08.832191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f69de-4bdf-4c80-a2a6-8995d92f4f98 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:08.833874 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d33f69de-4bdf-4c80-a2a6-8995d92f4f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:08.846779 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:08.861036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f69de-4bdf-4c80-a2a6-8995d92f4f98 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:08.878240 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e486944a-6e09-4e6f-85b1-a5ff44964cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac4fb804af24fd49a84789ae5f85363', 'request_id': 'req-e486944a-6e09-4e6f-85b1-a5ff44964cc5'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:08.885889 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e486944a-6e09-4e6f-85b1-a5ff44964cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac4fb804af24fd49a84789ae5f85363', 'request_id': 'req-e486944a-6e09-4e6f-85b1-a5ff44964cc5'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:08.895662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e486944a-6e09-4e6f-85b1-a5ff44964cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac4fb804af24fd49a84789ae5f85363', 'request_id': 'req-e486944a-6e09-4e6f-85b1-a5ff44964cc5'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:08.906181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:08.909205 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e486944a-6e09-4e6f-85b1-a5ff44964cc5 admin admin] The token cache is being invalidate because project 4ac4fb804af24fd49a84789ae5f85363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:08.909822 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e486944a-6e09-4e6f-85b1-a5ff44964cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:08.911276 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e486944a-6e09-4e6f-85b1-a5ff44964cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:08.913152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 861/1711] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:08 2022] DELETE /identity/v3/projects/4ac4fb804af24fd49a84789ae5f85363 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:08.917604 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486944a-6e09-4e6f-85b1-a5ff44964cc5 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:08.919515 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e486944a-6e09-4e6f-85b1-a5ff44964cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:08.940800 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720290d-0794-4965-835b-3f0b521480e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:08.942000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720290d-0794-4965-835b-3f0b521480e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:08.942383 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720290d-0794-4965-835b-3f0b521480e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:08.942661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720290d-0794-4965-835b-3f0b521480e7 admin admin] PATH_INFO: `/v3/projects/0ce616f0d97a49d3ae4482a41c2559c1` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:08.943799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720290d-0794-4965-835b-3f0b521480e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce616f0d97a49d3ae4482a41c2559c1)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:08.945707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720290d-0794-4965-835b-3f0b521480e7 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:09.001292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a720290d-0794-4965-835b-3f0b521480e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce616f0d97a49d3ae4482a41c2559c1', 'request_id': 'req-a720290d-0794-4965-835b-3f0b521480e7'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:09.007034 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486944a-6e09-4e6f-85b1-a5ff44964cc5 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:09.010487 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a720290d-0794-4965-835b-3f0b521480e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce616f0d97a49d3ae4482a41c2559c1', 'request_id': 'req-a720290d-0794-4965-835b-3f0b521480e7'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:09.017782 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a720290d-0794-4965-835b-3f0b521480e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce616f0d97a49d3ae4482a41c2559c1', 'request_id': 'req-a720290d-0794-4965-835b-3f0b521480e7'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:09.032044 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a720290d-0794-4965-835b-3f0b521480e7 admin admin] The token cache is being invalidate because project 0ce616f0d97a49d3ae4482a41c2559c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:09.032338 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a720290d-0794-4965-835b-3f0b521480e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:09.033002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a720290d-0794-4965-835b-3f0b521480e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:09.038311 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 851/1712] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:08 2022] DELETE /identity/v3/projects/0ce616f0d97a49d3ae4482a41c2559c1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:09.039890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f8af2-5949-4916-8eab-cd54fd7b5b98 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:09.040323 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f8af2-5949-4916-8eab-cd54fd7b5b98 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:09.041039 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f8af2-5949-4916-8eab-cd54fd7b5b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:09.067590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-521f8af2-5949-4916-8eab-cd54fd7b5b98 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:09.069736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-521f8af2-5949-4916-8eab-cd54fd7b5b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:09.073274 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e68d8-be21-442d-87ff-ad69ad01ed70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:09.074175 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e68d8-be21-442d-87ff-ad69ad01ed70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:09.074479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e68d8-be21-442d-87ff-ad69ad01ed70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:09.074782 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e68d8-be21-442d-87ff-ad69ad01ed70 admin admin] PATH_INFO: `/v3/users/9eaf5c3060c64846a0e7a68fd6cfb2db` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:09.075944 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e68d8-be21-442d-87ff-ad69ad01ed70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eaf5c3060c64846a0e7a68fd6cfb2db)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:09.078173 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e68d8-be21-442d-87ff-ad69ad01ed70 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:09.081878 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 852/1713] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:09.087918 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb3c5b-1e40-4065-849f-990408d610af None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:09.088206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb3c5b-1e40-4065-849f-990408d610af None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:09.088480 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb3c5b-1e40-4065-849f-990408d610af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:09.112181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-dcdb3c5b-1e40-4065-849f-990408d610af None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:09.113915 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-dcdb3c5b-1e40-4065-849f-990408d610af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:09.122565 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 853/1714] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:09.126453 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb3c5b-1e40-4065-849f-990408d610af None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:09.130170 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fd3e68d8-be21-442d-87ff-ad69ad01ed70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eaf5c3060c64846a0e7a68fd6cfb2db'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:09.137181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb3c5b-1e40-4065-849f-990408d610af None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:09.137471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fd3e68d8-be21-442d-87ff-ad69ad01ed70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eaf5c3060c64846a0e7a68fd6cfb2db'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:09.141815 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb784748-19c4-45e2-9350-2949d1e6dd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:09.142448 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb784748-19c4-45e2-9350-2949d1e6dd56 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:09.142729 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb784748-19c4-45e2-9350-2949d1e6dd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:09.143004 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb784748-19c4-45e2-9350-2949d1e6dd56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:09.143648 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb784748-19c4-45e2-9350-2949d1e6dd56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:42:09.144207 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb784748-19c4-45e2-9350-2949d1e6dd56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:09.146234 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb784748-19c4-45e2-9350-2949d1e6dd56 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:09.149257 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:09.151689 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fd3e68d8-be21-442d-87ff-ad69ad01ed70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eaf5c3060c64846a0e7a68fd6cfb2db'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:09.153227 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fd3e68d8-be21-442d-87ff-ad69ad01ed70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eaf5c3060c64846a0e7a68fd6cfb2db'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:09.159726 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 854/1715] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:42:09.161878 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fd3e68d8-be21-442d-87ff-ad69ad01ed70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eaf5c3060c64846a0e7a68fd6cfb2db'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:09.166134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb784748-19c4-45e2-9350-2949d1e6dd56 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:09.171447 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-cb784748-19c4-45e2-9350-2949d1e6dd56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:09.174852 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 862/1716] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:08 2022] DELETE /identity/v3/users/9eaf5c3060c64846a0e7a68fd6cfb2db => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:42:09.193204 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb784748-19c4-45e2-9350-2949d1e6dd56 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:09.293520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d7c85-f093-4188-847b-d67c7a59bb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:09.294273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d7c85-f093-4188-847b-d67c7a59bb64 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:09.294595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d7c85-f093-4188-847b-d67c7a59bb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:09.294865 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d7c85-f093-4188-847b-d67c7a59bb64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:09.295511 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d7c85-f093-4188-847b-d67c7a59bb64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:09.297708 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d7c85-f093-4188-847b-d67c7a59bb64 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:09.340166 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 855/1717] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:09 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:42:09.344402 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e68d8-be21-442d-87ff-ad69ad01ed70 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:09.358840 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e68d8-be21-442d-87ff-ad69ad01ed70 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:09.471866 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612686c-7435-4411-afaa-ea4fc59c1775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:09.472562 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612686c-7435-4411-afaa-ea4fc59c1775 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:09.473551 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612686c-7435-4411-afaa-ea4fc59c1775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:09.473918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612686c-7435-4411-afaa-ea4fc59c1775 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:09.474579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612686c-7435-4411-afaa-ea4fc59c1775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:09.476790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612686c-7435-4411-afaa-ea4fc59c1775 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:09.509970 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 863/1718] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:09 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:42:09.512288 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d7c85-f093-4188-847b-d67c7a59bb64 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:09.523804 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d7c85-f093-4188-847b-d67c7a59bb64 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:09.530225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ff1f9-d8e1-459b-82be-826516446b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:09.530992 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ff1f9-d8e1-459b-82be-826516446b0b admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:09.531209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ff1f9-d8e1-459b-82be-826516446b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:09.531488 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ff1f9-d8e1-459b-82be-826516446b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:09.532645 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ff1f9-d8e1-459b-82be-826516446b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:09.533789 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ff1f9-d8e1-459b-82be-826516446b0b admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:09.549084 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 856/1719] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:09.550386 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612686c-7435-4411-afaa-ea4fc59c1775 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:09.564717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612686c-7435-4411-afaa-ea4fc59c1775 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:09.569691 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1524dbd-28c9-4f4e-98da-ba51a73c2b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:09.570375 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1524dbd-28c9-4f4e-98da-ba51a73c2b50 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:09.570732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1524dbd-28c9-4f4e-98da-ba51a73c2b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:09.571009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1524dbd-28c9-4f4e-98da-ba51a73c2b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:09.571659 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1524dbd-28c9-4f4e-98da-ba51a73c2b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:09.573311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1524dbd-28c9-4f4e-98da-ba51a73c2b50 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:09.585891 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 864/1720] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:42:09.590038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ff1f9-d8e1-459b-82be-826516446b0b admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:09.600939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ff1f9-d8e1-459b-82be-826516446b0b admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:09.606670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b08d4-2024-440d-8625-844f6137af0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:09.607359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b08d4-2024-440d-8625-844f6137af0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:09.607714 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b08d4-2024-440d-8625-844f6137af0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:09.607946 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b08d4-2024-440d-8625-844f6137af0f admin admin] PATH_INFO: `/v3/projects/e77f4a4b19a44a7a87cd197d13340137/users/c7651b1fc3f6407cb5c893d1ec94824d/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:09.611701 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:09.634520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b08d4-2024-440d-8625-844f6137af0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e77f4a4b19a44a7a87cd197d13340137, user_id=c7651b1fc3f6407cb5c893d1ec94824d, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:09.638023 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b08d4-2024-440d-8625-844f6137af0f admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:09.655155 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 857/1721] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:09 2022] PUT /identity/v3/projects/e77f4a4b19a44a7a87cd197d13340137/users/c7651b1fc3f6407cb5c893d1ec94824d/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:09.666812 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49a310-da60-4079-9847-2350f93671e6 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:09.667617 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49a310-da60-4079-9847-2350f93671e6 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:09.667902 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49a310-da60-4079-9847-2350f93671e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:09.706781 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-7f49a310-da60-4079-9847-2350f93671e6 None None] MFA Rules not processed for user `c7651b1fc3f6407cb5c893d1ec94824d`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:09.708450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-7f49a310-da60-4079-9847-2350f93671e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:09.727084 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b08d4-2024-440d-8625-844f6137af0f admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:09.729326 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-ca5b08d4-2024-440d-8625-844f6137af0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:09.810050 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 865/1722] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:09.814598 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49a310-da60-4079-9847-2350f93671e6 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:09.831672 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b08d4-2024-440d-8625-844f6137af0f admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:09.837122 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15babbb9-4412-428e-abeb-bb66f8ea524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:09.837858 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15babbb9-4412-428e-abeb-bb66f8ea524f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:09.838218 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15babbb9-4412-428e-abeb-bb66f8ea524f admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:09.838561 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15babbb9-4412-428e-abeb-bb66f8ea524f admin admin] PATH_INFO: `/v3/projects/18ebfae0c4f1490bb085fed5cec1af6e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:09.839760 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15babbb9-4412-428e-abeb-bb66f8ea524f admin admin] RBAC: Authorizing `identity:delete_project(project_id=18ebfae0c4f1490bb085fed5cec1af6e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:09.841732 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15babbb9-4412-428e-abeb-bb66f8ea524f admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:09.907834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-15babbb9-4412-428e-abeb-bb66f8ea524f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18ebfae0c4f1490bb085fed5cec1af6e', 'request_id': 'req-15babbb9-4412-428e-abeb-bb66f8ea524f'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:09.930492 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-15babbb9-4412-428e-abeb-bb66f8ea524f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18ebfae0c4f1490bb085fed5cec1af6e', 'request_id': 'req-15babbb9-4412-428e-abeb-bb66f8ea524f'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:09.930917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:09.930995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-15babbb9-4412-428e-abeb-bb66f8ea524f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18ebfae0c4f1490bb085fed5cec1af6e', 'request_id': 'req-15babbb9-4412-428e-abeb-bb66f8ea524f'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:09.937655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49a310-da60-4079-9847-2350f93671e6 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:09.944913 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-15babbb9-4412-428e-abeb-bb66f8ea524f admin admin] The token cache is being invalidate because project 18ebfae0c4f1490bb085fed5cec1af6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:09.945394 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-15babbb9-4412-428e-abeb-bb66f8ea524f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:09.946163 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-15babbb9-4412-428e-abeb-bb66f8ea524f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:09.948029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 858/1723] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:09 2022] DELETE /identity/v3/projects/18ebfae0c4f1490bb085fed5cec1af6e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:09.953482 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7866e-f381-4852-b7aa-41282f4b9d1c None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:09.953934 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7866e-f381-4852-b7aa-41282f4b9d1c None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:09.954308 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7866e-f381-4852-b7aa-41282f4b9d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:09.978514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-35f7866e-f381-4852-b7aa-41282f4b9d1c None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:09.979718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-35f7866e-f381-4852-b7aa-41282f4b9d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:10.006424 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0b827-2d27-40ac-974f-df74f1c4951e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:10.007039 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0b827-2d27-40ac-974f-df74f1c4951e admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:10.007313 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0b827-2d27-40ac-974f-df74f1c4951e admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:10.007585 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0b827-2d27-40ac-974f-df74f1c4951e admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:10.008668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0b827-2d27-40ac-974f-df74f1c4951e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:10.011750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0b827-2d27-40ac-974f-df74f1c4951e admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:10.047589 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 866/1724] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:09 2022] POST /identity/v3/projects => generated 381 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:10.053235 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 859/1725] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:10.054882 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0b827-2d27-40ac-974f-df74f1c4951e admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:10.056672 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a2d0b827-2d27-40ac-974f-df74f1c4951e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:10.060944 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd2dc8-413a-4a80-879a-89a472794689 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:10.061415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd2dc8-413a-4a80-879a-89a472794689 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:10.061686 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd2dc8-413a-4a80-879a-89a472794689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:10.083140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-36dd2dc8-413a-4a80-879a-89a472794689 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:10.084392 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-36dd2dc8-413a-4a80-879a-89a472794689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:10.095349 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:10.124688 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0b827-2d27-40ac-974f-df74f1c4951e admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:10.129610 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379ad9a-e8ac-42b7-a5fd-2351c9ae5c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:10.130260 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379ad9a-e8ac-42b7-a5fd-2351c9ae5c7e admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:10.130537 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379ad9a-e8ac-42b7-a5fd-2351c9ae5c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:10.130809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379ad9a-e8ac-42b7-a5fd-2351c9ae5c7e admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:10.131496 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379ad9a-e8ac-42b7-a5fd-2351c9ae5c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:10.133644 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379ad9a-e8ac-42b7-a5fd-2351c9ae5c7e admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:10.162611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 860/1726] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:10.164783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 867/1727] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:10 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:10.166966 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379ad9a-e8ac-42b7-a5fd-2351c9ae5c7e admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:10.167075 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd2dc8-413a-4a80-879a-89a472794689 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:10.178623 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd2dc8-413a-4a80-879a-89a472794689 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:10.179149 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379ad9a-e8ac-42b7-a5fd-2351c9ae5c7e admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:10.185359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81076383-3ead-4987-b774-1c8772c1304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:10.185786 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435a5c4-0597-44a7-b8ab-27d9bfcf7d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:10.186222 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81076383-3ead-4987-b774-1c8772c1304b admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:10.186381 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81076383-3ead-4987-b774-1c8772c1304b admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:10.186532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435a5c4-0597-44a7-b8ab-27d9bfcf7d9f admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:10.186680 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81076383-3ead-4987-b774-1c8772c1304b admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:10.186769 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435a5c4-0597-44a7-b8ab-27d9bfcf7d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:10.187128 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435a5c4-0597-44a7-b8ab-27d9bfcf7d9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:10.187393 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81076383-3ead-4987-b774-1c8772c1304b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:10.189657 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435a5c4-0597-44a7-b8ab-27d9bfcf7d9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:42:10.189657 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435a5c4-0597-44a7-b8ab-27d9bfcf7d9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:10.189833 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81076383-3ead-4987-b774-1c8772c1304b admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:10.189951 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435a5c4-0597-44a7-b8ab-27d9bfcf7d9f admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:10.201300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 861/1728] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:42:10.205267 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 868/1729] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:42:10.206108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81076383-3ead-4987-b774-1c8772c1304b admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:10.210119 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435a5c4-0597-44a7-b8ab-27d9bfcf7d9f admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:10.220465 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81076383-3ead-4987-b774-1c8772c1304b admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:10.220856 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435a5c4-0597-44a7-b8ab-27d9bfcf7d9f admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:10.225858 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ea684-10d6-4142-b901-821d20631730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:10.226282 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009bb9b-5198-4e41-af57-2939bc9675b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:10.226494 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ea684-10d6-4142-b901-821d20631730 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:10.226773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ea684-10d6-4142-b901-821d20631730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:10.227004 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009bb9b-5198-4e41-af57-2939bc9675b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:10.227106 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ea684-10d6-4142-b901-821d20631730 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:10.227288 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009bb9b-5198-4e41-af57-2939bc9675b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:10.227566 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009bb9b-5198-4e41-af57-2939bc9675b2 admin admin] PATH_INFO: `/v3/projects/74761e60aea24ef899cbe9b2216c01ac/users/3c652c7ff1684041a0ccd6cd2de0e084/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:10.227907 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ea684-10d6-4142-b901-821d20631730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:10.229822 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ea684-10d6-4142-b901-821d20631730 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:10.244948 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009bb9b-5198-4e41-af57-2939bc9675b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74761e60aea24ef899cbe9b2216c01ac, user_id=3c652c7ff1684041a0ccd6cd2de0e084, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:10.247700 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009bb9b-5198-4e41-af57-2939bc9675b2 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:10.261395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 869/1730] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:10 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:10.264536 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 862/1731] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:10 2022] PUT /identity/v3/projects/74761e60aea24ef899cbe9b2216c01ac/users/3c652c7ff1684041a0ccd6cd2de0e084/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:42:10.265533 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ea684-10d6-4142-b901-821d20631730 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:10.267905 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009bb9b-5198-4e41-af57-2939bc9675b2 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:10.320717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:10.339415 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ea684-10d6-4142-b901-821d20631730 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:10.344086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7f084-361c-4975-a8ff-824309a1ed51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:10.344697 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7f084-361c-4975-a8ff-824309a1ed51 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:10.344978 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7f084-361c-4975-a8ff-824309a1ed51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:10.345251 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7f084-361c-4975-a8ff-824309a1ed51 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:10.345903 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7f084-361c-4975-a8ff-824309a1ed51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:10.348831 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7f084-361c-4975-a8ff-824309a1ed51 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:10.349951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009bb9b-5198-4e41-af57-2939bc9675b2 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:10.354790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d8563-fbbb-4165-8941-da0cf82ce42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:10.355396 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d8563-fbbb-4165-8941-da0cf82ce42f admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:10.355675 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d8563-fbbb-4165-8941-da0cf82ce42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:10.355949 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d8563-fbbb-4165-8941-da0cf82ce42f admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:10.356589 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d8563-fbbb-4165-8941-da0cf82ce42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:10.359227 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d8563-fbbb-4165-8941-da0cf82ce42f admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:10.370384 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 870/1732] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:10 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:10.373611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 863/1733] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:42:10.374507 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d8563-fbbb-4165-8941-da0cf82ce42f admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:10.374683 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7f084-361c-4975-a8ff-824309a1ed51 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:10.384635 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d8563-fbbb-4165-8941-da0cf82ce42f admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:10.384894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7f084-361c-4975-a8ff-824309a1ed51 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:10.389229 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf739b-4746-48d0-ab88-db7b2e33772d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:10.389439 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a88b6d-bf89-4b5b-9ee4-817d99349bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:10.389903 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf739b-4746-48d0-ab88-db7b2e33772d admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:10.390144 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a88b6d-bf89-4b5b-9ee4-817d99349bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:10.390271 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf739b-4746-48d0-ab88-db7b2e33772d admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:10.390350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a88b6d-bf89-4b5b-9ee4-817d99349bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:10.390511 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf739b-4746-48d0-ab88-db7b2e33772d admin admin] PATH_INFO: `/v3/projects/74761e60aea24ef899cbe9b2216c01ac/users/3c652c7ff1684041a0ccd6cd2de0e084/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:10.390689 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a88b6d-bf89-4b5b-9ee4-817d99349bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:10.391253 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a88b6d-bf89-4b5b-9ee4-817d99349bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:10.392342 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf739b-4746-48d0-ab88-db7b2e33772d admin admin] RBAC: Authorizing `identity:create_grant(project_id=74761e60aea24ef899cbe9b2216c01ac, user_id=3c652c7ff1684041a0ccd6cd2de0e084, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:10.392848 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a88b6d-bf89-4b5b-9ee4-817d99349bc3 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:10.396547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf739b-4746-48d0-ab88-db7b2e33772d admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:10.404649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 871/1734] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:42:10.406970 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 864/1735] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:10 2022] PUT /identity/v3/projects/74761e60aea24ef899cbe9b2216c01ac/users/3c652c7ff1684041a0ccd6cd2de0e084/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:10.408394 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a88b6d-bf89-4b5b-9ee4-817d99349bc3 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:10.418097 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e68e7e-70db-4aa2-9275-8c59da447e8f None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:10.418385 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e68e7e-70db-4aa2-9275-8c59da447e8f None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:10.418485 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a88b6d-bf89-4b5b-9ee4-817d99349bc3 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:10.418662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e68e7e-70db-4aa2-9275-8c59da447e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:10.449250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-21e68e7e-70db-4aa2-9275-8c59da447e8f None None] MFA Rules not processed for user `3c652c7ff1684041a0ccd6cd2de0e084`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:10.449972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-21e68e7e-70db-4aa2-9275-8c59da447e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:10.482420 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c804a-0845-4cbd-b846-1e50ed582c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:10.483043 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c804a-0845-4cbd-b846-1e50ed582c7b admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:10.483363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c804a-0845-4cbd-b846-1e50ed582c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:10.483754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c804a-0845-4cbd-b846-1e50ed582c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:10.484511 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c804a-0845-4cbd-b846-1e50ed582c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:10.486003 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c804a-0845-4cbd-b846-1e50ed582c7b admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:10.497867 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 872/1736] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:10.502434 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c804a-0845-4cbd-b846-1e50ed582c7b admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:10.512940 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:10.513131 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c804a-0845-4cbd-b846-1e50ed582c7b admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:10.519444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7ed9b-3b22-480f-b907-2e6265f76111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:10.520348 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7ed9b-3b22-480f-b907-2e6265f76111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:10.520629 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7ed9b-3b22-480f-b907-2e6265f76111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:10.520906 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7ed9b-3b22-480f-b907-2e6265f76111 admin admin] PATH_INFO: `/v3/projects/fd9fba90bc0245dca4bd9d65a96f8db5/users/e09765af8ed94b42b404f0846e132cdd/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:10.549100 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 865/1737] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:10.556431 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7ed9b-3b22-480f-b907-2e6265f76111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd9fba90bc0245dca4bd9d65a96f8db5, user_id=e09765af8ed94b42b404f0846e132cdd, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:10.560419 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7ed9b-3b22-480f-b907-2e6265f76111 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:10.562698 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e68e7e-70db-4aa2-9275-8c59da447e8f None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:10.565909 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-21e68e7e-70db-4aa2-9275-8c59da447e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:10.594539 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 873/1738] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:10 2022] PUT /identity/v3/projects/fd9fba90bc0245dca4bd9d65a96f8db5/users/e09765af8ed94b42b404f0846e132cdd/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:10.607063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be75df-c405-475c-823f-0c9ffd16e0e8 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:10.607411 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be75df-c405-475c-823f-0c9ffd16e0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:10.608032 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be75df-c405-475c-823f-0c9ffd16e0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:10.639236 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-e4be75df-c405-475c-823f-0c9ffd16e0e8 None None] MFA Rules not processed for user `e09765af8ed94b42b404f0846e132cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:10.640496 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e4be75df-c405-475c-823f-0c9ffd16e0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:10.647991 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e68e7e-70db-4aa2-9275-8c59da447e8f None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:10.717913 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 874/1739] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:10.718450 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469aaf9-2810-4227-891f-836067eebd28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:10.718755 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469aaf9-2810-4227-891f-836067eebd28 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:10.718847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469aaf9-2810-4227-891f-836067eebd28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:10.719408 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469aaf9-2810-4227-891f-836067eebd28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:10.729701 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be75df-c405-475c-823f-0c9ffd16e0e8 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:10.730805 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e4be75df-c405-475c-823f-0c9ffd16e0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:10.744500 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be75df-c405-475c-823f-0c9ffd16e0e8 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:10.748409 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34beb2dc-517e-492e-81d5-94c12f2cfdf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:10.749019 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34beb2dc-517e-492e-81d5-94c12f2cfdf2 service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:10.749365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34beb2dc-517e-492e-81d5-94c12f2cfdf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:10.749634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34beb2dc-517e-492e-81d5-94c12f2cfdf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:10.759630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34beb2dc-517e-492e-81d5-94c12f2cfdf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:10.761242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34beb2dc-517e-492e-81d5-94c12f2cfdf2 service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:10.776870 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 875/1740] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:42:10.796802 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469aaf9-2810-4227-891f-836067eebd28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:10.798123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34beb2dc-517e-492e-81d5-94c12f2cfdf2 service cinder] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:10.798457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469aaf9-2810-4227-891f-836067eebd28 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:10.809474 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 866/1741] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:42:10.810776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:10.875893 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34beb2dc-517e-492e-81d5-94c12f2cfdf2 service cinder] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:10.886725 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6c19f-4e64-4885-b189-6da4a3ad6f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:10.886725 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6c19f-4e64-4885-b189-6da4a3ad6f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:10.886725 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6c19f-4e64-4885-b189-6da4a3ad6f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:10.886725 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6c19f-4e64-4885-b189-6da4a3ad6f88 admin admin] PATH_INFO: `/v3/users/e09765af8ed94b42b404f0846e132cdd` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:10.887010 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6c19f-4e64-4885-b189-6da4a3ad6f88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e09765af8ed94b42b404f0846e132cdd)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:10.887010 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6c19f-4e64-4885-b189-6da4a3ad6f88 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:10.893648 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469aaf9-2810-4227-891f-836067eebd28 service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:10.902377 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469aaf9-2810-4227-891f-836067eebd28 service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:10.906070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a99cb-7005-460a-8876-61117f5c0a3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:10.906675 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a99cb-7005-460a-8876-61117f5c0a3d service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:10.906956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a99cb-7005-460a-8876-61117f5c0a3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:10.907229 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a99cb-7005-460a-8876-61117f5c0a3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:10.910644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-3c0a99cb-7005-460a-8876-61117f5c0a3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:10.942200 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c3c6c19f-4e64-4885-b189-6da4a3ad6f88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e09765af8ed94b42b404f0846e132cdd'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:10.950762 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c3c6c19f-4e64-4885-b189-6da4a3ad6f88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e09765af8ed94b42b404f0846e132cdd'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:10.970268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c3c6c19f-4e64-4885-b189-6da4a3ad6f88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e09765af8ed94b42b404f0846e132cdd'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:10.971241 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c3c6c19f-4e64-4885-b189-6da4a3ad6f88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e09765af8ed94b42b404f0846e132cdd'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:10.979847 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c3c6c19f-4e64-4885-b189-6da4a3ad6f88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e09765af8ed94b42b404f0846e132cdd'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:10.986700 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 876/1742] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:10 2022] DELETE /identity/v3/users/e09765af8ed94b42b404f0846e132cdd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:10.988371 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:10.991455 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a398a7-96af-4468-a85d-d1e2cc7b977f None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:10.992198 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a398a7-96af-4468-a85d-d1e2cc7b977f None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:10.992740 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a99cb-7005-460a-8876-61117f5c0a3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:10.993287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a398a7-96af-4468-a85d-d1e2cc7b977f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:10.994864 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a99cb-7005-460a-8876-61117f5c0a3d service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:11.006639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 867/1743] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:42:11.019311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-b7a398a7-96af-4468-a85d-d1e2cc7b977f None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:11.020786 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b7a398a7-96af-4468-a85d-d1e2cc7b977f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:11.137927 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 877/1744] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:11.145733 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a99cb-7005-460a-8876-61117f5c0a3d service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:11.147287 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-3c0a99cb-7005-460a-8876-61117f5c0a3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:11.239355 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a99cb-7005-460a-8876-61117f5c0a3d service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:11.299031 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417522c8-f63f-44fa-913a-b70e9bb49819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:11.299640 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417522c8-f63f-44fa-913a-b70e9bb49819 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:11.299918 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417522c8-f63f-44fa-913a-b70e9bb49819 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:11.300190 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417522c8-f63f-44fa-913a-b70e9bb49819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:11.309006 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417522c8-f63f-44fa-913a-b70e9bb49819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:11.310464 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417522c8-f63f-44fa-913a-b70e9bb49819 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:11.320318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 868/1745] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:42:11.602697 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a398a7-96af-4468-a85d-d1e2cc7b977f None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:11.604211 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b7a398a7-96af-4468-a85d-d1e2cc7b977f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:11.621108 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a398a7-96af-4468-a85d-d1e2cc7b977f None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:11.627210 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb408a5d-7554-4de5-8e6b-23db4935b6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:11.628152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb408a5d-7554-4de5-8e6b-23db4935b6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:11.628402 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb408a5d-7554-4de5-8e6b-23db4935b6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:11.628685 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb408a5d-7554-4de5-8e6b-23db4935b6a6 admin admin] PATH_INFO: `/v3/projects/fd9fba90bc0245dca4bd9d65a96f8db5` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:11.630258 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb408a5d-7554-4de5-8e6b-23db4935b6a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd9fba90bc0245dca4bd9d65a96f8db5)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:11.632673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb408a5d-7554-4de5-8e6b-23db4935b6a6 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:11.661579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:11.690405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fb408a5d-7554-4de5-8e6b-23db4935b6a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd9fba90bc0245dca4bd9d65a96f8db5', 'request_id': 'req-fb408a5d-7554-4de5-8e6b-23db4935b6a6'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:11.697240 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fb408a5d-7554-4de5-8e6b-23db4935b6a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd9fba90bc0245dca4bd9d65a96f8db5', 'request_id': 'req-fb408a5d-7554-4de5-8e6b-23db4935b6a6'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:11.703772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fb408a5d-7554-4de5-8e6b-23db4935b6a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd9fba90bc0245dca4bd9d65a96f8db5', 'request_id': 'req-fb408a5d-7554-4de5-8e6b-23db4935b6a6'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:11.716925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fb408a5d-7554-4de5-8e6b-23db4935b6a6 admin admin] The token cache is being invalidate because project fd9fba90bc0245dca4bd9d65a96f8db5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:11.717911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fb408a5d-7554-4de5-8e6b-23db4935b6a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:11.718766 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fb408a5d-7554-4de5-8e6b-23db4935b6a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:11.720055 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 878/1746] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:11 2022] DELETE /identity/v3/projects/fd9fba90bc0245dca4bd9d65a96f8db5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:11.727587 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618aacb-0a68-4ad8-9eba-220dd16a88e9 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:11.728467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618aacb-0a68-4ad8-9eba-220dd16a88e9 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:11.728807 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618aacb-0a68-4ad8-9eba-220dd16a88e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:11.749507 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-0618aacb-0a68-4ad8-9eba-220dd16a88e9 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:11.750732 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-0618aacb-0a68-4ad8-9eba-220dd16a88e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:11.810152 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 869/1747] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:11.818516 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e88b8-be5b-4ec6-b4ba-b46c18d87960 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:11.818801 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e88b8-be5b-4ec6-b4ba-b46c18d87960 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:11.819071 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e88b8-be5b-4ec6-b4ba-b46c18d87960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:11.839965 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-691e88b8-be5b-4ec6-b4ba-b46c18d87960 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:11.841238 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-691e88b8-be5b-4ec6-b4ba-b46c18d87960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:11.849450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 879/1748] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:11.853747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618aacb-0a68-4ad8-9eba-220dd16a88e9 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:11.863439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618aacb-0a68-4ad8-9eba-220dd16a88e9 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:11.868148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21755c43-c690-40a7-8b70-8be7649637fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:11.868756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21755c43-c690-40a7-8b70-8be7649637fc admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:11.869034 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21755c43-c690-40a7-8b70-8be7649637fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:11.869304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21755c43-c690-40a7-8b70-8be7649637fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:11.869980 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21755c43-c690-40a7-8b70-8be7649637fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:42:11.870323 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21755c43-c690-40a7-8b70-8be7649637fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:11.871953 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21755c43-c690-40a7-8b70-8be7649637fc admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:11.886238 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 870/1749] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:42:11.890660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e88b8-be5b-4ec6-b4ba-b46c18d87960 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:11.900720 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e88b8-be5b-4ec6-b4ba-b46c18d87960 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:11.905344 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d644d-f411-4f25-83ef-f1e0bbd4cc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:11.905972 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d644d-f411-4f25-83ef-f1e0bbd4cc77 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:11.906253 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d644d-f411-4f25-83ef-f1e0bbd4cc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:11.906522 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d644d-f411-4f25-83ef-f1e0bbd4cc77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:11.907158 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d644d-f411-4f25-83ef-f1e0bbd4cc77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:11.909629 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d644d-f411-4f25-83ef-f1e0bbd4cc77 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:11.939225 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 880/1750] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:11 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:11.944067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21755c43-c690-40a7-8b70-8be7649637fc admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:11.953984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21755c43-c690-40a7-8b70-8be7649637fc admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:11.991606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:12.010448 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586e650-b88c-475e-bd12-0730f1cc6102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:12.011052 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586e650-b88c-475e-bd12-0730f1cc6102 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:12.011332 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586e650-b88c-475e-bd12-0730f1cc6102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:12.011600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586e650-b88c-475e-bd12-0730f1cc6102 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:12.012229 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586e650-b88c-475e-bd12-0730f1cc6102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:12.014159 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586e650-b88c-475e-bd12-0730f1cc6102 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:12.035918 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 871/1751] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:11 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:42:12.040214 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d644d-f411-4f25-83ef-f1e0bbd4cc77 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:12.050233 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d644d-f411-4f25-83ef-f1e0bbd4cc77 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:12.055314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693254e6-05da-45bc-83fb-3fb874d0fcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:12.055944 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693254e6-05da-45bc-83fb-3fb874d0fcbe admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:12.056218 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693254e6-05da-45bc-83fb-3fb874d0fcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:12.056486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693254e6-05da-45bc-83fb-3fb874d0fcbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:12.057119 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693254e6-05da-45bc-83fb-3fb874d0fcbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:12.058867 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693254e6-05da-45bc-83fb-3fb874d0fcbe admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:12.070028 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 881/1752] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:12.074163 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586e650-b88c-475e-bd12-0730f1cc6102 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:12.084985 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586e650-b88c-475e-bd12-0730f1cc6102 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:12.089750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82c804-a22e-4e4a-9099-9b90b5e057ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:12.090389 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82c804-a22e-4e4a-9099-9b90b5e057ac admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:12.090674 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82c804-a22e-4e4a-9099-9b90b5e057ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:12.090952 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82c804-a22e-4e4a-9099-9b90b5e057ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:12.091595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82c804-a22e-4e4a-9099-9b90b5e057ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:12.093196 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82c804-a22e-4e4a-9099-9b90b5e057ac admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:12.103904 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 872/1753] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:12.107909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693254e6-05da-45bc-83fb-3fb874d0fcbe admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:12.118275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693254e6-05da-45bc-83fb-3fb874d0fcbe admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:12.123004 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfe58d-0b79-41bc-9036-29c7258d2a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:12.123661 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfe58d-0b79-41bc-9036-29c7258d2a9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:12.123940 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfe58d-0b79-41bc-9036-29c7258d2a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:12.124216 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfe58d-0b79-41bc-9036-29c7258d2a9d admin admin] PATH_INFO: `/v3/projects/d52bb2caa6574cbe805ea957cf2b5144/users/867471cb81d941d79b0f3433731dc3b8/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:12.140517 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfe58d-0b79-41bc-9036-29c7258d2a9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52bb2caa6574cbe805ea957cf2b5144, user_id=867471cb81d941d79b0f3433731dc3b8, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:12.143236 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfe58d-0b79-41bc-9036-29c7258d2a9d admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:12.158632 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 882/1754] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:12 2022] PUT /identity/v3/projects/d52bb2caa6574cbe805ea957cf2b5144/users/867471cb81d941d79b0f3433731dc3b8/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:12.168808 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b87b2-9ee4-41df-bf87-f6076902b67e None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:12.169095 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b87b2-9ee4-41df-bf87-f6076902b67e None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:12.169418 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b87b2-9ee4-41df-bf87-f6076902b67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:12.204361 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-978b87b2-9ee4-41df-bf87-f6076902b67e None None] MFA Rules not processed for user `867471cb81d941d79b0f3433731dc3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:12.205752 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-978b87b2-9ee4-41df-bf87-f6076902b67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:12.276197 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 873/1755] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:12.300485 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfe58d-0b79-41bc-9036-29c7258d2a9d admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:12.302603 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e5cfe58d-0b79-41bc-9036-29c7258d2a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:12.315088 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b87b2-9ee4-41df-bf87-f6076902b67e None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:12.316506 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-978b87b2-9ee4-41df-bf87-f6076902b67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:12.377921 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfe58d-0b79-41bc-9036-29c7258d2a9d admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:12.383291 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53e444-4408-4377-9a4d-425cb04ac73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:12.383934 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53e444-4408-4377-9a4d-425cb04ac73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:12.384216 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53e444-4408-4377-9a4d-425cb04ac73a admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:12.384640 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53e444-4408-4377-9a4d-425cb04ac73a admin admin] PATH_INFO: `/v3/users/fec8f3e8e08c4abb97374732c6524f3a` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:12.385774 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53e444-4408-4377-9a4d-425cb04ac73a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fec8f3e8e08c4abb97374732c6524f3a)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:12.386132 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b87b2-9ee4-41df-bf87-f6076902b67e None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:12.387752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53e444-4408-4377-9a4d-425cb04ac73a admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:12.390712 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cc74f-b4df-4f4b-a4a2-d8268890326b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:12.391455 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cc74f-b4df-4f4b-a4a2-d8268890326b service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:12.391743 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cc74f-b4df-4f4b-a4a2-d8268890326b service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:12.392016 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cc74f-b4df-4f4b-a4a2-d8268890326b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:12.403762 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1cc74f-b4df-4f4b-a4a2-d8268890326b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:12.405755 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1cc74f-b4df-4f4b-a4a2-d8268890326b service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:12.416600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 874/1756] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:42:12.454287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-2a53e444-4408-4377-9a4d-425cb04ac73a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fec8f3e8e08c4abb97374732c6524f3a'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:12.456710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:12.465443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-2a53e444-4408-4377-9a4d-425cb04ac73a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fec8f3e8e08c4abb97374732c6524f3a'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:12.482802 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-2a53e444-4408-4377-9a4d-425cb04ac73a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fec8f3e8e08c4abb97374732c6524f3a'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:12.483914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-2a53e444-4408-4377-9a4d-425cb04ac73a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fec8f3e8e08c4abb97374732c6524f3a'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:12.494657 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-2a53e444-4408-4377-9a4d-425cb04ac73a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fec8f3e8e08c4abb97374732c6524f3a'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:12.503527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 883/1757] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:12 2022] DELETE /identity/v3/users/fec8f3e8e08c4abb97374732c6524f3a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:12.508305 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d6800-5bf6-4c90-a1c2-529d200ec922 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:12.508889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d6800-5bf6-4c90-a1c2-529d200ec922 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:12.509352 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d6800-5bf6-4c90-a1c2-529d200ec922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:12.536645 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-c45d6800-5bf6-4c90-a1c2-529d200ec922 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:12.539550 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-c45d6800-5bf6-4c90-a1c2-529d200ec922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:12.675414 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:12.715019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 875/1758] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:12.725392 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53e444-4408-4377-9a4d-425cb04ac73a admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:12.726894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2a53e444-4408-4377-9a4d-425cb04ac73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:12.774778 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d6800-5bf6-4c90-a1c2-529d200ec922 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:12.776346 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-c45d6800-5bf6-4c90-a1c2-529d200ec922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:12.792819 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d6800-5bf6-4c90-a1c2-529d200ec922 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:12.802086 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25fe9f-28cd-4d1a-88ea-190af55e7802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:12.802996 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25fe9f-28cd-4d1a-88ea-190af55e7802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:12.803142 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25fe9f-28cd-4d1a-88ea-190af55e7802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:12.803673 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25fe9f-28cd-4d1a-88ea-190af55e7802 admin admin] PATH_INFO: `/v3/users/a5c371fd287d4df7a3825fd3c0d779ce` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:12.804764 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25fe9f-28cd-4d1a-88ea-190af55e7802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5c371fd287d4df7a3825fd3c0d779ce)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:12.807797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25fe9f-28cd-4d1a-88ea-190af55e7802 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:12.811018 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53e444-4408-4377-9a4d-425cb04ac73a admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:12.817353 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254c03-2246-427e-9511-ac56842c3c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:12.818365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254c03-2246-427e-9511-ac56842c3c62 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:12.818867 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254c03-2246-427e-9511-ac56842c3c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:12.820373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254c03-2246-427e-9511-ac56842c3c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:12.832478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c254c03-2246-427e-9511-ac56842c3c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:12.834470 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c254c03-2246-427e-9511-ac56842c3c62 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:12.847097 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 884/1759] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:12.945003 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0e25fe9f-28cd-4d1a-88ea-190af55e7802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5c371fd287d4df7a3825fd3c0d779ce'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:12.959290 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0e25fe9f-28cd-4d1a-88ea-190af55e7802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5c371fd287d4df7a3825fd3c0d779ce'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:12.960261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0e25fe9f-28cd-4d1a-88ea-190af55e7802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5c371fd287d4df7a3825fd3c0d779ce'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:12.961542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0e25fe9f-28cd-4d1a-88ea-190af55e7802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5c371fd287d4df7a3825fd3c0d779ce'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:12.974843 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0e25fe9f-28cd-4d1a-88ea-190af55e7802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5c371fd287d4df7a3825fd3c0d779ce'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:13.000941 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 876/1760] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:12 2022] DELETE /identity/v3/users/a5c371fd287d4df7a3825fd3c0d779ce => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:42:13.005883 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27950db1-ff57-4e70-b699-5ec141bd0741 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:13.006181 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27950db1-ff57-4e70-b699-5ec141bd0741 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:13.006523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27950db1-ff57-4e70-b699-5ec141bd0741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:13.029878 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-27950db1-ff57-4e70-b699-5ec141bd0741 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:13.031469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-27950db1-ff57-4e70-b699-5ec141bd0741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:13.108348 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 885/1761] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:13.120863 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25fe9f-28cd-4d1a-88ea-190af55e7802 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:13.122376 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-0e25fe9f-28cd-4d1a-88ea-190af55e7802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:13.198711 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25fe9f-28cd-4d1a-88ea-190af55e7802 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:13.202610 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27ce1d-1b25-4809-a914-13bbda68094e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:13.205761 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27ce1d-1b25-4809-a914-13bbda68094e service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:13.205761 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27ce1d-1b25-4809-a914-13bbda68094e service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:13.205761 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27ce1d-1b25-4809-a914-13bbda68094e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:13.207027 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27950db1-ff57-4e70-b699-5ec141bd0741 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:13.208708 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-27950db1-ff57-4e70-b699-5ec141bd0741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:13.215757 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27ce1d-1b25-4809-a914-13bbda68094e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:13.217307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27ce1d-1b25-4809-a914-13bbda68094e service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:13.220696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27950db1-ff57-4e70-b699-5ec141bd0741 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:13.226138 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab683a-6af9-412d-85c7-423f24beef74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:13.230011 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 877/1762] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:13.234474 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab683a-6af9-412d-85c7-423f24beef74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:13.235671 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab683a-6af9-412d-85c7-423f24beef74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:13.235671 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab683a-6af9-412d-85c7-423f24beef74 admin admin] PATH_INFO: `/v3/projects/5a6f58e35e66431891b9de452a8682d8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:13.236294 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab683a-6af9-412d-85c7-423f24beef74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a6f58e35e66431891b9de452a8682d8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:13.238687 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab683a-6af9-412d-85c7-423f24beef74 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:13.296393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-1bab683a-6af9-412d-85c7-423f24beef74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a6f58e35e66431891b9de452a8682d8', 'request_id': 'req-1bab683a-6af9-412d-85c7-423f24beef74'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:13.302353 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-1bab683a-6af9-412d-85c7-423f24beef74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a6f58e35e66431891b9de452a8682d8', 'request_id': 'req-1bab683a-6af9-412d-85c7-423f24beef74'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:13.310186 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-1bab683a-6af9-412d-85c7-423f24beef74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a6f58e35e66431891b9de452a8682d8', 'request_id': 'req-1bab683a-6af9-412d-85c7-423f24beef74'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:13.311329 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:13.324127 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-1bab683a-6af9-412d-85c7-423f24beef74 admin admin] The token cache is being invalidate because project 5a6f58e35e66431891b9de452a8682d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:13.324863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-1bab683a-6af9-412d-85c7-423f24beef74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:13.326698 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-1bab683a-6af9-412d-85c7-423f24beef74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:13.328529 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 886/1763] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:13 2022] DELETE /identity/v3/projects/5a6f58e35e66431891b9de452a8682d8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:42:13.334753 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0deb23b-e67f-4e87-9a31-35fe774ba194 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:13.335122 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0deb23b-e67f-4e87-9a31-35fe774ba194 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:13.335440 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0deb23b-e67f-4e87-9a31-35fe774ba194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:13.360467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-d0deb23b-e67f-4e87-9a31-35fe774ba194 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:13.361751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d0deb23b-e67f-4e87-9a31-35fe774ba194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:13.434015 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 878/1764] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:13.441808 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40ad1d-8b59-4b37-a3c7-c9559eb21deb None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:13.442344 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40ad1d-8b59-4b37-a3c7-c9559eb21deb None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:13.442732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40ad1d-8b59-4b37-a3c7-c9559eb21deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:13.463877 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-ad40ad1d-8b59-4b37-a3c7-c9559eb21deb None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:13.465120 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ad40ad1d-8b59-4b37-a3c7-c9559eb21deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:13.473269 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 887/1765] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:13.477537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0deb23b-e67f-4e87-9a31-35fe774ba194 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:13.487180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0deb23b-e67f-4e87-9a31-35fe774ba194 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:13.492829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37339d7f-dae7-469b-bb92-27e52364064a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:13.493568 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37339d7f-dae7-469b-bb92-27e52364064a admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:13.493987 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37339d7f-dae7-469b-bb92-27e52364064a admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:13.494365 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37339d7f-dae7-469b-bb92-27e52364064a admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:13.496564 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37339d7f-dae7-469b-bb92-27e52364064a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:42:13.496564 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37339d7f-dae7-469b-bb92-27e52364064a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:13.497445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37339d7f-dae7-469b-bb92-27e52364064a admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:13.499582 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:13.517351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 879/1766] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:42:13.519044 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40ad1d-8b59-4b37-a3c7-c9559eb21deb None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:13.528880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40ad1d-8b59-4b37-a3c7-c9559eb21deb None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:13.537141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0dd67-80fe-4f80-9ae9-e3fabcb74af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:13.537764 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0dd67-80fe-4f80-9ae9-e3fabcb74af9 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:13.538130 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0dd67-80fe-4f80-9ae9-e3fabcb74af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:13.538403 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0dd67-80fe-4f80-9ae9-e3fabcb74af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:13.539048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0dd67-80fe-4f80-9ae9-e3fabcb74af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:13.540950 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0dd67-80fe-4f80-9ae9-e3fabcb74af9 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:13.564775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37339d7f-dae7-469b-bb92-27e52364064a admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:13.567721 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-37339d7f-dae7-469b-bb92-27e52364064a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:13.574210 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 888/1767] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:13 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:13.578257 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0dd67-80fe-4f80-9ae9-e3fabcb74af9 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:13.593976 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37339d7f-dae7-469b-bb92-27e52364064a admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:13.651415 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0dd67-80fe-4f80-9ae9-e3fabcb74af9 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:13.656729 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9544d-f459-4b9c-b146-daf560972ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:13.657421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9544d-f459-4b9c-b146-daf560972ddb admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:13.657831 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9544d-f459-4b9c-b146-daf560972ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:13.658139 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9544d-f459-4b9c-b146-daf560972ddb admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:13.658841 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9544d-f459-4b9c-b146-daf560972ddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:13.661961 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9544d-f459-4b9c-b146-daf560972ddb admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:13.663479 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae0577-4af7-4156-8f37-5b2d12a561ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:13.664125 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae0577-4af7-4156-8f37-5b2d12a561ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:13.664422 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae0577-4af7-4156-8f37-5b2d12a561ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:13.664674 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae0577-4af7-4156-8f37-5b2d12a561ce admin admin] PATH_INFO: `/v3/projects/3706993deb3b4e968f985320241638b3` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:13.665801 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae0577-4af7-4156-8f37-5b2d12a561ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=3706993deb3b4e968f985320241638b3)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:13.667739 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae0577-4af7-4156-8f37-5b2d12a561ce admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:13.685882 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 889/1768] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:13 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:42:13.690172 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9544d-f459-4b9c-b146-daf560972ddb admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:13.701197 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9544d-f459-4b9c-b146-daf560972ddb admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:13.706752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc389e-59df-4027-b84c-18e8c25c3dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:13.707556 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc389e-59df-4027-b84c-18e8c25c3dff admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:13.708261 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc389e-59df-4027-b84c-18e8c25c3dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:13.708261 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc389e-59df-4027-b84c-18e8c25c3dff admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:13.708733 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc389e-59df-4027-b84c-18e8c25c3dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:13.710380 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc389e-59df-4027-b84c-18e8c25c3dff admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:13.720981 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 890/1769] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:42:13.724984 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ebae0577-4af7-4156-8f37-5b2d12a561ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3706993deb3b4e968f985320241638b3', 'request_id': 'req-ebae0577-4af7-4156-8f37-5b2d12a561ce'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:13.725192 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc389e-59df-4027-b84c-18e8c25c3dff admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:13.734111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ebae0577-4af7-4156-8f37-5b2d12a561ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3706993deb3b4e968f985320241638b3', 'request_id': 'req-ebae0577-4af7-4156-8f37-5b2d12a561ce'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:13.735936 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc389e-59df-4027-b84c-18e8c25c3dff admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:13.743017 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ebae0577-4af7-4156-8f37-5b2d12a561ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3706993deb3b4e968f985320241638b3', 'request_id': 'req-ebae0577-4af7-4156-8f37-5b2d12a561ce'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:13.759382 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ebae0577-4af7-4156-8f37-5b2d12a561ce admin admin] The token cache is being invalidate because project 3706993deb3b4e968f985320241638b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:13.759653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ebae0577-4af7-4156-8f37-5b2d12a561ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:13.760927 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ebae0577-4af7-4156-8f37-5b2d12a561ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:13.765885 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 880/1770] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:13 2022] DELETE /identity/v3/projects/3706993deb3b4e968f985320241638b3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:42:13.773541 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce69a4-c163-46c9-b836-47de0b8e3ca4 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:13.773888 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce69a4-c163-46c9-b836-47de0b8e3ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:13.774265 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce69a4-c163-46c9-b836-47de0b8e3ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:13.802373 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-4cce69a4-c163-46c9-b836-47de0b8e3ca4 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:13.803682 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-4cce69a4-c163-46c9-b836-47de0b8e3ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:13.807845 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e2358-d81d-43f5-9777-f5b11b8c4e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:13.808469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e2358-d81d-43f5-9777-f5b11b8c4e37 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:13.808749 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e2358-d81d-43f5-9777-f5b11b8c4e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:13.809021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e2358-d81d-43f5-9777-f5b11b8c4e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:13.809666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e2358-d81d-43f5-9777-f5b11b8c4e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:13.811548 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e2358-d81d-43f5-9777-f5b11b8c4e37 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:13.813737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 881/1771] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:13.822160 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9666d5f-8c6d-44d8-bf82-697ff6456a16 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:13.822451 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9666d5f-8c6d-44d8-bf82-697ff6456a16 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:13.822725 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9666d5f-8c6d-44d8-bf82-697ff6456a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:13.828459 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 891/1772] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:42:13.833335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e2358-d81d-43f5-9777-f5b11b8c4e37 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:13.836253 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-774e2358-d81d-43f5-9777-f5b11b8c4e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:13.847203 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-f9666d5f-8c6d-44d8-bf82-697ff6456a16 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:13.848768 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-f9666d5f-8c6d-44d8-bf82-697ff6456a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:13.854793 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e2358-d81d-43f5-9777-f5b11b8c4e37 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:13.858827 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 882/1773] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:13.864312 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac025cd-42b6-4a80-88ec-93477a9101ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:13.864714 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9666d5f-8c6d-44d8-bf82-697ff6456a16 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:13.865638 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac025cd-42b6-4a80-88ec-93477a9101ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:13.865938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac025cd-42b6-4a80-88ec-93477a9101ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:13.866217 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac025cd-42b6-4a80-88ec-93477a9101ac admin admin] PATH_INFO: `/v3/projects/935d19cdf6014527b779d4596bd8a6e8/users/8b11dd89a2d6402395d31125dc1ba007/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:13.876502 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9666d5f-8c6d-44d8-bf82-697ff6456a16 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:13.885173 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac025cd-42b6-4a80-88ec-93477a9101ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=935d19cdf6014527b779d4596bd8a6e8, user_id=8b11dd89a2d6402395d31125dc1ba007, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:13.886297 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a7722-a932-4818-b546-1f382f7830e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:13.887027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a7722-a932-4818-b546-1f382f7830e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:13.887405 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a7722-a932-4818-b546-1f382f7830e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:13.887789 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a7722-a932-4818-b546-1f382f7830e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:13.888002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac025cd-42b6-4a80-88ec-93477a9101ac admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:13.889762 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a7722-a932-4818-b546-1f382f7830e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:42:13.889762 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a7722-a932-4818-b546-1f382f7830e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:13.891346 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a7722-a932-4818-b546-1f382f7830e9 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:13.907763 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 892/1774] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:13 2022] PUT /identity/v3/projects/935d19cdf6014527b779d4596bd8a6e8/users/8b11dd89a2d6402395d31125dc1ba007/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:13.914470 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 883/1775] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:42:13.922517 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac025cd-42b6-4a80-88ec-93477a9101ac admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:13.926139 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212b8a1-4467-41c0-8eea-886a66281b1f None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:13.926707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212b8a1-4467-41c0-8eea-886a66281b1f None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:13.927690 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212b8a1-4467-41c0-8eea-886a66281b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:13.966784 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:13.998685 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-e212b8a1-4467-41c0-8eea-886a66281b1f None None] MFA Rules not processed for user `8b11dd89a2d6402395d31125dc1ba007`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:14.002542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e212b8a1-4467-41c0-8eea-886a66281b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:14.034276 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac025cd-42b6-4a80-88ec-93477a9101ac admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:14.041601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fb68e-9580-4664-90cc-cd67b9c2f32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:14.042650 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fb68e-9580-4664-90cc-cd67b9c2f32b admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:14.042939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fb68e-9580-4664-90cc-cd67b9c2f32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:14.043387 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fb68e-9580-4664-90cc-cd67b9c2f32b admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:14.044180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fb68e-9580-4664-90cc-cd67b9c2f32b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:14.047044 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fb68e-9580-4664-90cc-cd67b9c2f32b admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:14.086690 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:14.089436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 893/1776] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:13 2022] POST /identity/v3/projects => generated 365 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:14.095372 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fb68e-9580-4664-90cc-cd67b9c2f32b admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:14.127724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 884/1777] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:14.142265 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212b8a1-4467-41c0-8eea-886a66281b1f None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:14.161832 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212b8a1-4467-41c0-8eea-886a66281b1f None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:14.209024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fb68e-9580-4664-90cc-cd67b9c2f32b admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:14.215946 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a771191-7ea8-4daa-87ed-584c55b2ccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:14.216784 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a771191-7ea8-4daa-87ed-584c55b2ccf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:14.217124 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a771191-7ea8-4daa-87ed-584c55b2ccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:14.217827 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a771191-7ea8-4daa-87ed-584c55b2ccf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:14.218861 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a771191-7ea8-4daa-87ed-584c55b2ccf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:14.221311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a771191-7ea8-4daa-87ed-584c55b2ccf8 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:14.246340 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd0749-58a3-4cee-add2-c4b6929e8f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:14.246956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd0749-58a3-4cee-add2-c4b6929e8f2f admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:14.247234 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd0749-58a3-4cee-add2-c4b6929e8f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:14.247502 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd0749-58a3-4cee-add2-c4b6929e8f2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:14.248131 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd0749-58a3-4cee-add2-c4b6929e8f2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:14.248702 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 894/1778] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:14 2022] POST /identity/v3/users => generated 283 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:42:14.250332 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd0749-58a3-4cee-add2-c4b6929e8f2f admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:14.255924 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a771191-7ea8-4daa-87ed-584c55b2ccf8 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:14.272679 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a771191-7ea8-4daa-87ed-584c55b2ccf8 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:14.278194 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8fd0a-e5b2-4022-9ede-7b8734d50659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:14.278811 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8fd0a-e5b2-4022-9ede-7b8734d50659 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:14.279091 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8fd0a-e5b2-4022-9ede-7b8734d50659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:14.279361 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8fd0a-e5b2-4022-9ede-7b8734d50659 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:14.280153 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8fd0a-e5b2-4022-9ede-7b8734d50659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:14.281839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8fd0a-e5b2-4022-9ede-7b8734d50659 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:14.293754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 895/1779] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:14.297939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8fd0a-e5b2-4022-9ede-7b8734d50659 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:14.313089 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8fd0a-e5b2-4022-9ede-7b8734d50659 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:14.318491 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 885/1780] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:14 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:14.322583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd0749-58a3-4cee-add2-c4b6929e8f2f admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:14.412401 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd0749-58a3-4cee-add2-c4b6929e8f2f admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:14.416132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059bd52-f618-455c-8f0a-060c6c49355a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:14.416774 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059bd52-f618-455c-8f0a-060c6c49355a admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:14.417056 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059bd52-f618-455c-8f0a-060c6c49355a admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:14.417355 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059bd52-f618-455c-8f0a-060c6c49355a admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:14.418032 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059bd52-f618-455c-8f0a-060c6c49355a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:14.419255 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b434a-e4e1-4a7b-8f43-6bec34664468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:14.419661 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059bd52-f618-455c-8f0a-060c6c49355a admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:14.420397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b434a-e4e1-4a7b-8f43-6bec34664468 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:14.420987 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b434a-e4e1-4a7b-8f43-6bec34664468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:14.421426 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b434a-e4e1-4a7b-8f43-6bec34664468 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:14.422244 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b434a-e4e1-4a7b-8f43-6bec34664468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:14.424482 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b434a-e4e1-4a7b-8f43-6bec34664468 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:14.434002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 896/1781] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:14.438751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059bd52-f618-455c-8f0a-060c6c49355a admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:14.453574 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 886/1782] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:14 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:14.453712 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059bd52-f618-455c-8f0a-060c6c49355a admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:14.458448 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b434a-e4e1-4a7b-8f43-6bec34664468 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:14.459757 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365117a7-eb8d-4ce4-8426-a30d035b88ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:14.460433 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365117a7-eb8d-4ce4-8426-a30d035b88ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:14.460712 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365117a7-eb8d-4ce4-8426-a30d035b88ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:14.461019 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365117a7-eb8d-4ce4-8426-a30d035b88ae admin admin] PATH_INFO: `/v3/projects/897a3c9a55594ae999a6d991bb517d08/users/b60f8f6c092843c3aafdbe02f15221e4/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:14.469236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b434a-e4e1-4a7b-8f43-6bec34664468 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:14.478013 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:14.478322 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfc82f-bf1e-40a3-9f22-9b4d3ca1fc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:14.478936 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfc82f-bf1e-40a3-9f22-9b4d3ca1fc59 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:14.479221 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfc82f-bf1e-40a3-9f22-9b4d3ca1fc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:14.479615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfc82f-bf1e-40a3-9f22-9b4d3ca1fc59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:14.480397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dfc82f-bf1e-40a3-9f22-9b4d3ca1fc59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:14.482410 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dfc82f-bf1e-40a3-9f22-9b4d3ca1fc59 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:14.487393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365117a7-eb8d-4ce4-8426-a30d035b88ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=897a3c9a55594ae999a6d991bb517d08, user_id=b60f8f6c092843c3aafdbe02f15221e4, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:14.491378 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365117a7-eb8d-4ce4-8426-a30d035b88ae admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:14.500302 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 887/1783] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:14.504320 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfc82f-bf1e-40a3-9f22-9b4d3ca1fc59 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:14.524345 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 897/1784] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:14 2022] PUT /identity/v3/projects/897a3c9a55594ae999a6d991bb517d08/users/b60f8f6c092843c3aafdbe02f15221e4/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:14.526835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfc82f-bf1e-40a3-9f22-9b4d3ca1fc59 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:14.530006 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d02a1-8cf6-43ec-b483-087819fcdb16 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:14.530831 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d02a1-8cf6-43ec-b483-087819fcdb16 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:14.531116 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d02a1-8cf6-43ec-b483-087819fcdb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:14.603719 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-114d02a1-8cf6-43ec-b483-087819fcdb16 None None] MFA Rules not processed for user `b60f8f6c092843c3aafdbe02f15221e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:14.604941 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-114d02a1-8cf6-43ec-b483-087819fcdb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:14.612820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:14.631656 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b8b9c-eed6-4647-bccf-7a829348862e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:14.632343 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b8b9c-eed6-4647-bccf-7a829348862e admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:14.632629 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b8b9c-eed6-4647-bccf-7a829348862e admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:14.632906 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b8b9c-eed6-4647-bccf-7a829348862e admin admin] PATH_INFO: `/v3/projects/86c1c56a16b442d0a5af75d8febce914/users/8c2ff9c11891457bad6376339b8087fe/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:14.661999 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b8b9c-eed6-4647-bccf-7a829348862e admin admin] RBAC: Authorizing `identity:create_grant(project_id=86c1c56a16b442d0a5af75d8febce914, user_id=8c2ff9c11891457bad6376339b8087fe, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:14.666743 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b8b9c-eed6-4647-bccf-7a829348862e admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:14.689690 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 888/1785] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:14 2022] PUT /identity/v3/projects/86c1c56a16b442d0a5af75d8febce914/users/8c2ff9c11891457bad6376339b8087fe/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:14.690618 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b8b9c-eed6-4647-bccf-7a829348862e admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:14.710857 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 898/1786] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:14.723181 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d02a1-8cf6-43ec-b483-087819fcdb16 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:14.726051 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-114d02a1-8cf6-43ec-b483-087819fcdb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:14.774760 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b8b9c-eed6-4647-bccf-7a829348862e admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:14.780536 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8651f81-2568-44e3-a243-35cdc74be864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:14.781235 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8651f81-2568-44e3-a243-35cdc74be864 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:14.781587 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8651f81-2568-44e3-a243-35cdc74be864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:14.781934 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8651f81-2568-44e3-a243-35cdc74be864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:14.782657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8651f81-2568-44e3-a243-35cdc74be864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:14.784429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8651f81-2568-44e3-a243-35cdc74be864 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:14.789077 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d02a1-8cf6-43ec-b483-087819fcdb16 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:14.795995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 889/1787] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:14.801506 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8651f81-2568-44e3-a243-35cdc74be864 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:14.811850 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8651f81-2568-44e3-a243-35cdc74be864 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:14.818038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7317e-c06a-4457-9156-19e8786e5a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:14.818706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7317e-c06a-4457-9156-19e8786e5a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:14.818985 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7317e-c06a-4457-9156-19e8786e5a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:14.819264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7317e-c06a-4457-9156-19e8786e5a2b admin admin] PATH_INFO: `/v3/projects/86c1c56a16b442d0a5af75d8febce914/users/8c2ff9c11891457bad6376339b8087fe/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:14.821179 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7317e-c06a-4457-9156-19e8786e5a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=86c1c56a16b442d0a5af75d8febce914, user_id=8c2ff9c11891457bad6376339b8087fe, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:14.823867 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7317e-c06a-4457-9156-19e8786e5a2b admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:14.835059 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 890/1788] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:14 2022] PUT /identity/v3/projects/86c1c56a16b442d0a5af75d8febce914/users/8c2ff9c11891457bad6376339b8087fe/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:14.845363 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa705265-fa98-4cee-86bb-423367ffbf3a None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:14.845694 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa705265-fa98-4cee-86bb-423367ffbf3a None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:14.845976 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa705265-fa98-4cee-86bb-423367ffbf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:14.857105 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd4230-8ceb-4c7b-8f61-cd7bc63b46ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:14.858028 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd4230-8ceb-4c7b-8f61-cd7bc63b46ff service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:14.862088 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd4230-8ceb-4c7b-8f61-cd7bc63b46ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:14.862088 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd4230-8ceb-4c7b-8f61-cd7bc63b46ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:14.875510 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-aa705265-fa98-4cee-86bb-423367ffbf3a None None] MFA Rules not processed for user `8c2ff9c11891457bad6376339b8087fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:14.876729 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-aa705265-fa98-4cee-86bb-423367ffbf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:14.917237 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:14.927989 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd4230-8ceb-4c7b-8f61-cd7bc63b46ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:14.929433 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd4230-8ceb-4c7b-8f61-cd7bc63b46ff service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:14.938273 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 899/1789] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:42:14.950460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 891/1790] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:14.961900 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd4230-8ceb-4c7b-8f61-cd7bc63b46ff service cinder] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:14.963278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-23bd4230-8ceb-4c7b-8f61-cd7bc63b46ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:14.975798 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd4230-8ceb-4c7b-8f61-cd7bc63b46ff service cinder] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:15.037626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0913e93-905c-4d29-9553-54b88858ce6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:15.038607 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0913e93-905c-4d29-9553-54b88858ce6a service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:15.038892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0913e93-905c-4d29-9553-54b88858ce6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:15.039226 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0913e93-905c-4d29-9553-54b88858ce6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:15.127324 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0913e93-905c-4d29-9553-54b88858ce6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:15.130314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0913e93-905c-4d29-9553-54b88858ce6a service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:15.140169 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 900/1791] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:15.899167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa705265-fa98-4cee-86bb-423367ffbf3a None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:15.900607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-aa705265-fa98-4cee-86bb-423367ffbf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:15.948775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:15.969819 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa705265-fa98-4cee-86bb-423367ffbf3a None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:15.975004 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d8571-75ea-4072-b022-227b29303b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:15.975633 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d8571-75ea-4072-b022-227b29303b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:15.975913 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d8571-75ea-4072-b022-227b29303b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:15.976184 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d8571-75ea-4072-b022-227b29303b41 admin admin] PATH_INFO: `/v3/users/867471cb81d941d79b0f3433731dc3b8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:15.977294 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d8571-75ea-4072-b022-227b29303b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=867471cb81d941d79b0f3433731dc3b8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:15.979279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d8571-75ea-4072-b022-227b29303b41 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:16.026022 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-da5d8571-75ea-4072-b022-227b29303b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '867471cb81d941d79b0f3433731dc3b8'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:16.033321 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-da5d8571-75ea-4072-b022-227b29303b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '867471cb81d941d79b0f3433731dc3b8'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:16.034057 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-da5d8571-75ea-4072-b022-227b29303b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '867471cb81d941d79b0f3433731dc3b8'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:16.035396 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-da5d8571-75ea-4072-b022-227b29303b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '867471cb81d941d79b0f3433731dc3b8'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:16.042408 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-da5d8571-75ea-4072-b022-227b29303b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '867471cb81d941d79b0f3433731dc3b8'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:16.060454 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 892/1792] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:15 2022] DELETE /identity/v3/users/867471cb81d941d79b0f3433731dc3b8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:16.065407 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d76ad7-2620-47c2-a762-30661aa6d400 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:16.065968 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d76ad7-2620-47c2-a762-30661aa6d400 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:16.066150 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d76ad7-2620-47c2-a762-30661aa6d400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:16.085276 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-c0d76ad7-2620-47c2-a762-30661aa6d400 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:16.086492 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-c0d76ad7-2620-47c2-a762-30661aa6d400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:16.144803 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 901/1793] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:16.154508 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d8571-75ea-4072-b022-227b29303b41 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:16.155907 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-da5d8571-75ea-4072-b022-227b29303b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:16.214342 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d8571-75ea-4072-b022-227b29303b41 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:16.217988 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d82e71-493f-415a-9b5d-42235448b007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:16.218610 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d82e71-493f-415a-9b5d-42235448b007 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:16.218891 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d82e71-493f-415a-9b5d-42235448b007 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:16.219165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d82e71-493f-415a-9b5d-42235448b007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:16.228697 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d82e71-493f-415a-9b5d-42235448b007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:16.230153 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d82e71-493f-415a-9b5d-42235448b007 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:16.240440 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 893/1794] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:16.542084 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d76ad7-2620-47c2-a762-30661aa6d400 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:16.543917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-c0d76ad7-2620-47c2-a762-30661aa6d400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:16.562765 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d76ad7-2620-47c2-a762-30661aa6d400 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:16.568206 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b2d3a-8e2a-41ea-94d2-98cf51972ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:16.569007 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b2d3a-8e2a-41ea-94d2-98cf51972ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:16.569399 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b2d3a-8e2a-41ea-94d2-98cf51972ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:16.569834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b2d3a-8e2a-41ea-94d2-98cf51972ab1 admin admin] PATH_INFO: `/v3/projects/d52bb2caa6574cbe805ea957cf2b5144` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:16.571073 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b2d3a-8e2a-41ea-94d2-98cf51972ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52bb2caa6574cbe805ea957cf2b5144)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:16.573269 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b2d3a-8e2a-41ea-94d2-98cf51972ab1 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:16.639185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:16.650355 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-d14b2d3a-8e2a-41ea-94d2-98cf51972ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52bb2caa6574cbe805ea957cf2b5144', 'request_id': 'req-d14b2d3a-8e2a-41ea-94d2-98cf51972ab1'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:16.656226 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-d14b2d3a-8e2a-41ea-94d2-98cf51972ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52bb2caa6574cbe805ea957cf2b5144', 'request_id': 'req-d14b2d3a-8e2a-41ea-94d2-98cf51972ab1'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:16.677323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-d14b2d3a-8e2a-41ea-94d2-98cf51972ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52bb2caa6574cbe805ea957cf2b5144', 'request_id': 'req-d14b2d3a-8e2a-41ea-94d2-98cf51972ab1'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:16.690129 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-d14b2d3a-8e2a-41ea-94d2-98cf51972ab1 admin admin] The token cache is being invalidate because project d52bb2caa6574cbe805ea957cf2b5144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:16.690549 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-d14b2d3a-8e2a-41ea-94d2-98cf51972ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:16.691298 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-d14b2d3a-8e2a-41ea-94d2-98cf51972ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:16.693894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 902/1795] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:16 2022] DELETE /identity/v3/projects/d52bb2caa6574cbe805ea957cf2b5144 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:16.699175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876eeb1-90b7-4e2d-ad1a-f2ec958b0361 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:16.699493 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876eeb1-90b7-4e2d-ad1a-f2ec958b0361 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:16.699767 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876eeb1-90b7-4e2d-ad1a-f2ec958b0361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:16.723907 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-3876eeb1-90b7-4e2d-ad1a-f2ec958b0361 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:16.725750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-3876eeb1-90b7-4e2d-ad1a-f2ec958b0361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:16.796671 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 894/1796] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:16.806442 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2cacf-e86d-4b92-b661-c9e4ed461448 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:16.806795 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2cacf-e86d-4b92-b661-c9e4ed461448 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:16.807064 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2cacf-e86d-4b92-b661-c9e4ed461448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:16.829457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-3eb2cacf-e86d-4b92-b661-c9e4ed461448 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:16.830752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-3eb2cacf-e86d-4b92-b661-c9e4ed461448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:16.840116 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 903/1797] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:16.845024 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876eeb1-90b7-4e2d-ad1a-f2ec958b0361 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:16.852620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:16.857070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876eeb1-90b7-4e2d-ad1a-f2ec958b0361 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:16.864045 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd5782-b2d6-486b-be58-85a8b0b669fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:16.864715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd5782-b2d6-486b-be58-85a8b0b669fe admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:16.864969 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd5782-b2d6-486b-be58-85a8b0b669fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:16.865317 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd5782-b2d6-486b-be58-85a8b0b669fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:16.866016 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd5782-b2d6-486b-be58-85a8b0b669fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:42:16.866323 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd5782-b2d6-486b-be58-85a8b0b669fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:16.867957 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd5782-b2d6-486b-be58-85a8b0b669fe admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:16.883778 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 895/1798] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:42:16.889699 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2cacf-e86d-4b92-b661-c9e4ed461448 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:16.906685 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2cacf-e86d-4b92-b661-c9e4ed461448 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:16.916531 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec63e1-6b59-4242-a4db-66afedca9570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:16.917582 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec63e1-6b59-4242-a4db-66afedca9570 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:16.918840 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec63e1-6b59-4242-a4db-66afedca9570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:16.919492 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec63e1-6b59-4242-a4db-66afedca9570 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:16.920529 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec63e1-6b59-4242-a4db-66afedca9570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:16.923212 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec63e1-6b59-4242-a4db-66afedca9570 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:16.984321 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 904/1799] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:16 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:16.988663 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd5782-b2d6-486b-be58-85a8b0b669fe admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:17.025660 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd5782-b2d6-486b-be58-85a8b0b669fe admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:17.127584 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ba7ca-72de-4eb4-92ae-e3e833742c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:17.127584 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ba7ca-72de-4eb4-92ae-e3e833742c82 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:17.127853 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ba7ca-72de-4eb4-92ae-e3e833742c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:17.128136 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ba7ca-72de-4eb4-92ae-e3e833742c82 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:17.129799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ba7ca-72de-4eb4-92ae-e3e833742c82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:17.131887 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ba7ca-72de-4eb4-92ae-e3e833742c82 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:17.177546 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 896/1800] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:16 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:17.181946 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec63e1-6b59-4242-a4db-66afedca9570 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:17.200339 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec63e1-6b59-4242-a4db-66afedca9570 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:17.208250 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15373ad7-f646-47b9-9b90-c76b361e2e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:17.209002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15373ad7-f646-47b9-9b90-c76b361e2e2e admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:17.209406 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15373ad7-f646-47b9-9b90-c76b361e2e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:17.211234 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15373ad7-f646-47b9-9b90-c76b361e2e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:17.212056 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15373ad7-f646-47b9-9b90-c76b361e2e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:17.213794 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15373ad7-f646-47b9-9b90-c76b361e2e2e admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:17.226435 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 905/1801] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:17.231055 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ba7ca-72de-4eb4-92ae-e3e833742c82 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:17.245328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ba7ca-72de-4eb4-92ae-e3e833742c82 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:17.251795 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6021a-b22a-479a-8736-1040e9944cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:17.253104 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6021a-b22a-479a-8736-1040e9944cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:17.253766 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6021a-b22a-479a-8736-1040e9944cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:17.254453 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6021a-b22a-479a-8736-1040e9944cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:17.255380 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6021a-b22a-479a-8736-1040e9944cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:17.258202 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6021a-b22a-479a-8736-1040e9944cf5 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:17.271159 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 897/1802] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:17.275717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15373ad7-f646-47b9-9b90-c76b361e2e2e admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:17.286872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15373ad7-f646-47b9-9b90-c76b361e2e2e admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:17.291785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafcf65-1c74-4ccc-a951-9be4ee8f0b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:17.292448 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafcf65-1c74-4ccc-a951-9be4ee8f0b7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:17.292734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafcf65-1c74-4ccc-a951-9be4ee8f0b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:17.293009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafcf65-1c74-4ccc-a951-9be4ee8f0b7f admin admin] PATH_INFO: `/v3/projects/36c46080c95e4176bf6ff90b684c9f0b/users/df2faf19a5bd4030ab36271632fa3e44/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:17.309628 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafcf65-1c74-4ccc-a951-9be4ee8f0b7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c46080c95e4176bf6ff90b684c9f0b, user_id=df2faf19a5bd4030ab36271632fa3e44, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:17.312771 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafcf65-1c74-4ccc-a951-9be4ee8f0b7f admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:17.335335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 906/1803] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:17 2022] PUT /identity/v3/projects/36c46080c95e4176bf6ff90b684c9f0b/users/df2faf19a5bd4030ab36271632fa3e44/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:17.342706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30d577-2ee1-4de2-912c-a187f74b0045 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:17.343392 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30d577-2ee1-4de2-912c-a187f74b0045 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:17.343793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30d577-2ee1-4de2-912c-a187f74b0045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:17.372709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-db30d577-2ee1-4de2-912c-a187f74b0045 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:17.373985 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-db30d577-2ee1-4de2-912c-a187f74b0045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:17.455912 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 898/1804] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:17.466342 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafcf65-1c74-4ccc-a951-9be4ee8f0b7f admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:17.468503 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-1aafcf65-1c74-4ccc-a951-9be4ee8f0b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:17.530570 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafcf65-1c74-4ccc-a951-9be4ee8f0b7f admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:17.534275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cc5a5-a97d-491f-9007-2818f40bdd3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:17.534942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cc5a5-a97d-491f-9007-2818f40bdd3e service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:17.535358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cc5a5-a97d-491f-9007-2818f40bdd3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:17.535633 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cc5a5-a97d-491f-9007-2818f40bdd3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:17.545735 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cc5a5-a97d-491f-9007-2818f40bdd3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:17.547621 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cc5a5-a97d-491f-9007-2818f40bdd3e service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:17.558741 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 907/1805] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:17.980106 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30d577-2ee1-4de2-912c-a187f74b0045 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:17.981617 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-db30d577-2ee1-4de2-912c-a187f74b0045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:17.994206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30d577-2ee1-4de2-912c-a187f74b0045 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:17.998856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97e36e-bbbb-4da2-9a27-125910373a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:17.999606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97e36e-bbbb-4da2-9a27-125910373a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:17.999932 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97e36e-bbbb-4da2-9a27-125910373a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:18.000266 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97e36e-bbbb-4da2-9a27-125910373a02 admin admin] PATH_INFO: `/v3/users/8b11dd89a2d6402395d31125dc1ba007` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:18.001527 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97e36e-bbbb-4da2-9a27-125910373a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b11dd89a2d6402395d31125dc1ba007)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:18.003689 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97e36e-bbbb-4da2-9a27-125910373a02 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:18.053714 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-3b97e36e-bbbb-4da2-9a27-125910373a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b11dd89a2d6402395d31125dc1ba007'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:18.061631 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-3b97e36e-bbbb-4da2-9a27-125910373a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b11dd89a2d6402395d31125dc1ba007'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:18.062353 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-3b97e36e-bbbb-4da2-9a27-125910373a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b11dd89a2d6402395d31125dc1ba007'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:18.062967 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-3b97e36e-bbbb-4da2-9a27-125910373a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b11dd89a2d6402395d31125dc1ba007'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:18.070472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-3b97e36e-bbbb-4da2-9a27-125910373a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b11dd89a2d6402395d31125dc1ba007'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:18.072366 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:18.091570 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 899/1806] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:17 2022] DELETE /identity/v3/users/8b11dd89a2d6402395d31125dc1ba007 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:18.096165 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39adcb-a41b-44e2-b5c3-065bf8101b17 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:18.096445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39adcb-a41b-44e2-b5c3-065bf8101b17 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:18.096713 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39adcb-a41b-44e2-b5c3-065bf8101b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:18.117665 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-ad39adcb-a41b-44e2-b5c3-065bf8101b17 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:18.118911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ad39adcb-a41b-44e2-b5c3-065bf8101b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:18.198319 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 908/1807] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:18.209529 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97e36e-bbbb-4da2-9a27-125910373a02 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:18.211005 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-3b97e36e-bbbb-4da2-9a27-125910373a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:18.305569 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97e36e-bbbb-4da2-9a27-125910373a02 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:18.312310 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5f5d1-1c1a-42d5-b615-8da84e77d402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:18.312950 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5f5d1-1c1a-42d5-b615-8da84e77d402 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:18.313234 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5f5d1-1c1a-42d5-b615-8da84e77d402 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:18.313650 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5f5d1-1c1a-42d5-b615-8da84e77d402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:18.338275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5f5d1-1c1a-42d5-b615-8da84e77d402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:18.340068 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5f5d1-1c1a-42d5-b615-8da84e77d402 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:18.354154 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 900/1808] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:18.694276 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39adcb-a41b-44e2-b5c3-065bf8101b17 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:18.695712 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ad39adcb-a41b-44e2-b5c3-065bf8101b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:18.712441 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39adcb-a41b-44e2-b5c3-065bf8101b17 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:18.728668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8b70b-9a80-4004-89a9-aa9bf8c00ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:18.730532 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8b70b-9a80-4004-89a9-aa9bf8c00ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:18.731003 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8b70b-9a80-4004-89a9-aa9bf8c00ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:18.731512 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8b70b-9a80-4004-89a9-aa9bf8c00ed7 admin admin] PATH_INFO: `/v3/users/c7651b1fc3f6407cb5c893d1ec94824d` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:18.735168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8b70b-9a80-4004-89a9-aa9bf8c00ed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7651b1fc3f6407cb5c893d1ec94824d)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:18.737365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8b70b-9a80-4004-89a9-aa9bf8c00ed7 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:18.741953 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:18.822849 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e9c8b70b-9a80-4004-89a9-aa9bf8c00ed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7651b1fc3f6407cb5c893d1ec94824d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:18.831184 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e9c8b70b-9a80-4004-89a9-aa9bf8c00ed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7651b1fc3f6407cb5c893d1ec94824d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:18.851726 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e9c8b70b-9a80-4004-89a9-aa9bf8c00ed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7651b1fc3f6407cb5c893d1ec94824d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:18.852695 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e9c8b70b-9a80-4004-89a9-aa9bf8c00ed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7651b1fc3f6407cb5c893d1ec94824d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:18.865199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e9c8b70b-9a80-4004-89a9-aa9bf8c00ed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7651b1fc3f6407cb5c893d1ec94824d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:18.873305 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 909/1809] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:18 2022] DELETE /identity/v3/users/c7651b1fc3f6407cb5c893d1ec94824d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:18.879072 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380b08e-502f-4607-822a-1b9b7ce2285a None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:18.879687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380b08e-502f-4607-822a-1b9b7ce2285a None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:18.882921 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380b08e-502f-4607-822a-1b9b7ce2285a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:18.905999 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-5380b08e-502f-4607-822a-1b9b7ce2285a None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:18.907184 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-5380b08e-502f-4607-822a-1b9b7ce2285a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:18.978239 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 901/1810] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:18.991606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8b70b-9a80-4004-89a9-aa9bf8c00ed7 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:18.993056 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e9c8b70b-9a80-4004-89a9-aa9bf8c00ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:19.063402 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8b70b-9a80-4004-89a9-aa9bf8c00ed7 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:19.068633 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0299f2-2683-43d2-85a8-9f4d7930aad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:19.069195 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0299f2-2683-43d2-85a8-9f4d7930aad3 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:19.069521 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0299f2-2683-43d2-85a8-9f4d7930aad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:19.069797 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0299f2-2683-43d2-85a8-9f4d7930aad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:19.083543 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0299f2-2683-43d2-85a8-9f4d7930aad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:19.085021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0299f2-2683-43d2-85a8-9f4d7930aad3 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:19.098444 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380b08e-502f-4607-822a-1b9b7ce2285a None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:19.099951 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 910/1811] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:19.100951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-5380b08e-502f-4607-822a-1b9b7ce2285a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:19.121717 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380b08e-502f-4607-822a-1b9b7ce2285a None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:19.127396 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4c756-1ddd-4e03-9f21-5a00788b1c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:19.128158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4c756-1ddd-4e03-9f21-5a00788b1c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:19.128448 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4c756-1ddd-4e03-9f21-5a00788b1c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:19.128723 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4c756-1ddd-4e03-9f21-5a00788b1c52 admin admin] PATH_INFO: `/v3/projects/935d19cdf6014527b779d4596bd8a6e8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:19.130260 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4c756-1ddd-4e03-9f21-5a00788b1c52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=935d19cdf6014527b779d4596bd8a6e8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:19.132370 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4c756-1ddd-4e03-9f21-5a00788b1c52 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:19.217887 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-cbc4c756-1ddd-4e03-9f21-5a00788b1c52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935d19cdf6014527b779d4596bd8a6e8', 'request_id': 'req-cbc4c756-1ddd-4e03-9f21-5a00788b1c52'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:19.240691 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-cbc4c756-1ddd-4e03-9f21-5a00788b1c52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935d19cdf6014527b779d4596bd8a6e8', 'request_id': 'req-cbc4c756-1ddd-4e03-9f21-5a00788b1c52'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:19.248383 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-cbc4c756-1ddd-4e03-9f21-5a00788b1c52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935d19cdf6014527b779d4596bd8a6e8', 'request_id': 'req-cbc4c756-1ddd-4e03-9f21-5a00788b1c52'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:19.263437 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-cbc4c756-1ddd-4e03-9f21-5a00788b1c52 admin admin] The token cache is being invalidate because project 935d19cdf6014527b779d4596bd8a6e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:19.263734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-cbc4c756-1ddd-4e03-9f21-5a00788b1c52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:19.266280 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-cbc4c756-1ddd-4e03-9f21-5a00788b1c52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:19.268236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 902/1812] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:19 2022] DELETE /identity/v3/projects/935d19cdf6014527b779d4596bd8a6e8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:19.276748 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0299f2-2683-43d2-85a8-9f4d7930aad3 service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:19.297016 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0299f2-2683-43d2-85a8-9f4d7930aad3 service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:19.406194 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af91dc8-2bdc-4372-ab70-744865b57071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:19.407978 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af91dc8-2bdc-4372-ab70-744865b57071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:19.408456 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af91dc8-2bdc-4372-ab70-744865b57071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:19.408861 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af91dc8-2bdc-4372-ab70-744865b57071 admin admin] PATH_INFO: `/v3/users/8c2ff9c11891457bad6376339b8087fe` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:19.413786 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af91dc8-2bdc-4372-ab70-744865b57071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2ff9c11891457bad6376339b8087fe)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:19.416217 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af91dc8-2bdc-4372-ab70-744865b57071 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:19.481806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:19.572321 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-3af91dc8-2bdc-4372-ab70-744865b57071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2ff9c11891457bad6376339b8087fe'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:19.589117 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-3af91dc8-2bdc-4372-ab70-744865b57071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2ff9c11891457bad6376339b8087fe'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:19.606268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-3af91dc8-2bdc-4372-ab70-744865b57071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2ff9c11891457bad6376339b8087fe'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:19.616549 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-3af91dc8-2bdc-4372-ab70-744865b57071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2ff9c11891457bad6376339b8087fe'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:19.632421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-3af91dc8-2bdc-4372-ab70-744865b57071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2ff9c11891457bad6376339b8087fe'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:19.649623 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 911/1813] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:19 2022] DELETE /identity/v3/users/8c2ff9c11891457bad6376339b8087fe => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:20.243519 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4c756-1ddd-4e03-9f21-5a00788b1c52 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:20.245707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-cbc4c756-1ddd-4e03-9f21-5a00788b1c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:20.278647 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4c756-1ddd-4e03-9f21-5a00788b1c52 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:20.286563 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:20.392800 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e69ab-6e72-4c60-8d33-4c52c7cbdc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:20.394109 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e69ab-6e72-4c60-8d33-4c52c7cbdc77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:20.394405 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e69ab-6e72-4c60-8d33-4c52c7cbdc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:20.394684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e69ab-6e72-4c60-8d33-4c52c7cbdc77 admin admin] PATH_INFO: `/v3/projects/e77f4a4b19a44a7a87cd197d13340137` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:20.396403 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e69ab-6e72-4c60-8d33-4c52c7cbdc77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e77f4a4b19a44a7a87cd197d13340137)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:20.401446 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e69ab-6e72-4c60-8d33-4c52c7cbdc77 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:20.460775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af91dc8-2bdc-4372-ab70-744865b57071 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:20.463027 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-3af91dc8-2bdc-4372-ab70-744865b57071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:20.477374 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-2d9e69ab-6e72-4c60-8d33-4c52c7cbdc77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e77f4a4b19a44a7a87cd197d13340137', 'request_id': 'req-2d9e69ab-6e72-4c60-8d33-4c52c7cbdc77'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:20.488651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af91dc8-2bdc-4372-ab70-744865b57071 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:20.491086 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-2d9e69ab-6e72-4c60-8d33-4c52c7cbdc77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e77f4a4b19a44a7a87cd197d13340137', 'request_id': 'req-2d9e69ab-6e72-4c60-8d33-4c52c7cbdc77'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:20.502374 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-2d9e69ab-6e72-4c60-8d33-4c52c7cbdc77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e77f4a4b19a44a7a87cd197d13340137', 'request_id': 'req-2d9e69ab-6e72-4c60-8d33-4c52c7cbdc77'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:20.524265 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-2d9e69ab-6e72-4c60-8d33-4c52c7cbdc77 admin admin] The token cache is being invalidate because project e77f4a4b19a44a7a87cd197d13340137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:20.524567 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-2d9e69ab-6e72-4c60-8d33-4c52c7cbdc77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:20.525373 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-2d9e69ab-6e72-4c60-8d33-4c52c7cbdc77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:20.527484 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 903/1814] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:20 2022] DELETE /identity/v3/projects/e77f4a4b19a44a7a87cd197d13340137 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:20.532039 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e69ab-6e72-4c60-8d33-4c52c7cbdc77 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:20.534741 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-2d9e69ab-6e72-4c60-8d33-4c52c7cbdc77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:20.618850 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac9e58-0037-498a-a780-17426bf853a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:20.620459 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac9e58-0037-498a-a780-17426bf853a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:20.621116 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac9e58-0037-498a-a780-17426bf853a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:20.621585 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac9e58-0037-498a-a780-17426bf853a4 admin admin] PATH_INFO: `/v3/projects/86c1c56a16b442d0a5af75d8febce914` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:20.623450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac9e58-0037-498a-a780-17426bf853a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86c1c56a16b442d0a5af75d8febce914)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:20.626894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac9e58-0037-498a-a780-17426bf853a4 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:20.655500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e69ab-6e72-4c60-8d33-4c52c7cbdc77 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:20.662849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba9858-077d-41e1-86ec-7cdf73f41d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:20.663690 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba9858-077d-41e1-86ec-7cdf73f41d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:20.663979 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba9858-077d-41e1-86ec-7cdf73f41d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:20.664751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba9858-077d-41e1-86ec-7cdf73f41d9b admin admin] PATH_INFO: `/v3/users/3c652c7ff1684041a0ccd6cd2de0e084` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:20.666105 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba9858-077d-41e1-86ec-7cdf73f41d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c652c7ff1684041a0ccd6cd2de0e084)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:20.670027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba9858-077d-41e1-86ec-7cdf73f41d9b admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:20.762210 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:20.774549 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-59ac9e58-0037-498a-a780-17426bf853a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86c1c56a16b442d0a5af75d8febce914', 'request_id': 'req-59ac9e58-0037-498a-a780-17426bf853a4'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:20.776495 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a8ba9858-077d-41e1-86ec-7cdf73f41d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c652c7ff1684041a0ccd6cd2de0e084'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:20.783392 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-59ac9e58-0037-498a-a780-17426bf853a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86c1c56a16b442d0a5af75d8febce914', 'request_id': 'req-59ac9e58-0037-498a-a780-17426bf853a4'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:20.789933 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a8ba9858-077d-41e1-86ec-7cdf73f41d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c652c7ff1684041a0ccd6cd2de0e084'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:20.792236 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a8ba9858-077d-41e1-86ec-7cdf73f41d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c652c7ff1684041a0ccd6cd2de0e084'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:20.794251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a8ba9858-077d-41e1-86ec-7cdf73f41d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c652c7ff1684041a0ccd6cd2de0e084'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:20.798316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-59ac9e58-0037-498a-a780-17426bf853a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86c1c56a16b442d0a5af75d8febce914', 'request_id': 'req-59ac9e58-0037-498a-a780-17426bf853a4'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:20.830408 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-59ac9e58-0037-498a-a780-17426bf853a4 admin admin] The token cache is being invalidate because project 86c1c56a16b442d0a5af75d8febce914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:20.830827 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-59ac9e58-0037-498a-a780-17426bf853a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:20.831634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-59ac9e58-0037-498a-a780-17426bf853a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:20.833179 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a8ba9858-077d-41e1-86ec-7cdf73f41d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c652c7ff1684041a0ccd6cd2de0e084'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:20.844659 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 912/1815] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:20 2022] DELETE /identity/v3/projects/86c1c56a16b442d0a5af75d8febce914 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:20.846288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd89dd-1bd7-4e32-b8cd-1ca575aec826 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:20.846579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd89dd-1bd7-4e32-b8cd-1ca575aec826 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:20.847381 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd89dd-1bd7-4e32-b8cd-1ca575aec826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:20.885350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 904/1816] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:20 2022] DELETE /identity/v3/users/3c652c7ff1684041a0ccd6cd2de0e084 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:20.938153 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-62bd89dd-1bd7-4e32-b8cd-1ca575aec826 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:20.942663 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-62bd89dd-1bd7-4e32-b8cd-1ca575aec826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:21.046202 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:21.138192 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 913/1817] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:21.141387 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d74f4-0c9d-45dc-a8c6-822cf514b1f1 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:21.141680 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d74f4-0c9d-45dc-a8c6-822cf514b1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:21.141996 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d74f4-0c9d-45dc-a8c6-822cf514b1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:21.192596 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-a27d74f4-0c9d-45dc-a8c6-822cf514b1f1 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:21.194002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a27d74f4-0c9d-45dc-a8c6-822cf514b1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:21.223878 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 905/1818] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:21.228461 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd89dd-1bd7-4e32-b8cd-1ca575aec826 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:21.242028 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd89dd-1bd7-4e32-b8cd-1ca575aec826 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:21.264585 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b6954-6742-4bf0-9638-aed74495ffb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:21.265437 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b6954-6742-4bf0-9638-aed74495ffb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:21.265787 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b6954-6742-4bf0-9638-aed74495ffb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:21.266623 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b6954-6742-4bf0-9638-aed74495ffb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:21.267639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b6954-6742-4bf0-9638-aed74495ffb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:42:21.270155 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b6954-6742-4bf0-9638-aed74495ffb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:21.274615 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b6954-6742-4bf0-9638-aed74495ffb2 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:21.288994 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 914/1819] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:42:21.293495 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d74f4-0c9d-45dc-a8c6-822cf514b1f1 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:21.330554 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d74f4-0c9d-45dc-a8c6-822cf514b1f1 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:21.356294 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba507051-6666-42a9-be66-e5b214744f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:21.357693 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba507051-6666-42a9-be66-e5b214744f87 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:21.357693 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba507051-6666-42a9-be66-e5b214744f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:21.357693 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba507051-6666-42a9-be66-e5b214744f87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:21.369804 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba507051-6666-42a9-be66-e5b214744f87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:21.374435 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba507051-6666-42a9-be66-e5b214744f87 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:21.482332 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 906/1820] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:21 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:21.486588 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b6954-6742-4bf0-9638-aed74495ffb2 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:21.503753 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b6954-6742-4bf0-9638-aed74495ffb2 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:21.652161 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f733e-5dcd-42a1-9621-c4b7318e871b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:21.653106 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f733e-5dcd-42a1-9621-c4b7318e871b admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:21.653535 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f733e-5dcd-42a1-9621-c4b7318e871b admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:21.653899 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f733e-5dcd-42a1-9621-c4b7318e871b admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:21.655164 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f733e-5dcd-42a1-9621-c4b7318e871b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:21.672287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f733e-5dcd-42a1-9621-c4b7318e871b admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:21.673162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba507051-6666-42a9-be66-e5b214744f87 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:21.676415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-ba507051-6666-42a9-be66-e5b214744f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:21.708021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba507051-6666-42a9-be66-e5b214744f87 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:21.716928 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605577ab-059a-4646-811b-e79d3f7f3bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:21.717513 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605577ab-059a-4646-811b-e79d3f7f3bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:21.717875 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605577ab-059a-4646-811b-e79d3f7f3bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:21.718144 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605577ab-059a-4646-811b-e79d3f7f3bc9 admin admin] PATH_INFO: `/v3/projects/74761e60aea24ef899cbe9b2216c01ac` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:21.719548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605577ab-059a-4646-811b-e79d3f7f3bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74761e60aea24ef899cbe9b2216c01ac)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:21.722833 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605577ab-059a-4646-811b-e79d3f7f3bc9 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:21.731893 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 915/1821] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:21 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:21.733407 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f733e-5dcd-42a1-9621-c4b7318e871b admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:21.748517 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f733e-5dcd-42a1-9621-c4b7318e871b admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:21.762598 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b17a6-71c4-42c9-82bb-e4fd9aaf0552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:21.763337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b17a6-71c4-42c9-82bb-e4fd9aaf0552 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:21.763726 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b17a6-71c4-42c9-82bb-e4fd9aaf0552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:21.764046 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b17a6-71c4-42c9-82bb-e4fd9aaf0552 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:21.764948 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b17a6-71c4-42c9-82bb-e4fd9aaf0552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:21.767947 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b17a6-71c4-42c9-82bb-e4fd9aaf0552 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:21.783319 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 916/1822] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:42:21.788081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b17a6-71c4-42c9-82bb-e4fd9aaf0552 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:21.794004 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-605577ab-059a-4646-811b-e79d3f7f3bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74761e60aea24ef899cbe9b2216c01ac', 'request_id': 'req-605577ab-059a-4646-811b-e79d3f7f3bc9'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:21.802369 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b17a6-71c4-42c9-82bb-e4fd9aaf0552 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:21.808462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-605577ab-059a-4646-811b-e79d3f7f3bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74761e60aea24ef899cbe9b2216c01ac', 'request_id': 'req-605577ab-059a-4646-811b-e79d3f7f3bc9'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:21.817775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-605577ab-059a-4646-811b-e79d3f7f3bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74761e60aea24ef899cbe9b2216c01ac', 'request_id': 'req-605577ab-059a-4646-811b-e79d3f7f3bc9'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:21.834772 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-605577ab-059a-4646-811b-e79d3f7f3bc9 admin admin] The token cache is being invalidate because project 74761e60aea24ef899cbe9b2216c01ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:21.835655 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-605577ab-059a-4646-811b-e79d3f7f3bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:21.836617 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-605577ab-059a-4646-811b-e79d3f7f3bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:21.839911 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 907/1823] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:21 2022] DELETE /identity/v3/projects/74761e60aea24ef899cbe9b2216c01ac => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:42:21.845933 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089758b-df31-4ec7-b0f7-eef242ef9913 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:21.846352 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089758b-df31-4ec7-b0f7-eef242ef9913 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:21.846808 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089758b-df31-4ec7-b0f7-eef242ef9913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:21.880068 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-f089758b-df31-4ec7-b0f7-eef242ef9913 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:21.881541 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-f089758b-df31-4ec7-b0f7-eef242ef9913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:21.900304 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682cd66-7478-4a96-b6ad-51f31864438d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:21.900996 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682cd66-7478-4a96-b6ad-51f31864438d admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:21.901273 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682cd66-7478-4a96-b6ad-51f31864438d admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:21.901554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682cd66-7478-4a96-b6ad-51f31864438d admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:21.902229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682cd66-7478-4a96-b6ad-51f31864438d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:21.904086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682cd66-7478-4a96-b6ad-51f31864438d admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:21.922109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 917/1824] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:21.927085 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682cd66-7478-4a96-b6ad-51f31864438d admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:21.929415 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-4682cd66-7478-4a96-b6ad-51f31864438d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:21.948377 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682cd66-7478-4a96-b6ad-51f31864438d admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:21.955866 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c20fc-0d7d-46ba-84f2-5070741b219c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:21.957729 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c20fc-0d7d-46ba-84f2-5070741b219c admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:21.957970 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c20fc-0d7d-46ba-84f2-5070741b219c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:21.958377 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c20fc-0d7d-46ba-84f2-5070741b219c admin admin] PATH_INFO: `/v3/projects/61451dcf818647dca7b602fbb15c8bf1/users/412cd3568cfc4a3599fbe7a27fdb0e1d/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:21.974740 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 908/1825] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:21.978859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c20fc-0d7d-46ba-84f2-5070741b219c admin admin] RBAC: Authorizing `identity:create_grant(project_id=61451dcf818647dca7b602fbb15c8bf1, user_id=412cd3568cfc4a3599fbe7a27fdb0e1d, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:21.982060 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c20fc-0d7d-46ba-84f2-5070741b219c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:21.982567 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1eb72-52bb-4b98-99e6-7bafc8648e81 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:21.982959 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1eb72-52bb-4b98-99e6-7bafc8648e81 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:21.983362 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1eb72-52bb-4b98-99e6-7bafc8648e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:22.005331 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 918/1826] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:21 2022] PUT /identity/v3/projects/61451dcf818647dca7b602fbb15c8bf1/users/412cd3568cfc4a3599fbe7a27fdb0e1d/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:22.014916 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24653631-43f9-44bd-b0a8-2eef25acb597 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:22.015204 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24653631-43f9-44bd-b0a8-2eef25acb597 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:22.015655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24653631-43f9-44bd-b0a8-2eef25acb597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:22.018138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-49c1eb72-52bb-4b98-99e6-7bafc8648e81 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:22.021369 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-49c1eb72-52bb-4b98-99e6-7bafc8648e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:22.032472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:22.050415 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:22.068010 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-24653631-43f9-44bd-b0a8-2eef25acb597 None None] MFA Rules not processed for user `412cd3568cfc4a3599fbe7a27fdb0e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:22.069429 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-24653631-43f9-44bd-b0a8-2eef25acb597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:22.122261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 909/1827] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:22.126404 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1eb72-52bb-4b98-99e6-7bafc8648e81 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:22.139820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1eb72-52bb-4b98-99e6-7bafc8648e81 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:22.149566 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac5681-9d8f-40e3-8377-d7a0a90b488c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:22.151061 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac5681-9d8f-40e3-8377-d7a0a90b488c admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:22.151835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac5681-9d8f-40e3-8377-d7a0a90b488c admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:22.152514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac5681-9d8f-40e3-8377-d7a0a90b488c admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:22.154478 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac5681-9d8f-40e3-8377-d7a0a90b488c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:42:22.155046 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac5681-9d8f-40e3-8377-d7a0a90b488c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:22.158777 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac5681-9d8f-40e3-8377-d7a0a90b488c admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:22.176728 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 910/1828] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:42:22.181808 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac5681-9d8f-40e3-8377-d7a0a90b488c admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:22.201593 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac5681-9d8f-40e3-8377-d7a0a90b488c admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:22.209156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 919/1829] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:22.210356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24653631-43f9-44bd-b0a8-2eef25acb597 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:22.214349 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c0154-6d8a-4996-a77f-4b152322ad24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:22.215165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c0154-6d8a-4996-a77f-4b152322ad24 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:22.215599 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c0154-6d8a-4996-a77f-4b152322ad24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:22.216024 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c0154-6d8a-4996-a77f-4b152322ad24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:22.216927 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c0154-6d8a-4996-a77f-4b152322ad24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:22.220384 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c0154-6d8a-4996-a77f-4b152322ad24 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:22.225501 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24653631-43f9-44bd-b0a8-2eef25acb597 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:22.232611 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2773ac2-e065-4465-ba52-e79adfb8b267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:22.233348 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2773ac2-e065-4465-ba52-e79adfb8b267 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:22.233733 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2773ac2-e065-4465-ba52-e79adfb8b267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:22.234160 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2773ac2-e065-4465-ba52-e79adfb8b267 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:22.235447 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2773ac2-e065-4465-ba52-e79adfb8b267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:22.238236 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2773ac2-e065-4465-ba52-e79adfb8b267 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:22.278225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 911/1830] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:22 2022] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:22.279391 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c0154-6d8a-4996-a77f-4b152322ad24 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:22.310108 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 920/1831] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:22 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:22.316303 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2773ac2-e065-4465-ba52-e79adfb8b267 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:22.412956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c0154-6d8a-4996-a77f-4b152322ad24 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:22.442596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2773ac2-e065-4465-ba52-e79adfb8b267 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:22.447939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1e0e3-832c-455b-b616-6e85104b40a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:22.448633 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1e0e3-832c-455b-b616-6e85104b40a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:22.449027 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1e0e3-832c-455b-b616-6e85104b40a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:22.449370 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1e0e3-832c-455b-b616-6e85104b40a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:22.450115 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1e0e3-832c-455b-b616-6e85104b40a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:22.452197 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1e0e3-832c-455b-b616-6e85104b40a4 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:22.495937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 921/1832] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:22 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:22.500181 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1e0e3-832c-455b-b616-6e85104b40a4 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:22.506408 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb55ad-8744-4713-93f3-cb866f1a6dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:22.507081 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb55ad-8744-4713-93f3-cb866f1a6dbb admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:22.507365 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb55ad-8744-4713-93f3-cb866f1a6dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:22.507641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb55ad-8744-4713-93f3-cb866f1a6dbb admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:22.508349 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb55ad-8744-4713-93f3-cb866f1a6dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:22.510673 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb55ad-8744-4713-93f3-cb866f1a6dbb admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:22.523758 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1e0e3-832c-455b-b616-6e85104b40a4 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:22.547194 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45ed88-778e-4cd8-92f8-ffc3b76381f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:22.548337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45ed88-778e-4cd8-92f8-ffc3b76381f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:22.548651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45ed88-778e-4cd8-92f8-ffc3b76381f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:22.548928 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45ed88-778e-4cd8-92f8-ffc3b76381f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:22.551795 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45ed88-778e-4cd8-92f8-ffc3b76381f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:22.554630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45ed88-778e-4cd8-92f8-ffc3b76381f6 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:22.555192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 912/1833] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:22 2022] POST /identity/v3/users => generated 282 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:22.567921 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb55ad-8744-4713-93f3-cb866f1a6dbb admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:22.573511 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 922/1834] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:22.577737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45ed88-778e-4cd8-92f8-ffc3b76381f6 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:22.593125 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45ed88-778e-4cd8-92f8-ffc3b76381f6 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:22.594371 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb55ad-8744-4713-93f3-cb866f1a6dbb admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:22.600424 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47167d4a-2957-49f8-b860-5c2380a55f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:22.601315 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47167d4a-2957-49f8-b860-5c2380a55f59 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:22.601702 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47167d4a-2957-49f8-b860-5c2380a55f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:22.602164 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47167d4a-2957-49f8-b860-5c2380a55f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:22.603167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47167d4a-2957-49f8-b860-5c2380a55f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:22.606541 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47167d4a-2957-49f8-b860-5c2380a55f59 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:22.609973 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590b951-1952-442d-ae84-7bcea63a8c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:22.610607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590b951-1952-442d-ae84-7bcea63a8c3b admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:22.610885 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590b951-1952-442d-ae84-7bcea63a8c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:22.613806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590b951-1952-442d-ae84-7bcea63a8c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:22.615124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590b951-1952-442d-ae84-7bcea63a8c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:22.618132 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590b951-1952-442d-ae84-7bcea63a8c3b admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:22.621215 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 923/1835] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:42:22.626926 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47167d4a-2957-49f8-b860-5c2380a55f59 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:22.644685 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 913/1836] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:22.654282 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590b951-1952-442d-ae84-7bcea63a8c3b admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:22.663571 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:22.667932 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590b951-1952-442d-ae84-7bcea63a8c3b admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:22.676074 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47167d4a-2957-49f8-b860-5c2380a55f59 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:22.677931 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533828a9-da0c-461f-a3fc-a63e18cc61da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:22.678782 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533828a9-da0c-461f-a3fc-a63e18cc61da admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:22.679451 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533828a9-da0c-461f-a3fc-a63e18cc61da admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:22.680096 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533828a9-da0c-461f-a3fc-a63e18cc61da admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:22.681494 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533828a9-da0c-461f-a3fc-a63e18cc61da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:22.683457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533828a9-da0c-461f-a3fc-a63e18cc61da admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:22.690666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b7ee0-d852-439f-8cd5-706a07cb5af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:22.692201 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b7ee0-d852-439f-8cd5-706a07cb5af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:22.693926 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b7ee0-d852-439f-8cd5-706a07cb5af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:22.694506 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b7ee0-d852-439f-8cd5-706a07cb5af9 admin admin] PATH_INFO: `/v3/projects/ad40cc3fdd24406c92d72003d06aeed6/users/880945743742454d8bf902cb632d9610/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:22.733378 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b7ee0-d852-439f-8cd5-706a07cb5af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad40cc3fdd24406c92d72003d06aeed6, user_id=880945743742454d8bf902cb632d9610, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:22.735049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 914/1837] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:22.737949 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb46ea-3f15-4663-bc7b-9c163cb54128 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:22.738232 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb46ea-3f15-4663-bc7b-9c163cb54128 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:22.738507 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb46ea-3f15-4663-bc7b-9c163cb54128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:22.741436 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b7ee0-d852-439f-8cd5-706a07cb5af9 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:22.769970 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 924/1838] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:22 2022] PUT /identity/v3/projects/ad40cc3fdd24406c92d72003d06aeed6/users/880945743742454d8bf902cb632d9610/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:22.771530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b7ee0-d852-439f-8cd5-706a07cb5af9 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:22.787817 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-87fb46ea-3f15-4663-bc7b-9c163cb54128 None None] MFA Rules not processed for user `8ed7e68f243f44f4886ccf366b49ae6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:22.788955 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-87fb46ea-3f15-4663-bc7b-9c163cb54128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:22.870108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 915/1839] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:22.875105 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5288f73-001d-4dca-8742-0b33a76aaaa6 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:22.877374 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5288f73-001d-4dca-8742-0b33a76aaaa6 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:22.878660 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5288f73-001d-4dca-8742-0b33a76aaaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:22.893079 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:22.993385 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b7ee0-d852-439f-8cd5-706a07cb5af9 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:22.997555 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-f5288f73-001d-4dca-8742-0b33a76aaaa6 None None] MFA Rules not processed for user `880945743742454d8bf902cb632d9610`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:23.005886 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-f5288f73-001d-4dca-8742-0b33a76aaaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:23.008126 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6109061-23e6-4e8b-958d-85a83e666e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:23.008937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6109061-23e6-4e8b-958d-85a83e666e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:23.009248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6109061-23e6-4e8b-958d-85a83e666e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:23.009508 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6109061-23e6-4e8b-958d-85a83e666e37 admin admin] PATH_INFO: `/v3/projects/8ca4e570147847398135bde498ee2680/users/0e4e4d838cac48cbaf87be776c6b5abf/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:23.051178 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6109061-23e6-4e8b-958d-85a83e666e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca4e570147847398135bde498ee2680, user_id=0e4e4d838cac48cbaf87be776c6b5abf, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:23.056114 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6109061-23e6-4e8b-958d-85a83e666e37 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:23.087167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 925/1840] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:22 2022] PUT /identity/v3/projects/8ca4e570147847398135bde498ee2680/users/0e4e4d838cac48cbaf87be776c6b5abf/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:23.100450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51052333-02e0-4075-bae9-91e035b1343e None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:23.100765 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51052333-02e0-4075-bae9-91e035b1343e None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:23.101054 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51052333-02e0-4075-bae9-91e035b1343e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:23.156214 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-51052333-02e0-4075-bae9-91e035b1343e None None] MFA Rules not processed for user `0e4e4d838cac48cbaf87be776c6b5abf`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:23.157837 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-51052333-02e0-4075-bae9-91e035b1343e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:23.230414 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 916/1841] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:23.234048 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5288f73-001d-4dca-8742-0b33a76aaaa6 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:23.260234 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5288f73-001d-4dca-8742-0b33a76aaaa6 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:23.298114 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 926/1842] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:23.302225 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51052333-02e0-4075-bae9-91e035b1343e None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:23.411341 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75204f62-bc64-4b29-bad2-4c2bfe61c5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:23.412149 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75204f62-bc64-4b29-bad2-4c2bfe61c5eb admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:23.417015 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75204f62-bc64-4b29-bad2-4c2bfe61c5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:23.418041 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75204f62-bc64-4b29-bad2-4c2bfe61c5eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:23.418876 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75204f62-bc64-4b29-bad2-4c2bfe61c5eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:23.423896 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75204f62-bc64-4b29-bad2-4c2bfe61c5eb admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:23.473682 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 917/1843] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:23 2022] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:42:23.473882 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51052333-02e0-4075-bae9-91e035b1343e None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:23.475112 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75204f62-bc64-4b29-bad2-4c2bfe61c5eb admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:23.496964 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:23.574043 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:23.602928 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75204f62-bc64-4b29-bad2-4c2bfe61c5eb admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:23.614424 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b5d07-6515-4af8-879f-699d3360ed63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:23.614728 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7eaec-aa59-437b-a943-ad2e0aef4555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:23.615059 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b5d07-6515-4af8-879f-699d3360ed63 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:23.615516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b5d07-6515-4af8-879f-699d3360ed63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:23.615628 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7eaec-aa59-437b-a943-ad2e0aef4555 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:23.615791 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b5d07-6515-4af8-879f-699d3360ed63 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:23.616437 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b5d07-6515-4af8-879f-699d3360ed63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:23.617708 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7eaec-aa59-437b-a943-ad2e0aef4555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:23.618200 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7eaec-aa59-437b-a943-ad2e0aef4555 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:23.618399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b5d07-6515-4af8-879f-699d3360ed63 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:23.621115 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7eaec-aa59-437b-a943-ad2e0aef4555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:23.626671 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7eaec-aa59-437b-a943-ad2e0aef4555 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:23.659815 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 918/1844] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:23 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:23.663675 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60777e9-4b8e-4380-89ac-1e44e7e1a344 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:23.664209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60777e9-4b8e-4380-89ac-1e44e7e1a344 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:23.664512 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60777e9-4b8e-4380-89ac-1e44e7e1a344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:23.688118 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 927/1845] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:23 2022] POST /identity/v3/projects => generated 363 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:42:23.689401 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7eaec-aa59-437b-a943-ad2e0aef4555 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:23.702683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-f60777e9-4b8e-4380-89ac-1e44e7e1a344 None None] MFA Rules not processed for user `df2faf19a5bd4030ab36271632fa3e44`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:23.704504 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-f60777e9-4b8e-4380-89ac-1e44e7e1a344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:23.786633 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7eaec-aa59-437b-a943-ad2e0aef4555 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:23.791712 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fef58-678d-40c8-beec-8971f1b2d86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:23.792655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fef58-678d-40c8-beec-8971f1b2d86f admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:23.793319 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fef58-678d-40c8-beec-8971f1b2d86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:23.793758 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fef58-678d-40c8-beec-8971f1b2d86f admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:23.794815 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fef58-678d-40c8-beec-8971f1b2d86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:23.796930 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fef58-678d-40c8-beec-8971f1b2d86f admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:23.807730 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 919/1846] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:23.808915 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60777e9-4b8e-4380-89ac-1e44e7e1a344 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:23.820453 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 928/1847] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:23.821986 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fef58-678d-40c8-beec-8971f1b2d86f admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:23.822716 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60777e9-4b8e-4380-89ac-1e44e7e1a344 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:23.823919 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-670fef58-678d-40c8-beec-8971f1b2d86f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:23.827825 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ecada-7457-436c-9674-00be69040229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:23.828451 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ecada-7457-436c-9674-00be69040229 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:23.829098 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ecada-7457-436c-9674-00be69040229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:23.829384 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ecada-7457-436c-9674-00be69040229 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:23.830052 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ecada-7457-436c-9674-00be69040229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:23.832407 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ecada-7457-436c-9674-00be69040229 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:23.838664 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fef58-678d-40c8-beec-8971f1b2d86f admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:23.847779 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e70fd-384e-4a4e-9157-e219c82948ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:23.849371 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e70fd-384e-4a4e-9157-e219c82948ed admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:23.849785 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e70fd-384e-4a4e-9157-e219c82948ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:23.850917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e70fd-384e-4a4e-9157-e219c82948ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:23.851780 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e70fd-384e-4a4e-9157-e219c82948ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:23.854710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e70fd-384e-4a4e-9157-e219c82948ed admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:23.861117 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 920/1848] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:23 2022] POST /identity/v3/users => generated 288 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:23.862367 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ecada-7457-436c-9674-00be69040229 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:23.873572 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ecada-7457-436c-9674-00be69040229 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:23.879548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75c6b6-25ff-4cb9-a388-f3e0a3ac9061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:23.880228 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75c6b6-25ff-4cb9-a388-f3e0a3ac9061 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:23.880511 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75c6b6-25ff-4cb9-a388-f3e0a3ac9061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:23.881023 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75c6b6-25ff-4cb9-a388-f3e0a3ac9061 admin admin] PATH_INFO: `/v3/projects/75504c3837b9479ab2a07d7944723969/users/ce22d8c9e2bb46818f2238be5f3a278f/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:23.898366 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75c6b6-25ff-4cb9-a388-f3e0a3ac9061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75504c3837b9479ab2a07d7944723969, user_id=ce22d8c9e2bb46818f2238be5f3a278f, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:23.899204 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 929/1849] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:23 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:23.900200 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e70fd-384e-4a4e-9157-e219c82948ed admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:23.904811 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75c6b6-25ff-4cb9-a388-f3e0a3ac9061 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:23.924032 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 921/1850] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:23 2022] PUT /identity/v3/projects/75504c3837b9479ab2a07d7944723969/users/ce22d8c9e2bb46818f2238be5f3a278f/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:23.924924 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75c6b6-25ff-4cb9-a388-f3e0a3ac9061 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:23.984655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e70fd-384e-4a4e-9157-e219c82948ed admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:24.047109 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:24.049380 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:24.067185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b1771-6174-4c93-a4de-a8b6a58a84bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:24.068123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b1771-6174-4c93-a4de-a8b6a58a84bc admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:24.068401 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b1771-6174-4c93-a4de-a8b6a58a84bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:24.068670 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b1771-6174-4c93-a4de-a8b6a58a84bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:24.069309 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b1771-6174-4c93-a4de-a8b6a58a84bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:24.072184 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b1771-6174-4c93-a4de-a8b6a58a84bc admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:24.079650 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75c6b6-25ff-4cb9-a388-f3e0a3ac9061 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:24.085629 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c2f2c-c072-4b7c-bbba-a40a3f3ae455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:24.086501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c2f2c-c072-4b7c-bbba-a40a3f3ae455 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:24.086855 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c2f2c-c072-4b7c-bbba-a40a3f3ae455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:24.087312 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c2f2c-c072-4b7c-bbba-a40a3f3ae455 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:24.088088 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c2f2c-c072-4b7c-bbba-a40a3f3ae455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:24.090279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c2f2c-c072-4b7c-bbba-a40a3f3ae455 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:24.094028 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 930/1851] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:24.096910 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b1771-6174-4c93-a4de-a8b6a58a84bc admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:24.111309 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b1771-6174-4c93-a4de-a8b6a58a84bc admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:24.116416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9099d6f-6fd1-4424-81e3-7d09c90c8da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:24.117220 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9099d6f-6fd1-4424-81e3-7d09c90c8da8 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:24.117509 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9099d6f-6fd1-4424-81e3-7d09c90c8da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:24.117784 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9099d6f-6fd1-4424-81e3-7d09c90c8da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:24.118933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9099d6f-6fd1-4424-81e3-7d09c90c8da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:24.120202 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 922/1852] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:23 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:24.121128 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c2f2c-c072-4b7c-bbba-a40a3f3ae455 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:24.123798 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9099d6f-6fd1-4424-81e3-7d09c90c8da8 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:24.132397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c2f2c-c072-4b7c-bbba-a40a3f3ae455 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:24.137989 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 931/1853] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:24.137989 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9099d6f-6fd1-4424-81e3-7d09c90c8da8 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:24.141633 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06232f0-92c8-41dc-982f-2ae5ed11354c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:24.142379 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06232f0-92c8-41dc-982f-2ae5ed11354c admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:24.142653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06232f0-92c8-41dc-982f-2ae5ed11354c admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:24.142930 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06232f0-92c8-41dc-982f-2ae5ed11354c admin admin] PATH_INFO: `/v3/projects/c11e34d602d94dfa8a0196962dd523f9/users/f90255375d96468fb011145804cc73f4/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:24.152761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9099d6f-6fd1-4424-81e3-7d09c90c8da8 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:24.161664 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06232f0-92c8-41dc-982f-2ae5ed11354c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11e34d602d94dfa8a0196962dd523f9, user_id=f90255375d96468fb011145804cc73f4, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:24.164948 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06232f0-92c8-41dc-982f-2ae5ed11354c admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:24.167616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1b0d3-a81b-49e6-8d54-2ee73bf0b1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:24.172596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1b0d3-a81b-49e6-8d54-2ee73bf0b1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:24.172887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1b0d3-a81b-49e6-8d54-2ee73bf0b1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:24.173209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1b0d3-a81b-49e6-8d54-2ee73bf0b1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:24.174018 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1b0d3-a81b-49e6-8d54-2ee73bf0b1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:24.180051 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1b0d3-a81b-49e6-8d54-2ee73bf0b1b2 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:24.183049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 923/1854] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:24 2022] PUT /identity/v3/projects/c11e34d602d94dfa8a0196962dd523f9/users/f90255375d96468fb011145804cc73f4/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:24.184187 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06232f0-92c8-41dc-982f-2ae5ed11354c admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:24.193967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 932/1855] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:24.193967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1b0d3-a81b-49e6-8d54-2ee73bf0b1b2 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:24.204354 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1b0d3-a81b-49e6-8d54-2ee73bf0b1b2 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:24.290665 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba37129-0171-43e3-9f3c-324e479c0cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:24.291497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba37129-0171-43e3-9f3c-324e479c0cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:24.292093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba37129-0171-43e3-9f3c-324e479c0cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:24.292453 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba37129-0171-43e3-9f3c-324e479c0cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:24.293198 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba37129-0171-43e3-9f3c-324e479c0cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:24.295273 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba37129-0171-43e3-9f3c-324e479c0cb5 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:24.297970 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06232f0-92c8-41dc-982f-2ae5ed11354c admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:24.304467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7793a-14de-4db6-98f4-60bf7c4d9249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:24.305171 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7793a-14de-4db6-98f4-60bf7c4d9249 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:24.305526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7793a-14de-4db6-98f4-60bf7c4d9249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:24.305799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7793a-14de-4db6-98f4-60bf7c4d9249 admin admin] PATH_INFO: `/v3/projects/75504c3837b9479ab2a07d7944723969/users/ce22d8c9e2bb46818f2238be5f3a278f/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:24.307858 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7793a-14de-4db6-98f4-60bf7c4d9249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75504c3837b9479ab2a07d7944723969, user_id=ce22d8c9e2bb46818f2238be5f3a278f, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:24.312425 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7793a-14de-4db6-98f4-60bf7c4d9249 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:24.315464 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 933/1856] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:24.318931 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba37129-0171-43e3-9f3c-324e479c0cb5 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:24.338487 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba37129-0171-43e3-9f3c-324e479c0cb5 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:24.342430 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 924/1857] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:24 2022] PUT /identity/v3/projects/75504c3837b9479ab2a07d7944723969/users/ce22d8c9e2bb46818f2238be5f3a278f/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:24.343828 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7793a-14de-4db6-98f4-60bf7c4d9249 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:24.488271 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7793a-14de-4db6-98f4-60bf7c4d9249 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:24.495625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba45737-b7ae-4e45-ba2e-b11cddf50cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:24.496646 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba45737-b7ae-4e45-ba2e-b11cddf50cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:24.497069 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba45737-b7ae-4e45-ba2e-b11cddf50cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:24.497528 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba45737-b7ae-4e45-ba2e-b11cddf50cf0 admin admin] PATH_INFO: `/v3/projects/c11e34d602d94dfa8a0196962dd523f9/users/f90255375d96468fb011145804cc73f4/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:24.500755 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba45737-b7ae-4e45-ba2e-b11cddf50cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11e34d602d94dfa8a0196962dd523f9, user_id=f90255375d96468fb011145804cc73f4, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:24.505822 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba45737-b7ae-4e45-ba2e-b11cddf50cf0 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:24.508162 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cb350-c9e7-4980-9c54-714582864b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:24.509005 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cb350-c9e7-4980-9c54-714582864b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:24.509288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cb350-c9e7-4980-9c54-714582864b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:24.509558 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cb350-c9e7-4980-9c54-714582864b49 admin admin] PATH_INFO: `/v3/projects/cc3558f144fb46738c0e6b5a5ba67b21/users/6d30389ea7d2448597b280575266946c/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:24.548079 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cb350-c9e7-4980-9c54-714582864b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc3558f144fb46738c0e6b5a5ba67b21, user_id=6d30389ea7d2448597b280575266946c, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:24.550215 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 925/1858] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:24 2022] PUT /identity/v3/projects/c11e34d602d94dfa8a0196962dd523f9/users/f90255375d96468fb011145804cc73f4/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:24.551842 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cb350-c9e7-4980-9c54-714582864b49 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:24.557327 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec33716-9501-40fb-9de4-51190423fc03 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:24.557701 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec33716-9501-40fb-9de4-51190423fc03 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:24.558140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec33716-9501-40fb-9de4-51190423fc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:24.576636 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 934/1859] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:24 2022] PUT /identity/v3/projects/cc3558f144fb46738c0e6b5a5ba67b21/users/6d30389ea7d2448597b280575266946c/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:24.578083 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0382bb0-2941-4254-8949-c8767e5cd2dc None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:24.578366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0382bb0-2941-4254-8949-c8767e5cd2dc None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:24.578638 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0382bb0-2941-4254-8949-c8767e5cd2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:24.593414 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-cec33716-9501-40fb-9de4-51190423fc03 None None] MFA Rules not processed for user `ce22d8c9e2bb46818f2238be5f3a278f`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:24.594833 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-cec33716-9501-40fb-9de4-51190423fc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:24.659328 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-e0382bb0-2941-4254-8949-c8767e5cd2dc None None] MFA Rules not processed for user `f90255375d96468fb011145804cc73f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:24.661115 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e0382bb0-2941-4254-8949-c8767e5cd2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:24.662141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:24.725193 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 926/1860] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:24.726400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec33716-9501-40fb-9de4-51190423fc03 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:24.736444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:24.790437 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 935/1861] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:24.792515 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0382bb0-2941-4254-8949-c8767e5cd2dc None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:24.794724 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e0382bb0-2941-4254-8949-c8767e5cd2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:24.840447 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec33716-9501-40fb-9de4-51190423fc03 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:24.845234 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b4457-bb3a-46b3-b370-69b10ae6f6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:24.845876 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b4457-bb3a-46b3-b370-69b10ae6f6ad admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:24.846166 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b4457-bb3a-46b3-b370-69b10ae6f6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:24.846513 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b4457-bb3a-46b3-b370-69b10ae6f6ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:24.847353 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b4457-bb3a-46b3-b370-69b10ae6f6ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:24.848965 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b4457-bb3a-46b3-b370-69b10ae6f6ad admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:24.864629 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 927/1862] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:24.868819 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b4457-bb3a-46b3-b370-69b10ae6f6ad admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:24.882219 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b4457-bb3a-46b3-b370-69b10ae6f6ad admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:24.888976 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91ab69-09d9-4ee9-95be-7e805ebd4dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:24.889928 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91ab69-09d9-4ee9-95be-7e805ebd4dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:24.890348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91ab69-09d9-4ee9-95be-7e805ebd4dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:24.890724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91ab69-09d9-4ee9-95be-7e805ebd4dc4 admin admin] PATH_INFO: `/v3/projects/cc3558f144fb46738c0e6b5a5ba67b21/users/6d30389ea7d2448597b280575266946c/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:24.893091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91ab69-09d9-4ee9-95be-7e805ebd4dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc3558f144fb46738c0e6b5a5ba67b21, user_id=6d30389ea7d2448597b280575266946c, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:24.898237 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91ab69-09d9-4ee9-95be-7e805ebd4dc4 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:24.904895 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0382bb0-2941-4254-8949-c8767e5cd2dc None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:24.915150 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d50a4e-389d-4594-b6dd-1712debd595a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:24.916052 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d50a4e-389d-4594-b6dd-1712debd595a service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:24.917655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d50a4e-389d-4594-b6dd-1712debd595a service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:24.917813 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d50a4e-389d-4594-b6dd-1712debd595a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:24.921910 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 928/1863] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:24 2022] PUT /identity/v3/projects/cc3558f144fb46738c0e6b5a5ba67b21/users/6d30389ea7d2448597b280575266946c/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:25.016074 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d50a4e-389d-4594-b6dd-1712debd595a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:25.017561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d50a4e-389d-4594-b6dd-1712debd595a service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:25.030598 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 936/1864] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:25.115196 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91ab69-09d9-4ee9-95be-7e805ebd4dc4 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:25.116896 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-7f91ab69-09d9-4ee9-95be-7e805ebd4dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:25.238589 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91ab69-09d9-4ee9-95be-7e805ebd4dc4 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:25.250718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9efc5-3979-401e-bee5-17abf5a820ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:25.251457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9efc5-3979-401e-bee5-17abf5a820ee service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:25.252380 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9efc5-3979-401e-bee5-17abf5a820ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:25.253436 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9efc5-3979-401e-bee5-17abf5a820ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:25.404169 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d9efc5-3979-401e-bee5-17abf5a820ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:25.405398 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d9efc5-3979-401e-bee5-17abf5a820ee service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:25.442506 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 929/1865] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:25.690486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d50a4e-389d-4594-b6dd-1712debd595a service cinder] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:25.697738 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d50a4e-389d-4594-b6dd-1712debd595a service cinder] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:25.715992 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d1b40-73d7-4362-93e7-a8241c6da279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:25.716217 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d1b40-73d7-4362-93e7-a8241c6da279 service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:25.716530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d1b40-73d7-4362-93e7-a8241c6da279 service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:25.716807 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d1b40-73d7-4362-93e7-a8241c6da279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:25.817289 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d1b40-73d7-4362-93e7-a8241c6da279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:25.819006 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d1b40-73d7-4362-93e7-a8241c6da279 service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:25.833137 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 937/1866] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:27.098978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9efc5-3979-401e-bee5-17abf5a820ee service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:27.108631 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:27.120456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9efc5-3979-401e-bee5-17abf5a820ee service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:27.130180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd8eee-68f1-498f-bd97-d2561618e219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:27.131027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd8eee-68f1-498f-bd97-d2561618e219 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:27.131450 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd8eee-68f1-498f-bd97-d2561618e219 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:27.131904 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd8eee-68f1-498f-bd97-d2561618e219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:27.218820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd8eee-68f1-498f-bd97-d2561618e219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:27.220424 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd8eee-68f1-498f-bd97-d2561618e219 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:27.233754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 930/1867] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:28.377022 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d1b40-73d7-4362-93e7-a8241c6da279 service cinder] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:28.391281 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d1b40-73d7-4362-93e7-a8241c6da279 service cinder] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:28.399942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0c140-27ec-4a0c-8a3e-7b9f22ab8c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:28.401568 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0c140-27ec-4a0c-8a3e-7b9f22ab8c31 service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:28.401867 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0c140-27ec-4a0c-8a3e-7b9f22ab8c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:28.402179 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0c140-27ec-4a0c-8a3e-7b9f22ab8c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:28.443635 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:28.539092 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0c140-27ec-4a0c-8a3e-7b9f22ab8c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:28.540982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0c140-27ec-4a0c-8a3e-7b9f22ab8c31 service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:28.556746 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 938/1868] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:29.423936 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd8eee-68f1-498f-bd97-d2561618e219 service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:29.594842 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd8eee-68f1-498f-bd97-d2561618e219 service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:29.607850 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52fab3-44d3-4551-a136-035a82644e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:29.608616 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52fab3-44d3-4551-a136-035a82644e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:29.610297 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52fab3-44d3-4551-a136-035a82644e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:29.610685 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52fab3-44d3-4551-a136-035a82644e40 admin admin] PATH_INFO: `/v3/users/0e4e4d838cac48cbaf87be776c6b5abf` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:29.615883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52fab3-44d3-4551-a136-035a82644e40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e4e4d838cac48cbaf87be776c6b5abf)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:29.618343 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52fab3-44d3-4551-a136-035a82644e40 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:29.788522 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0b52fab3-44d3-4551-a136-035a82644e40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e4e4d838cac48cbaf87be776c6b5abf'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:29.817978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0b52fab3-44d3-4551-a136-035a82644e40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e4e4d838cac48cbaf87be776c6b5abf'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:29.819260 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0b52fab3-44d3-4551-a136-035a82644e40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e4e4d838cac48cbaf87be776c6b5abf'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:29.820227 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0b52fab3-44d3-4551-a136-035a82644e40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e4e4d838cac48cbaf87be776c6b5abf'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:29.848238 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-0b52fab3-44d3-4551-a136-035a82644e40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e4e4d838cac48cbaf87be776c6b5abf'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:29.911874 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 931/1869] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:29 2022] DELETE /identity/v3/users/0e4e4d838cac48cbaf87be776c6b5abf => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:29.917264 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76705d-ebf0-4775-88be-4ee5f06f47df None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:29.917802 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76705d-ebf0-4775-88be-4ee5f06f47df None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:29.918523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76705d-ebf0-4775-88be-4ee5f06f47df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:29.965485 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-2d76705d-ebf0-4775-88be-4ee5f06f47df None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:29.967138 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2d76705d-ebf0-4775-88be-4ee5f06f47df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:30.079952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 939/1870] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:30.091638 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52fab3-44d3-4551-a136-035a82644e40 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:30.093517 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-0b52fab3-44d3-4551-a136-035a82644e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:30.148829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:30.251463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52fab3-44d3-4551-a136-035a82644e40 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:30.256661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d40a08-e096-4274-b23a-dd7393e14fcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:30.257662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d40a08-e096-4274-b23a-dd7393e14fcb service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:30.258090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d40a08-e096-4274-b23a-dd7393e14fcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:30.258493 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d40a08-e096-4274-b23a-dd7393e14fcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:30.274863 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d40a08-e096-4274-b23a-dd7393e14fcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:30.276329 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d40a08-e096-4274-b23a-dd7393e14fcb service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:30.301635 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 932/1871] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:31.161838 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76705d-ebf0-4775-88be-4ee5f06f47df None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:31.167819 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2d76705d-ebf0-4775-88be-4ee5f06f47df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:31.195679 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76705d-ebf0-4775-88be-4ee5f06f47df None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:31.214090 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e65ad-9110-42d8-bbc0-0b97d0873351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:31.214761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e65ad-9110-42d8-bbc0-0b97d0873351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:31.215044 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e65ad-9110-42d8-bbc0-0b97d0873351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:31.215320 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e65ad-9110-42d8-bbc0-0b97d0873351 admin admin] PATH_INFO: `/v3/projects/8ca4e570147847398135bde498ee2680` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:31.222653 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e65ad-9110-42d8-bbc0-0b97d0873351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca4e570147847398135bde498ee2680)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:31.224895 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e65ad-9110-42d8-bbc0-0b97d0873351 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:31.305507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-704e65ad-9110-42d8-bbc0-0b97d0873351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca4e570147847398135bde498ee2680', 'request_id': 'req-704e65ad-9110-42d8-bbc0-0b97d0873351'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:31.312162 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-704e65ad-9110-42d8-bbc0-0b97d0873351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca4e570147847398135bde498ee2680', 'request_id': 'req-704e65ad-9110-42d8-bbc0-0b97d0873351'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:31.325704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-704e65ad-9110-42d8-bbc0-0b97d0873351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca4e570147847398135bde498ee2680', 'request_id': 'req-704e65ad-9110-42d8-bbc0-0b97d0873351'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:31.354784 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-704e65ad-9110-42d8-bbc0-0b97d0873351 admin admin] The token cache is being invalidate because project 8ca4e570147847398135bde498ee2680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:31.355249 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-704e65ad-9110-42d8-bbc0-0b97d0873351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:31.356010 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-704e65ad-9110-42d8-bbc0-0b97d0873351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:31.358232 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 940/1872] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:31 2022] DELETE /identity/v3/projects/8ca4e570147847398135bde498ee2680 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:31.363074 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d40a08-e096-4274-b23a-dd7393e14fcb service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:31.374120 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d40a08-e096-4274-b23a-dd7393e14fcb service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:31.474847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615831c2-aee1-4f32-b7c9-42576d8d5848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:31.477525 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615831c2-aee1-4f32-b7c9-42576d8d5848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:31.478068 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615831c2-aee1-4f32-b7c9-42576d8d5848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:31.478352 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615831c2-aee1-4f32-b7c9-42576d8d5848 admin admin] PATH_INFO: `/v3/users/f90255375d96468fb011145804cc73f4` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:31.479681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615831c2-aee1-4f32-b7c9-42576d8d5848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f90255375d96468fb011145804cc73f4)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:31.481928 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615831c2-aee1-4f32-b7c9-42576d8d5848 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:31.589666 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-615831c2-aee1-4f32-b7c9-42576d8d5848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f90255375d96468fb011145804cc73f4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:31.617483 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-615831c2-aee1-4f32-b7c9-42576d8d5848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f90255375d96468fb011145804cc73f4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:31.618270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-615831c2-aee1-4f32-b7c9-42576d8d5848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f90255375d96468fb011145804cc73f4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:31.619603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-615831c2-aee1-4f32-b7c9-42576d8d5848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f90255375d96468fb011145804cc73f4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:31.635379 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-615831c2-aee1-4f32-b7c9-42576d8d5848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f90255375d96468fb011145804cc73f4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:31.671033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 933/1873] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:31 2022] DELETE /identity/v3/users/f90255375d96468fb011145804cc73f4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:32.176750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e65ad-9110-42d8-bbc0-0b97d0873351 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:32.178996 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-704e65ad-9110-42d8-bbc0-0b97d0873351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:32.242225 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e65ad-9110-42d8-bbc0-0b97d0873351 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:32.356023 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:32.430272 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead727d-8ca6-4fc3-a636-daca24eda80a None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:32.430782 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead727d-8ca6-4fc3-a636-daca24eda80a None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:32.431167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead727d-8ca6-4fc3-a636-daca24eda80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:32.446839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521bc50-90eb-47c9-831c-1c3021cb7049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:32.449885 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521bc50-90eb-47c9-831c-1c3021cb7049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:32.450290 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521bc50-90eb-47c9-831c-1c3021cb7049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:32.453226 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521bc50-90eb-47c9-831c-1c3021cb7049 admin admin] PATH_INFO: `/v3/projects/c11e34d602d94dfa8a0196962dd523f9` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:32.454845 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521bc50-90eb-47c9-831c-1c3021cb7049 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c11e34d602d94dfa8a0196962dd523f9)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:32.461941 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521bc50-90eb-47c9-831c-1c3021cb7049 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:32.498770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-9ead727d-8ca6-4fc3-a636-daca24eda80a None None] MFA Rules not processed for user `6d30389ea7d2448597b280575266946c`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:32.500411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-9ead727d-8ca6-4fc3-a636-daca24eda80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:32.546886 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:32.562266 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b521bc50-90eb-47c9-831c-1c3021cb7049 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c11e34d602d94dfa8a0196962dd523f9', 'request_id': 'req-b521bc50-90eb-47c9-831c-1c3021cb7049'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:32.577530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b521bc50-90eb-47c9-831c-1c3021cb7049 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c11e34d602d94dfa8a0196962dd523f9', 'request_id': 'req-b521bc50-90eb-47c9-831c-1c3021cb7049'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:32.587967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b521bc50-90eb-47c9-831c-1c3021cb7049 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c11e34d602d94dfa8a0196962dd523f9', 'request_id': 'req-b521bc50-90eb-47c9-831c-1c3021cb7049'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:32.603112 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b521bc50-90eb-47c9-831c-1c3021cb7049 admin admin] The token cache is being invalidate because project c11e34d602d94dfa8a0196962dd523f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:32.603917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b521bc50-90eb-47c9-831c-1c3021cb7049 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:32.605011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b521bc50-90eb-47c9-831c-1c3021cb7049 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:32.607981 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 934/1875] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:32.613340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 941/1875] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:32 2022] DELETE /identity/v3/projects/c11e34d602d94dfa8a0196962dd523f9 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:32.614526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0043cb8-32a7-4646-8c46-78a29c7ab373 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:32.614526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0043cb8-32a7-4646-8c46-78a29c7ab373 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:32.614781 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0043cb8-32a7-4646-8c46-78a29c7ab373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:32.622788 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521bc50-90eb-47c9-831c-1c3021cb7049 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:32.624733 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b521bc50-90eb-47c9-831c-1c3021cb7049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:32.643579 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-e0043cb8-32a7-4646-8c46-78a29c7ab373 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:32.645709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e0043cb8-32a7-4646-8c46-78a29c7ab373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:32.724692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521bc50-90eb-47c9-831c-1c3021cb7049 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:32.729707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640614c8-9a20-4905-b5fe-6aeff143bd01 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '077f50ca034b4d12817543377815393b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:32.730916 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640614c8-9a20-4905-b5fe-6aeff143bd01 service glance] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:32.731388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640614c8-9a20-4905-b5fe-6aeff143bd01 service glance] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:32.731955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640614c8-9a20-4905-b5fe-6aeff143bd01 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:32.734040 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-640614c8-9a20-4905-b5fe-6aeff143bd01 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:32.792780 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 935/1876] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:32.798417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a386b72-6f6b-460c-acdc-fdccf3f0ece5 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:32.799512 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a386b72-6f6b-460c-acdc-fdccf3f0ece5 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:32.800009 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a386b72-6f6b-460c-acdc-fdccf3f0ece5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:32.847509 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-0a386b72-6f6b-460c-acdc-fdccf3f0ece5 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:32.848760 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-0a386b72-6f6b-460c-acdc-fdccf3f0ece5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:32.868917 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 936/1877] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:32.870767 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a386b72-6f6b-460c-acdc-fdccf3f0ece5 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:32.881791 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a386b72-6f6b-460c-acdc-fdccf3f0ece5 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:32.886739 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657c5d6-9974-438e-a650-702f23fcdb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:32.887521 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657c5d6-9974-438e-a650-702f23fcdb75 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:32.887809 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657c5d6-9974-438e-a650-702f23fcdb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:32.888084 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657c5d6-9974-438e-a650-702f23fcdb75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:32.888753 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657c5d6-9974-438e-a650-702f23fcdb75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:42:32.889056 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657c5d6-9974-438e-a650-702f23fcdb75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:32.890733 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657c5d6-9974-438e-a650-702f23fcdb75 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:32.898950 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640614c8-9a20-4905-b5fe-6aeff143bd01 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:32.903539 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640614c8-9a20-4905-b5fe-6aeff143bd01 service glance] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:32.905510 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 937/1878] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:42:32.911552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657c5d6-9974-438e-a650-702f23fcdb75 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:32.921338 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 942/1879] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:32.923337 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657c5d6-9974-438e-a650-702f23fcdb75 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:32.929394 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ee758-4458-4e16-8ba4-9c128bef03c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:32.930185 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ee758-4458-4e16-8ba4-9c128bef03c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:32.930535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ee758-4458-4e16-8ba4-9c128bef03c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:32.931134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ee758-4458-4e16-8ba4-9c128bef03c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:32.932105 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ee758-4458-4e16-8ba4-9c128bef03c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:32.934985 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ee758-4458-4e16-8ba4-9c128bef03c1 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:33.000027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 938/1880] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:32 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:33.040534 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640614c8-9a20-4905-b5fe-6aeff143bd01 service glance] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:33.061256 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640614c8-9a20-4905-b5fe-6aeff143bd01 service glance] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:33.101798 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:33.105046 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e8917-ef72-4ded-bb75-de8ce2cab8de None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:33.105413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e8917-ef72-4ded-bb75-de8ce2cab8de None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:33.105960 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e8917-ef72-4ded-bb75-de8ce2cab8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:33.147660 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-0b2e8917-ef72-4ded-bb75-de8ce2cab8de None None] MFA Rules not processed for user `a1bdbce1b3d047cfa5ddf72f902ecd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:33.156318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-0b2e8917-ef72-4ded-bb75-de8ce2cab8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:33.227332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6fe1c-0e96-47c2-9c1c-b756766574d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:33.227890 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6fe1c-0e96-47c2-9c1c-b756766574d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:33.228132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6fe1c-0e96-47c2-9c1c-b756766574d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:33.228408 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6fe1c-0e96-47c2-9c1c-b756766574d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:33.229147 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6fe1c-0e96-47c2-9c1c-b756766574d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:33.233397 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6fe1c-0e96-47c2-9c1c-b756766574d6 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:33.293303 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 943/1881] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:33 2022] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:33.296689 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6fe1c-0e96-47c2-9c1c-b756766574d6 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:33.311042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6fe1c-0e96-47c2-9c1c-b756766574d6 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:33.315929 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 939/1882] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Oct 20 14:42:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:33.319229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c861a-cf43-42e6-a5ff-4af464dc37c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:33.320273 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c861a-cf43-42e6-a5ff-4af464dc37c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:33.320649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c861a-cf43-42e6-a5ff-4af464dc37c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:33.321089 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c861a-cf43-42e6-a5ff-4af464dc37c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:33.323982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c861a-cf43-42e6-a5ff-4af464dc37c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:33.331500 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c861a-cf43-42e6-a5ff-4af464dc37c3 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:33.346957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 944/1883] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:33.354376 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e8917-ef72-4ded-bb75-de8ce2cab8de None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:33.408004 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e8917-ef72-4ded-bb75-de8ce2cab8de None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:33.414698 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff5199-a967-45da-98e3-298129178d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:33.415328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff5199-a967-45da-98e3-298129178d76 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:33.415607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff5199-a967-45da-98e3-298129178d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:33.415884 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff5199-a967-45da-98e3-298129178d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:33.419091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff5199-a967-45da-98e3-298129178d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:33.419766 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff5199-a967-45da-98e3-298129178d76 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:33.429571 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c861a-cf43-42e6-a5ff-4af464dc37c3 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:33.438061 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-020c861a-cf43-42e6-a5ff-4af464dc37c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:33.447304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 940/1884] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:33.451663 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff5199-a967-45da-98e3-298129178d76 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:33.464664 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff5199-a967-45da-98e3-298129178d76 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:33.473472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb6ea5-511f-44b6-8792-51f8b335520b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:33.474180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb6ea5-511f-44b6-8792-51f8b335520b admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:33.474461 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb6ea5-511f-44b6-8792-51f8b335520b admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:33.474734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb6ea5-511f-44b6-8792-51f8b335520b admin admin] PATH_INFO: `/v3/projects/cd46e4fa8ba74227b32f130e2ef3b350/users/d31ded6d0352406a87f1731bafda3f94/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:33.507623 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb6ea5-511f-44b6-8792-51f8b335520b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd46e4fa8ba74227b32f130e2ef3b350, user_id=d31ded6d0352406a87f1731bafda3f94, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:33.510571 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb6ea5-511f-44b6-8792-51f8b335520b admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:33.515032 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:33.553910 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 941/1885] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:33 2022] PUT /identity/v3/projects/cd46e4fa8ba74227b32f130e2ef3b350/users/d31ded6d0352406a87f1731bafda3f94/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:42:33.553910 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb6ea5-511f-44b6-8792-51f8b335520b admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:33.557306 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-24bb6ea5-511f-44b6-8792-51f8b335520b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:33.605432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c861a-cf43-42e6-a5ff-4af464dc37c3 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:33.664556 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb6ea5-511f-44b6-8792-51f8b335520b admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:33.671823 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0eddd0-9c99-4f09-8638-6169f7dba312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:33.673419 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eddd0-9c99-4f09-8638-6169f7dba312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:33.673713 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eddd0-9c99-4f09-8638-6169f7dba312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:33.674540 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eddd0-9c99-4f09-8638-6169f7dba312 admin admin] PATH_INFO: `/v3/users/412cd3568cfc4a3599fbe7a27fdb0e1d` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:33.676208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0eddd0-9c99-4f09-8638-6169f7dba312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=412cd3568cfc4a3599fbe7a27fdb0e1d)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:33.680031 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0eddd0-9c99-4f09-8638-6169f7dba312 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:33.715647 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4e02d-b1e1-4569-a8cd-34a2e2512922 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60d62d14cd4042ab1bff5509e30f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:33.716917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4e02d-b1e1-4569-a8cd-34a2e2512922 service swift] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:33.717419 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4e02d-b1e1-4569-a8cd-34a2e2512922 service swift] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:33.717704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4e02d-b1e1-4569-a8cd-34a2e2512922 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:33.754632 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ba0eddd0-9c99-4f09-8638-6169f7dba312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '412cd3568cfc4a3599fbe7a27fdb0e1d'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:33.763891 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ba0eddd0-9c99-4f09-8638-6169f7dba312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '412cd3568cfc4a3599fbe7a27fdb0e1d'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:33.764751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ba0eddd0-9c99-4f09-8638-6169f7dba312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '412cd3568cfc4a3599fbe7a27fdb0e1d'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:33.765703 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ba0eddd0-9c99-4f09-8638-6169f7dba312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '412cd3568cfc4a3599fbe7a27fdb0e1d'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:33.776583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ba0eddd0-9c99-4f09-8638-6169f7dba312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '412cd3568cfc4a3599fbe7a27fdb0e1d'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:33.778366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:33.794159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4e02d-b1e1-4569-a8cd-34a2e2512922 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:33.795757 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4e02d-b1e1-4569-a8cd-34a2e2512922 service swift] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:33.797174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 942/1886] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:33 2022] DELETE /identity/v3/users/412cd3568cfc4a3599fbe7a27fdb0e1d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:33.798330 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ed223-e140-4ea4-9bde-92375eee280f None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:33.798617 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ed223-e140-4ea4-9bde-92375eee280f None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:33.799074 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ed223-e140-4ea4-9bde-92375eee280f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:33.806813 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 945/1887] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Oct 20 14:42:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 14:42:33.817895 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab43a6d-2f51-4e8d-9508-24e70b2724ed None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:33.817895 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab43a6d-2f51-4e8d-9508-24e70b2724ed None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:33.817895 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab43a6d-2f51-4e8d-9508-24e70b2724ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:33.839378 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-6f8ed223-e140-4ea4-9bde-92375eee280f None None] MFA Rules not processed for user `d31ded6d0352406a87f1731bafda3f94`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:33.840305 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-4ab43a6d-2f51-4e8d-9508-24e70b2724ed None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:33.840609 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-6f8ed223-e140-4ea4-9bde-92375eee280f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:33.841501 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-4ab43a6d-2f51-4e8d-9508-24e70b2724ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:33.967262 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 946/1888] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:33.970385 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 943/1889] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:33.971879 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab43a6d-2f51-4e8d-9508-24e70b2724ed None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:33.973271 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-4ab43a6d-2f51-4e8d-9508-24e70b2724ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:33.977747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ed223-e140-4ea4-9bde-92375eee280f None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:33.984508 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-6f8ed223-e140-4ea4-9bde-92375eee280f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:33.989185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab43a6d-2f51-4e8d-9508-24e70b2724ed None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:33.998677 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec74f6-63db-4590-89fd-d811b6c94c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:33.999376 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec74f6-63db-4590-89fd-d811b6c94c26 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:34.001231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec74f6-63db-4590-89fd-d811b6c94c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:34.001367 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec74f6-63db-4590-89fd-d811b6c94c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:34.003897 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec74f6-63db-4590-89fd-d811b6c94c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:34.004961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:34.006409 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec74f6-63db-4590-89fd-d811b6c94c26 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:34.111809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 947/1890] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:33 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:34.116380 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec74f6-63db-4590-89fd-d811b6c94c26 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:34.159165 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ed223-e140-4ea4-9bde-92375eee280f None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:34.264251 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec74f6-63db-4590-89fd-d811b6c94c26 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:34.276533 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee28be-98e9-4282-9f4a-c5e872a2dd6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:34.277188 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee28be-98e9-4282-9f4a-c5e872a2dd6b service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:34.277473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee28be-98e9-4282-9f4a-c5e872a2dd6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:34.278189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee28be-98e9-4282-9f4a-c5e872a2dd6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:34.280717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c0ae5-51a1-476b-868f-0a27a3391692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:34.281297 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c0ae5-51a1-476b-868f-0a27a3391692 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:34.281564 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c0ae5-51a1-476b-868f-0a27a3391692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:34.281975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c0ae5-51a1-476b-868f-0a27a3391692 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:34.282709 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c0ae5-51a1-476b-868f-0a27a3391692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:34.286645 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c0ae5-51a1-476b-868f-0a27a3391692 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:34.303894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee28be-98e9-4282-9f4a-c5e872a2dd6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:34.309390 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee28be-98e9-4282-9f4a-c5e872a2dd6b service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:34.352216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 944/1891] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:34.353706 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 948/1892] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:34 2022] POST /identity/v3/users => generated 300 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:42:34.357274 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee28be-98e9-4282-9f4a-c5e872a2dd6b service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:34.368013 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee28be-98e9-4282-9f4a-c5e872a2dd6b service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:34.372906 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8cd6a7-a56d-4820-9874-ed50b8cab3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:34.373528 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cd6a7-a56d-4820-9874-ed50b8cab3bd admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:34.373813 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cd6a7-a56d-4820-9874-ed50b8cab3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:34.374135 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cd6a7-a56d-4820-9874-ed50b8cab3bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:34.374955 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8cd6a7-a56d-4820-9874-ed50b8cab3bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:34.376570 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8cd6a7-a56d-4820-9874-ed50b8cab3bd admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:34.389795 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 945/1893] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:42:34.397623 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c0ae5-51a1-476b-868f-0a27a3391692 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:34.414759 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c0ae5-51a1-476b-868f-0a27a3391692 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:34.422543 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fea5c-f3ed-4729-91eb-62df4988d9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:34.423231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fea5c-f3ed-4729-91eb-62df4988d9cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:34.423513 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fea5c-f3ed-4729-91eb-62df4988d9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:34.424395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fea5c-f3ed-4729-91eb-62df4988d9cb admin admin] PATH_INFO: `/v3/projects/bd58713477d9494384554bb556d07e27/users/b223e92ec7c740c7b860c0e8601513e2/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:34.467176 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8fea5c-f3ed-4729-91eb-62df4988d9cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd58713477d9494384554bb556d07e27, user_id=b223e92ec7c740c7b860c0e8601513e2, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:34.470447 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8fea5c-f3ed-4729-91eb-62df4988d9cb admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:34.497043 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 949/1894] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:34 2022] PUT /identity/v3/projects/bd58713477d9494384554bb556d07e27/users/b223e92ec7c740c7b860c0e8601513e2/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:34.500943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8cd6a7-a56d-4820-9874-ed50b8cab3bd admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:34.519779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8cd6a7-a56d-4820-9874-ed50b8cab3bd admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:34.702275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd449fae-e308-4db1-9e71-7441027c311b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:34.703732 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd449fae-e308-4db1-9e71-7441027c311b admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:34.706119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd449fae-e308-4db1-9e71-7441027c311b admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:34.706680 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd449fae-e308-4db1-9e71-7441027c311b admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:34.708693 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd449fae-e308-4db1-9e71-7441027c311b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:34.712594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd449fae-e308-4db1-9e71-7441027c311b admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:34.750938 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 946/1895] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:34.752721 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fea5c-f3ed-4729-91eb-62df4988d9cb admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:34.770400 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fea5c-f3ed-4729-91eb-62df4988d9cb admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:34.814181 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc06c70-ca0e-417c-b0ab-1a5a82b53460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:34.816769 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc06c70-ca0e-417c-b0ab-1a5a82b53460 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:34.817153 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc06c70-ca0e-417c-b0ab-1a5a82b53460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:34.817431 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc06c70-ca0e-417c-b0ab-1a5a82b53460 admin admin] PATH_INFO: `/v3/projects/bd58713477d9494384554bb556d07e27/users/b223e92ec7c740c7b860c0e8601513e2/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:34.827438 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc06c70-ca0e-417c-b0ab-1a5a82b53460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd58713477d9494384554bb556d07e27, user_id=b223e92ec7c740c7b860c0e8601513e2, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:34.832207 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc06c70-ca0e-417c-b0ab-1a5a82b53460 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:34.878603 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 950/1896] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:34 2022] PUT /identity/v3/projects/bd58713477d9494384554bb556d07e27/users/b223e92ec7c740c7b860c0e8601513e2/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:34.880919 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5127c27-8001-462f-8455-87b71ae4a54a None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:34.881210 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5127c27-8001-462f-8455-87b71ae4a54a None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:34.881482 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5127c27-8001-462f-8455-87b71ae4a54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:34.970126 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-c5127c27-8001-462f-8455-87b71ae4a54a None None] MFA Rules not processed for user `b223e92ec7c740c7b860c0e8601513e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:34.972534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-c5127c27-8001-462f-8455-87b71ae4a54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:35.074089 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc06c70-ca0e-417c-b0ab-1a5a82b53460 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:35.076126 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-adc06c70-ca0e-417c-b0ab-1a5a82b53460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:35.117051 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:35.151161 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:35.196594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 947/1897] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:35.213376 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5127c27-8001-462f-8455-87b71ae4a54a None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:35.218240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-c5127c27-8001-462f-8455-87b71ae4a54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:35.335787 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc06c70-ca0e-417c-b0ab-1a5a82b53460 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:35.344446 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584c738-8d53-402e-a063-eca0e5b82dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:35.345390 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584c738-8d53-402e-a063-eca0e5b82dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:35.346146 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584c738-8d53-402e-a063-eca0e5b82dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:35.346722 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584c738-8d53-402e-a063-eca0e5b82dc0 admin admin] PATH_INFO: `/v3/projects/61451dcf818647dca7b602fbb15c8bf1` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:35.348775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584c738-8d53-402e-a063-eca0e5b82dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61451dcf818647dca7b602fbb15c8bf1)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:35.348994 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5127c27-8001-462f-8455-87b71ae4a54a None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:35.351741 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584c738-8d53-402e-a063-eca0e5b82dc0 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:35.354332 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d5fd9-f3c4-44cb-993b-492de2658bd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:35.354858 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d5fd9-f3c4-44cb-993b-492de2658bd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:35.355143 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d5fd9-f3c4-44cb-993b-492de2658bd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:35.356203 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d5fd9-f3c4-44cb-993b-492de2658bd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:35.369552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d5fd9-f3c4-44cb-993b-492de2658bd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:35.372301 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d5fd9-f3c4-44cb-993b-492de2658bd4 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:35.389286 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 948/1898] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:35.491812 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-7584c738-8d53-402e-a063-eca0e5b82dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61451dcf818647dca7b602fbb15c8bf1', 'request_id': 'req-7584c738-8d53-402e-a063-eca0e5b82dc0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:35.515384 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-7584c738-8d53-402e-a063-eca0e5b82dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61451dcf818647dca7b602fbb15c8bf1', 'request_id': 'req-7584c738-8d53-402e-a063-eca0e5b82dc0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:35.519325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d5fd9-f3c4-44cb-993b-492de2658bd4 service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:35.532137 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-7584c738-8d53-402e-a063-eca0e5b82dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61451dcf818647dca7b602fbb15c8bf1', 'request_id': 'req-7584c738-8d53-402e-a063-eca0e5b82dc0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:35.562597 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d5fd9-f3c4-44cb-993b-492de2658bd4 service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:35.562840 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-7584c738-8d53-402e-a063-eca0e5b82dc0 admin admin] The token cache is being invalidate because project 61451dcf818647dca7b602fbb15c8bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:35.567556 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-7584c738-8d53-402e-a063-eca0e5b82dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:35.568524 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-7584c738-8d53-402e-a063-eca0e5b82dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:35.570511 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 951/1899] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:35 2022] DELETE /identity/v3/projects/61451dcf818647dca7b602fbb15c8bf1 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:35.574391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584c738-8d53-402e-a063-eca0e5b82dc0 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:35.575882 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-7584c738-8d53-402e-a063-eca0e5b82dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:35.680578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bea541-f498-4c35-b6be-c876c4cb77c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:35.683611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bea541-f498-4c35-b6be-c876c4cb77c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:35.684220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bea541-f498-4c35-b6be-c876c4cb77c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:35.684679 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bea541-f498-4c35-b6be-c876c4cb77c4 admin admin] PATH_INFO: `/v3/users/d31ded6d0352406a87f1731bafda3f94` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:35.700302 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bea541-f498-4c35-b6be-c876c4cb77c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d31ded6d0352406a87f1731bafda3f94)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:35.702475 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bea541-f498-4c35-b6be-c876c4cb77c4 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:35.706966 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584c738-8d53-402e-a063-eca0e5b82dc0 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:35.729351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8364df-89c0-4e29-a43f-9be2046ed391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:35.730018 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8364df-89c0-4e29-a43f-9be2046ed391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:35.730368 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8364df-89c0-4e29-a43f-9be2046ed391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:35.731073 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8364df-89c0-4e29-a43f-9be2046ed391 admin admin] PATH_INFO: `/v3/users/880945743742454d8bf902cb632d9610` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:35.733222 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8364df-89c0-4e29-a43f-9be2046ed391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=880945743742454d8bf902cb632d9610)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:35.735316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8364df-89c0-4e29-a43f-9be2046ed391 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:35.802269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-79bea541-f498-4c35-b6be-c876c4cb77c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd31ded6d0352406a87f1731bafda3f94'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:35.804815 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-79bea541-f498-4c35-b6be-c876c4cb77c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd31ded6d0352406a87f1731bafda3f94'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:35.812421 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-79bea541-f498-4c35-b6be-c876c4cb77c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd31ded6d0352406a87f1731bafda3f94'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:35.813258 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-79bea541-f498-4c35-b6be-c876c4cb77c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd31ded6d0352406a87f1731bafda3f94'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:35.829412 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-79bea541-f498-4c35-b6be-c876c4cb77c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd31ded6d0352406a87f1731bafda3f94'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:35.896305 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:35.916933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fa8364df-89c0-4e29-a43f-9be2046ed391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '880945743742454d8bf902cb632d9610'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:35.919018 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:35.958195 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fa8364df-89c0-4e29-a43f-9be2046ed391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '880945743742454d8bf902cb632d9610'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:35.974056 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 949/1900] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:35 2022] DELETE /identity/v3/users/d31ded6d0352406a87f1731bafda3f94 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:35.995828 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908245e-01db-41ce-99a2-2b0cdabe2f02 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:35.996166 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908245e-01db-41ce-99a2-2b0cdabe2f02 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:35.996402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908245e-01db-41ce-99a2-2b0cdabe2f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:36.000678 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fa8364df-89c0-4e29-a43f-9be2046ed391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '880945743742454d8bf902cb632d9610'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:36.001765 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fa8364df-89c0-4e29-a43f-9be2046ed391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '880945743742454d8bf902cb632d9610'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:36.014581 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fa8364df-89c0-4e29-a43f-9be2046ed391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '880945743742454d8bf902cb632d9610'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:36.025511 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 952/1901] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:35 2022] DELETE /identity/v3/users/880945743742454d8bf902cb632d9610 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:36.061036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-2908245e-01db-41ce-99a2-2b0cdabe2f02 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:36.062331 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-2908245e-01db-41ce-99a2-2b0cdabe2f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:36.134855 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 950/1902] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:36.168233 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8364df-89c0-4e29-a43f-9be2046ed391 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:36.170516 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-fa8364df-89c0-4e29-a43f-9be2046ed391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:36.341081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8364df-89c0-4e29-a43f-9be2046ed391 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:36.347852 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de3cc6-11c4-4060-ae99-7e358fa0b368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:36.348482 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de3cc6-11c4-4060-ae99-7e358fa0b368 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:36.348758 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de3cc6-11c4-4060-ae99-7e358fa0b368 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:36.349033 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de3cc6-11c4-4060-ae99-7e358fa0b368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:36.368652 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de3cc6-11c4-4060-ae99-7e358fa0b368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:36.371843 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de3cc6-11c4-4060-ae99-7e358fa0b368 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:36.400679 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 953/1903] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:36.853496 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908245e-01db-41ce-99a2-2b0cdabe2f02 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:36.858187 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-2908245e-01db-41ce-99a2-2b0cdabe2f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:36.879715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908245e-01db-41ce-99a2-2b0cdabe2f02 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:36.901660 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cf2ff-74a9-4d68-bbbc-c8c237e7f97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:36.902701 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cf2ff-74a9-4d68-bbbc-c8c237e7f97a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:36.903205 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cf2ff-74a9-4d68-bbbc-c8c237e7f97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:36.904317 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cf2ff-74a9-4d68-bbbc-c8c237e7f97a admin admin] PATH_INFO: `/v3/projects/ad40cc3fdd24406c92d72003d06aeed6` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:36.909989 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3cf2ff-74a9-4d68-bbbc-c8c237e7f97a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad40cc3fdd24406c92d72003d06aeed6)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:36.918036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3cf2ff-74a9-4d68-bbbc-c8c237e7f97a admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:37.091227 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de3cc6-11c4-4060-ae99-7e358fa0b368 service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:37.093698 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-10de3cc6-11c4-4060-ae99-7e358fa0b368 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:37.108839 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7d3cf2ff-74a9-4d68-bbbc-c8c237e7f97a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad40cc3fdd24406c92d72003d06aeed6', 'request_id': 'req-7d3cf2ff-74a9-4d68-bbbc-c8c237e7f97a'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:37.140473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7d3cf2ff-74a9-4d68-bbbc-c8c237e7f97a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad40cc3fdd24406c92d72003d06aeed6', 'request_id': 'req-7d3cf2ff-74a9-4d68-bbbc-c8c237e7f97a'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:37.144768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de3cc6-11c4-4060-ae99-7e358fa0b368 service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:37.156475 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7d3cf2ff-74a9-4d68-bbbc-c8c237e7f97a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad40cc3fdd24406c92d72003d06aeed6', 'request_id': 'req-7d3cf2ff-74a9-4d68-bbbc-c8c237e7f97a'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:37.212404 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7d3cf2ff-74a9-4d68-bbbc-c8c237e7f97a admin admin] The token cache is being invalidate because project ad40cc3fdd24406c92d72003d06aeed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:37.217116 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7d3cf2ff-74a9-4d68-bbbc-c8c237e7f97a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:37.218509 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7d3cf2ff-74a9-4d68-bbbc-c8c237e7f97a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:37.224592 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 951/1904] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:36 2022] DELETE /identity/v3/projects/ad40cc3fdd24406c92d72003d06aeed6 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:37.228694 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cf2ff-74a9-4d68-bbbc-c8c237e7f97a admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:37.235369 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-7d3cf2ff-74a9-4d68-bbbc-c8c237e7f97a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:37.294489 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b60b69-c7db-4e3e-88c7-a5e2fe59d4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:37.295524 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b60b69-c7db-4e3e-88c7-a5e2fe59d4ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:37.296025 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b60b69-c7db-4e3e-88c7-a5e2fe59d4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:37.296620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b60b69-c7db-4e3e-88c7-a5e2fe59d4ad admin admin] PATH_INFO: `/v3/projects/cd46e4fa8ba74227b32f130e2ef3b350` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:37.298679 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b60b69-c7db-4e3e-88c7-a5e2fe59d4ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd46e4fa8ba74227b32f130e2ef3b350)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:37.301325 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b60b69-c7db-4e3e-88c7-a5e2fe59d4ad admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:37.463265 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cf2ff-74a9-4d68-bbbc-c8c237e7f97a admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:37.463826 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-77b60b69-c7db-4e3e-88c7-a5e2fe59d4ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd46e4fa8ba74227b32f130e2ef3b350', 'request_id': 'req-77b60b69-c7db-4e3e-88c7-a5e2fe59d4ad'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:37.488000 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-77b60b69-c7db-4e3e-88c7-a5e2fe59d4ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd46e4fa8ba74227b32f130e2ef3b350', 'request_id': 'req-77b60b69-c7db-4e3e-88c7-a5e2fe59d4ad'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:37.504607 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-77b60b69-c7db-4e3e-88c7-a5e2fe59d4ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd46e4fa8ba74227b32f130e2ef3b350', 'request_id': 'req-77b60b69-c7db-4e3e-88c7-a5e2fe59d4ad'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:37.520036 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:37.550834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-77b60b69-c7db-4e3e-88c7-a5e2fe59d4ad admin admin] The token cache is being invalidate because project cd46e4fa8ba74227b32f130e2ef3b350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:37.551240 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-77b60b69-c7db-4e3e-88c7-a5e2fe59d4ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:37.551934 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-77b60b69-c7db-4e3e-88c7-a5e2fe59d4ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:37.553148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:37.559056 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 954/1905] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:37 2022] DELETE /identity/v3/projects/cd46e4fa8ba74227b32f130e2ef3b350 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:37.560117 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b60b69-c7db-4e3e-88c7-a5e2fe59d4ad admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:37.562510 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-77b60b69-c7db-4e3e-88c7-a5e2fe59d4ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:37.652714 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde935a8-a1e1-4558-88b1-e307953b3a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:37.654616 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde935a8-a1e1-4558-88b1-e307953b3a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:37.656348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde935a8-a1e1-4558-88b1-e307953b3a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:37.656913 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde935a8-a1e1-4558-88b1-e307953b3a04 admin admin] PATH_INFO: `/v3/users/ce22d8c9e2bb46818f2238be5f3a278f` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:37.661618 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde935a8-a1e1-4558-88b1-e307953b3a04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce22d8c9e2bb46818f2238be5f3a278f)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:37.663852 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde935a8-a1e1-4558-88b1-e307953b3a04 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:37.730204 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b60b69-c7db-4e3e-88c7-a5e2fe59d4ad admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:37.746933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ca19c-96fe-47d7-89ba-82f4b52b0c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:37.747768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ca19c-96fe-47d7-89ba-82f4b52b0c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:37.748046 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ca19c-96fe-47d7-89ba-82f4b52b0c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:37.748321 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ca19c-96fe-47d7-89ba-82f4b52b0c1b admin admin] PATH_INFO: `/v3/users/b223e92ec7c740c7b860c0e8601513e2` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:37.749737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-dde935a8-a1e1-4558-88b1-e307953b3a04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce22d8c9e2bb46818f2238be5f3a278f'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:37.750290 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ca19c-96fe-47d7-89ba-82f4b52b0c1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b223e92ec7c740c7b860c0e8601513e2)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:37.753280 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ca19c-96fe-47d7-89ba-82f4b52b0c1b admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:37.760461 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-dde935a8-a1e1-4558-88b1-e307953b3a04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce22d8c9e2bb46818f2238be5f3a278f'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:37.761626 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-dde935a8-a1e1-4558-88b1-e307953b3a04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce22d8c9e2bb46818f2238be5f3a278f'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:37.762255 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-dde935a8-a1e1-4558-88b1-e307953b3a04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce22d8c9e2bb46818f2238be5f3a278f'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:37.786965 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-dde935a8-a1e1-4558-88b1-e307953b3a04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce22d8c9e2bb46818f2238be5f3a278f'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:37.822753 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 952/1906] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:37 2022] DELETE /identity/v3/users/ce22d8c9e2bb46818f2238be5f3a278f => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:37.852509 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8e5ca19c-96fe-47d7-89ba-82f4b52b0c1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b223e92ec7c740c7b860c0e8601513e2'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:37.865350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8e5ca19c-96fe-47d7-89ba-82f4b52b0c1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b223e92ec7c740c7b860c0e8601513e2'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:37.908670 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8e5ca19c-96fe-47d7-89ba-82f4b52b0c1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b223e92ec7c740c7b860c0e8601513e2'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:37.909974 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8e5ca19c-96fe-47d7-89ba-82f4b52b0c1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b223e92ec7c740c7b860c0e8601513e2'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:37.930490 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8e5ca19c-96fe-47d7-89ba-82f4b52b0c1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b223e92ec7c740c7b860c0e8601513e2'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:37.956700 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 955/1907] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:37 2022] DELETE /identity/v3/users/b223e92ec7c740c7b860c0e8601513e2 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:38.482555 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde935a8-a1e1-4558-88b1-e307953b3a04 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:38.483868 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-dde935a8-a1e1-4558-88b1-e307953b3a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:38.590361 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ca19c-96fe-47d7-89ba-82f4b52b0c1b admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:38.592268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-8e5ca19c-96fe-47d7-89ba-82f4b52b0c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:38.721504 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ca19c-96fe-47d7-89ba-82f4b52b0c1b admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:38.734491 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336dc60-2220-4f26-a815-ff32e42551da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:38.739772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336dc60-2220-4f26-a815-ff32e42551da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:38.740082 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336dc60-2220-4f26-a815-ff32e42551da admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:38.740377 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336dc60-2220-4f26-a815-ff32e42551da admin admin] PATH_INFO: `/v3/projects/bd58713477d9494384554bb556d07e27` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:38.744073 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336dc60-2220-4f26-a815-ff32e42551da admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd58713477d9494384554bb556d07e27)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:38.744336 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde935a8-a1e1-4558-88b1-e307953b3a04 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:38.752022 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336dc60-2220-4f26-a815-ff32e42551da admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:38.763717 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64a919-59df-4dd5-8854-47ea1cf0ebe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:38.764380 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64a919-59df-4dd5-8854-47ea1cf0ebe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:38.764694 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64a919-59df-4dd5-8854-47ea1cf0ebe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:38.764930 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64a919-59df-4dd5-8854-47ea1cf0ebe9 admin admin] PATH_INFO: `/v3/projects/75504c3837b9479ab2a07d7944723969` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:38.772705 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64a919-59df-4dd5-8854-47ea1cf0ebe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75504c3837b9479ab2a07d7944723969)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:38.774808 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64a919-59df-4dd5-8854-47ea1cf0ebe9 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:38.825241 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:38.886486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b336dc60-2220-4f26-a815-ff32e42551da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd58713477d9494384554bb556d07e27', 'request_id': 'req-b336dc60-2220-4f26-a815-ff32e42551da'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:38.891497 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:38.898393 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1e64a919-59df-4dd5-8854-47ea1cf0ebe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75504c3837b9479ab2a07d7944723969', 'request_id': 'req-1e64a919-59df-4dd5-8854-47ea1cf0ebe9'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:38.899391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b336dc60-2220-4f26-a815-ff32e42551da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd58713477d9494384554bb556d07e27', 'request_id': 'req-b336dc60-2220-4f26-a815-ff32e42551da'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:38.921388 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1e64a919-59df-4dd5-8854-47ea1cf0ebe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75504c3837b9479ab2a07d7944723969', 'request_id': 'req-1e64a919-59df-4dd5-8854-47ea1cf0ebe9'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:38.924452 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b336dc60-2220-4f26-a815-ff32e42551da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd58713477d9494384554bb556d07e27', 'request_id': 'req-b336dc60-2220-4f26-a815-ff32e42551da'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:38.931344 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1e64a919-59df-4dd5-8854-47ea1cf0ebe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75504c3837b9479ab2a07d7944723969', 'request_id': 'req-1e64a919-59df-4dd5-8854-47ea1cf0ebe9'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:38.946940 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1e64a919-59df-4dd5-8854-47ea1cf0ebe9 admin admin] The token cache is being invalidate because project 75504c3837b9479ab2a07d7944723969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:38.947255 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1e64a919-59df-4dd5-8854-47ea1cf0ebe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:38.948348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1e64a919-59df-4dd5-8854-47ea1cf0ebe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:38.950733 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 953/1908] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:38 2022] DELETE /identity/v3/projects/75504c3837b9479ab2a07d7944723969 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:42:38.961494 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b336dc60-2220-4f26-a815-ff32e42551da admin admin] The token cache is being invalidate because project bd58713477d9494384554bb556d07e27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:38.961875 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b336dc60-2220-4f26-a815-ff32e42551da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:38.962580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b336dc60-2220-4f26-a815-ff32e42551da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:38.964234 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 956/1909] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:38 2022] DELETE /identity/v3/projects/bd58713477d9494384554bb556d07e27 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:38.969452 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf24bb8-a3a3-4d3c-b740-27b57d05926a None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:38.969742 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf24bb8-a3a3-4d3c-b740-27b57d05926a None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:38.970040 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf24bb8-a3a3-4d3c-b740-27b57d05926a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:38.973197 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd10e4-1028-4f94-be12-0729c05981e5 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:38.976458 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd10e4-1028-4f94-be12-0729c05981e5 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:38.976929 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd10e4-1028-4f94-be12-0729c05981e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:39.003274 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-74fd10e4-1028-4f94-be12-0729c05981e5 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:39.004859 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-74fd10e4-1028-4f94-be12-0729c05981e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:39.015432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-faf24bb8-a3a3-4d3c-b740-27b57d05926a None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:39.016691 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-faf24bb8-a3a3-4d3c-b740-27b57d05926a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:39.100884 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 954/1910] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:39.112896 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67216efc-63a2-453a-9295-1f073d2abbfb None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:39.113180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67216efc-63a2-453a-9295-1f073d2abbfb None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:39.113455 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67216efc-63a2-453a-9295-1f073d2abbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:39.170536 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-67216efc-63a2-453a-9295-1f073d2abbfb None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:39.175601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-67216efc-63a2-453a-9295-1f073d2abbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:39.202416 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 955/1911] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:39.207922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67216efc-63a2-453a-9295-1f073d2abbfb None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:39.238764 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67216efc-63a2-453a-9295-1f073d2abbfb None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:39.246944 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68bb8c-8d09-4016-8450-a6360e25c2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:39.250049 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 957/1912] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:39.258370 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68bb8c-8d09-4016-8450-a6360e25c2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:39.259252 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68bb8c-8d09-4016-8450-a6360e25c2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:39.259756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68bb8c-8d09-4016-8450-a6360e25c2a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:39.261029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68bb8c-8d09-4016-8450-a6360e25c2a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:42:39.261798 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68bb8c-8d09-4016-8450-a6360e25c2a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:39.263764 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68bb8c-8d09-4016-8450-a6360e25c2a2 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:39.269687 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a797ff-60f3-41c3-81ea-1196485cf5d1 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:39.270341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a797ff-60f3-41c3-81ea-1196485cf5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:39.270832 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a797ff-60f3-41c3-81ea-1196485cf5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:39.319354 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 956/1913] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:42:39.326614 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68bb8c-8d09-4016-8450-a6360e25c2a2 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:39.336268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-83a797ff-60f3-41c3-81ea-1196485cf5d1 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:39.337786 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-83a797ff-60f3-41c3-81ea-1196485cf5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:39.369541 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68bb8c-8d09-4016-8450-a6360e25c2a2 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:39.386414 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2ebfd-3024-4075-9c95-c4c8d9a0c815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:39.386635 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 958/1914] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:39.387945 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2ebfd-3024-4075-9c95-c4c8d9a0c815 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:39.388523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2ebfd-3024-4075-9c95-c4c8d9a0c815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:39.389021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2ebfd-3024-4075-9c95-c4c8d9a0c815 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:39.389909 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2ebfd-3024-4075-9c95-c4c8d9a0c815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:39.391312 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a797ff-60f3-41c3-81ea-1196485cf5d1 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:39.393327 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2ebfd-3024-4075-9c95-c4c8d9a0c815 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:39.411008 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a797ff-60f3-41c3-81ea-1196485cf5d1 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:39.422761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a185b-237d-470a-8a56-88ad7060d5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:39.424551 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a185b-237d-470a-8a56-88ad7060d5ee admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:39.424850 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a185b-237d-470a-8a56-88ad7060d5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:39.425122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a185b-237d-470a-8a56-88ad7060d5ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:39.425802 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a185b-237d-470a-8a56-88ad7060d5ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:42:39.426134 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a185b-237d-470a-8a56-88ad7060d5ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:39.428367 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a185b-237d-470a-8a56-88ad7060d5ee admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:39.451184 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 959/1915] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:42:39.481001 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a185b-237d-470a-8a56-88ad7060d5ee admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:39.492796 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 957/1916] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:39 2022] POST /identity/v3/projects => generated 369 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:39.495791 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2ebfd-3024-4075-9c95-c4c8d9a0c815 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:39.506533 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a185b-237d-470a-8a56-88ad7060d5ee admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:39.706249 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2e196-fcdb-4dde-a23f-961d178a121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:39.707717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2e196-fcdb-4dde-a23f-961d178a121b admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:39.708216 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2e196-fcdb-4dde-a23f-961d178a121b admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:39.708632 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2e196-fcdb-4dde-a23f-961d178a121b admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:39.709501 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2e196-fcdb-4dde-a23f-961d178a121b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:39.712051 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2e196-fcdb-4dde-a23f-961d178a121b admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:39.764101 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2ebfd-3024-4075-9c95-c4c8d9a0c815 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:39.790190 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a48e3-9066-4070-b99c-23ea772322da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:39.791222 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a48e3-9066-4070-b99c-23ea772322da admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:39.791345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a48e3-9066-4070-b99c-23ea772322da admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:39.792763 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a48e3-9066-4070-b99c-23ea772322da admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:39.792763 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a48e3-9066-4070-b99c-23ea772322da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:39.797618 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a48e3-9066-4070-b99c-23ea772322da admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:39.828794 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 960/1917] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:39 2022] POST /identity/v3/projects => generated 379 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:39.831971 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2e196-fcdb-4dde-a23f-961d178a121b admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:39.874331 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 958/1918] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:39 2022] POST /identity/v3/users => generated 285 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:39.876179 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a48e3-9066-4070-b99c-23ea772322da admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:39.886592 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:39.908470 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a48e3-9066-4070-b99c-23ea772322da admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:40.042373 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:40.101582 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2e196-fcdb-4dde-a23f-961d178a121b admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:40.145354 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f09c2-7e69-43f0-842c-962227e438de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:40.145354 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f09c2-7e69-43f0-842c-962227e438de admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:40.145354 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f09c2-7e69-43f0-842c-962227e438de admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:40.145354 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f09c2-7e69-43f0-842c-962227e438de admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:40.148593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f09c2-7e69-43f0-842c-962227e438de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:40.151002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f09c2-7e69-43f0-842c-962227e438de admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:40.176036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45268ff-d56d-47ce-ab7d-7c5dd2b6f7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:40.176774 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45268ff-d56d-47ce-ab7d-7c5dd2b6f7ae admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:40.177085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45268ff-d56d-47ce-ab7d-7c5dd2b6f7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:40.177363 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45268ff-d56d-47ce-ab7d-7c5dd2b6f7ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:40.182161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45268ff-d56d-47ce-ab7d-7c5dd2b6f7ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:40.183827 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45268ff-d56d-47ce-ab7d-7c5dd2b6f7ae admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:40.207937 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 959/1919] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:40.211729 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45268ff-d56d-47ce-ab7d-7c5dd2b6f7ae admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:40.213701 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 961/1920] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:39 2022] POST /identity/v3/users => generated 290 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:40.227496 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f09c2-7e69-43f0-842c-962227e438de admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:40.237698 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45268ff-d56d-47ce-ab7d-7c5dd2b6f7ae admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:40.243072 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65821c9b-cd0d-4b4d-8808-d282981d9d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:40.243706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65821c9b-cd0d-4b4d-8808-d282981d9d61 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:40.244091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65821c9b-cd0d-4b4d-8808-d282981d9d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:40.244467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65821c9b-cd0d-4b4d-8808-d282981d9d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:40.245747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65821c9b-cd0d-4b4d-8808-d282981d9d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:40.247877 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65821c9b-cd0d-4b4d-8808-d282981d9d61 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:40.258948 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f09c2-7e69-43f0-842c-962227e438de admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:40.278456 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4467a-7f60-4c97-83d8-52850ac5cd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:40.278717 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 960/1921] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:40.279479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4467a-7f60-4c97-83d8-52850ac5cd41 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:40.279903 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4467a-7f60-4c97-83d8-52850ac5cd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:40.280434 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4467a-7f60-4c97-83d8-52850ac5cd41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:40.281231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4467a-7f60-4c97-83d8-52850ac5cd41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:40.281737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65821c9b-cd0d-4b4d-8808-d282981d9d61 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:40.286315 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4467a-7f60-4c97-83d8-52850ac5cd41 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:40.301916 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65821c9b-cd0d-4b4d-8808-d282981d9d61 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:40.303171 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 962/1922] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:40.312322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4467a-7f60-4c97-83d8-52850ac5cd41 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:40.319075 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ba951-89af-4d21-906f-8866690f61d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:40.319970 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ba951-89af-4d21-906f-8866690f61d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:40.320277 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ba951-89af-4d21-906f-8866690f61d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:40.320622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ba951-89af-4d21-906f-8866690f61d0 admin admin] PATH_INFO: `/v3/projects/5e8ec1a394f8410db119af892121ddc9/users/7a070b7fa5074d6ea71aad94783d0c69/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:40.329115 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4467a-7f60-4c97-83d8-52850ac5cd41 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:40.334055 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8b28a-1704-4f06-9fa5-9ba092f40b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:40.334903 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8b28a-1704-4f06-9fa5-9ba092f40b63 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:40.335410 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8b28a-1704-4f06-9fa5-9ba092f40b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:40.336071 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8b28a-1704-4f06-9fa5-9ba092f40b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:40.336827 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8b28a-1704-4f06-9fa5-9ba092f40b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:40.338643 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8b28a-1704-4f06-9fa5-9ba092f40b63 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:40.342725 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ba951-89af-4d21-906f-8866690f61d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e8ec1a394f8410db119af892121ddc9, user_id=7a070b7fa5074d6ea71aad94783d0c69, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:40.346893 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ba951-89af-4d21-906f-8866690f61d0 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:40.355556 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 963/1923] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:40.356954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8b28a-1704-4f06-9fa5-9ba092f40b63 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:40.369643 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8b28a-1704-4f06-9fa5-9ba092f40b63 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:40.389667 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 961/1924] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:40 2022] PUT /identity/v3/projects/5e8ec1a394f8410db119af892121ddc9/users/7a070b7fa5074d6ea71aad94783d0c69/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:40.401281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86771f66-0579-4d85-82c1-6aaafa80ab41 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:40.401572 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86771f66-0579-4d85-82c1-6aaafa80ab41 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:40.401881 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86771f66-0579-4d85-82c1-6aaafa80ab41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:40.454403 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-86771f66-0579-4d85-82c1-6aaafa80ab41 None None] MFA Rules not processed for user `7a070b7fa5074d6ea71aad94783d0c69`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:40.456040 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-86771f66-0579-4d85-82c1-6aaafa80ab41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:40.542430 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d96fe-9fe5-43ce-b253-03c12fd02a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:40.543801 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d96fe-9fe5-43ce-b253-03c12fd02a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:40.544202 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d96fe-9fe5-43ce-b253-03c12fd02a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:40.544560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d96fe-9fe5-43ce-b253-03c12fd02a1f admin admin] PATH_INFO: `/v3/projects/8d6556be08e44a929daaee4fcc1c1086/users/09b69171df59489fa436908c30554048/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:40.582479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d96fe-9fe5-43ce-b253-03c12fd02a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6556be08e44a929daaee4fcc1c1086, user_id=09b69171df59489fa436908c30554048, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:40.587461 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d96fe-9fe5-43ce-b253-03c12fd02a1f admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:40.589631 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 962/1925] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:40.634876 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 964/1926] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:40 2022] PUT /identity/v3/projects/8d6556be08e44a929daaee4fcc1c1086/users/09b69171df59489fa436908c30554048/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:40.646718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492447e3-6224-4a32-b6ce-bfddc8c1437e None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:40.647072 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492447e3-6224-4a32-b6ce-bfddc8c1437e None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:40.647418 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492447e3-6224-4a32-b6ce-bfddc8c1437e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:40.708176 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-492447e3-6224-4a32-b6ce-bfddc8c1437e None None] MFA Rules not processed for user `09b69171df59489fa436908c30554048`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:40.709900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-492447e3-6224-4a32-b6ce-bfddc8c1437e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:40.845765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 963/1927] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:40.846972 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d96fe-9fe5-43ce-b253-03c12fd02a1f admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:40.968848 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d96fe-9fe5-43ce-b253-03c12fd02a1f admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:40.975599 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352be86f-1adf-490a-b3dc-8f6e260897b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:40.976242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352be86f-1adf-490a-b3dc-8f6e260897b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:40.976525 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352be86f-1adf-490a-b3dc-8f6e260897b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:40.976975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352be86f-1adf-490a-b3dc-8f6e260897b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:40.977639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352be86f-1adf-490a-b3dc-8f6e260897b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:40.981612 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352be86f-1adf-490a-b3dc-8f6e260897b7 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:40.995875 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:41.038192 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 965/1928] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:40 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:41.042649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492447e3-6224-4a32-b6ce-bfddc8c1437e None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:41.060510 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:41.079815 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492447e3-6224-4a32-b6ce-bfddc8c1437e None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:41.216302 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0cf8b-4087-4120-86f4-a400e523fc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:41.217098 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0cf8b-4087-4120-86f4-a400e523fc64 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:41.217381 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0cf8b-4087-4120-86f4-a400e523fc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:41.217657 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0cf8b-4087-4120-86f4-a400e523fc64 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:41.218351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0cf8b-4087-4120-86f4-a400e523fc64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:41.223262 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0cf8b-4087-4120-86f4-a400e523fc64 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:41.285919 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 964/1929] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:41 2022] POST /identity/v3/users => generated 296 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:41.287579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352be86f-1adf-490a-b3dc-8f6e260897b7 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:41.298724 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352be86f-1adf-490a-b3dc-8f6e260897b7 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:41.304506 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9017f9f-a88c-4b76-bcf7-a186273eff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:41.305281 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9017f9f-a88c-4b76-bcf7-a186273eff3c admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:41.305680 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9017f9f-a88c-4b76-bcf7-a186273eff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:41.318581 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9017f9f-a88c-4b76-bcf7-a186273eff3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:41.319694 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9017f9f-a88c-4b76-bcf7-a186273eff3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:41.322664 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9017f9f-a88c-4b76-bcf7-a186273eff3c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:41.341751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 966/1930] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:41.342720 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0cf8b-4087-4120-86f4-a400e523fc64 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:41.359306 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0cf8b-4087-4120-86f4-a400e523fc64 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:41.365161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95952319-4d3f-4573-9396-184d2cd97d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:41.365962 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95952319-4d3f-4573-9396-184d2cd97d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:41.366166 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95952319-4d3f-4573-9396-184d2cd97d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:41.366414 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95952319-4d3f-4573-9396-184d2cd97d5b admin admin] PATH_INFO: `/v3/projects/561f0e02864a422f9107c0e4ec805cf5/users/32ad1cf4b5974b4781ac6f2e8b565de5/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:41.395926 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95952319-4d3f-4573-9396-184d2cd97d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=561f0e02864a422f9107c0e4ec805cf5, user_id=32ad1cf4b5974b4781ac6f2e8b565de5, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:41.399242 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95952319-4d3f-4573-9396-184d2cd97d5b admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:41.437790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 965/1931] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:41 2022] PUT /identity/v3/projects/561f0e02864a422f9107c0e4ec805cf5/users/32ad1cf4b5974b4781ac6f2e8b565de5/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:42:41.452394 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9017f9f-a88c-4b76-bcf7-a186273eff3c admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:41.465386 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9017f9f-a88c-4b76-bcf7-a186273eff3c admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:41.553891 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11acd09-be02-4024-8a7a-0a3e29a558ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:41.554625 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11acd09-be02-4024-8a7a-0a3e29a558ba admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:41.554972 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11acd09-be02-4024-8a7a-0a3e29a558ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:41.555312 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11acd09-be02-4024-8a7a-0a3e29a558ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:41.556032 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11acd09-be02-4024-8a7a-0a3e29a558ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:41.558802 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11acd09-be02-4024-8a7a-0a3e29a558ba admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:41.570969 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 967/1932] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:41.577421 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95952319-4d3f-4573-9396-184d2cd97d5b admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:41.579105 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11acd09-be02-4024-8a7a-0a3e29a558ba admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:41.587185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-f11acd09-be02-4024-8a7a-0a3e29a558ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:41.590371 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95952319-4d3f-4573-9396-184d2cd97d5b admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:41.597598 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5e500-fc4f-4676-a3a1-7ad0462cb2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:41.598387 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5e500-fc4f-4676-a3a1-7ad0462cb2e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:41.598791 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5e500-fc4f-4676-a3a1-7ad0462cb2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:41.599166 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5e500-fc4f-4676-a3a1-7ad0462cb2e0 admin admin] PATH_INFO: `/v3/projects/561f0e02864a422f9107c0e4ec805cf5/users/32ad1cf4b5974b4781ac6f2e8b565de5/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:41.602392 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5e500-fc4f-4676-a3a1-7ad0462cb2e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=561f0e02864a422f9107c0e4ec805cf5, user_id=32ad1cf4b5974b4781ac6f2e8b565de5, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:41.609383 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5e500-fc4f-4676-a3a1-7ad0462cb2e0 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:41.634170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 966/1933] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:41 2022] PUT /identity/v3/projects/561f0e02864a422f9107c0e4ec805cf5/users/32ad1cf4b5974b4781ac6f2e8b565de5/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:41.640502 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b3144-b142-4115-8736-7d0ec7d4f4f2 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:41.641192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b3144-b142-4115-8736-7d0ec7d4f4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:41.641695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b3144-b142-4115-8736-7d0ec7d4f4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:41.686989 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-346b3144-b142-4115-8736-7d0ec7d4f4f2 None None] MFA Rules not processed for user `32ad1cf4b5974b4781ac6f2e8b565de5`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:41.688212 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-346b3144-b142-4115-8736-7d0ec7d4f4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:41.696415 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11acd09-be02-4024-8a7a-0a3e29a558ba admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:41.769121 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195cb7c-ac16-4880-813e-9d0780915be2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '077f50ca034b4d12817543377815393b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:41.769747 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195cb7c-ac16-4880-813e-9d0780915be2 service glance] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:41.770058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195cb7c-ac16-4880-813e-9d0780915be2 service glance] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:41.770333 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195cb7c-ac16-4880-813e-9d0780915be2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:41.783461 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 967/1934] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:41.794238 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b3144-b142-4115-8736-7d0ec7d4f4f2 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:41.799108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-346b3144-b142-4115-8736-7d0ec7d4f4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:41.838154 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:41.858267 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:41.866281 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195cb7c-ac16-4880-813e-9d0780915be2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:41.869255 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195cb7c-ac16-4880-813e-9d0780915be2 service glance] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:41.874943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b3144-b142-4115-8736-7d0ec7d4f4f2 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:41.881103 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b45976-1f2e-422b-abc5-e66dd957f989 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:41.881731 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b45976-1f2e-422b-abc5-e66dd957f989 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:41.882049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b45976-1f2e-422b-abc5-e66dd957f989 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:41.882326 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b45976-1f2e-422b-abc5-e66dd957f989 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:41.883830 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 968/1935] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:42:41.896063 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b45976-1f2e-422b-abc5-e66dd957f989 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:41.897878 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b45976-1f2e-422b-abc5-e66dd957f989 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:41.914411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 968/1936] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:41 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:42:42.687593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195cb7c-ac16-4880-813e-9d0780915be2 service glance] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:42.909749 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195cb7c-ac16-4880-813e-9d0780915be2 service glance] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:42.916146 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6ed34-7c6e-4fc8-8bc4-9d88f4f6e8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:42.917310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6ed34-7c6e-4fc8-8bc4-9d88f4f6e8da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:42.917826 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6ed34-7c6e-4fc8-8bc4-9d88f4f6e8da admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:42.918267 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6ed34-7c6e-4fc8-8bc4-9d88f4f6e8da admin admin] PATH_INFO: `/v3/users/09b69171df59489fa436908c30554048` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:42.919600 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6ed34-7c6e-4fc8-8bc4-9d88f4f6e8da admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b69171df59489fa436908c30554048)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:42.924952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6ed34-7c6e-4fc8-8bc4-9d88f4f6e8da admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:42.992499 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-cae6ed34-7c6e-4fc8-8bc4-9d88f4f6e8da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b69171df59489fa436908c30554048'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:43.004403 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-cae6ed34-7c6e-4fc8-8bc4-9d88f4f6e8da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b69171df59489fa436908c30554048'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:43.022390 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-cae6ed34-7c6e-4fc8-8bc4-9d88f4f6e8da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b69171df59489fa436908c30554048'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:43.024420 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-cae6ed34-7c6e-4fc8-8bc4-9d88f4f6e8da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b69171df59489fa436908c30554048'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:43.044843 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-cae6ed34-7c6e-4fc8-8bc4-9d88f4f6e8da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b69171df59489fa436908c30554048'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:43.060272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 969/1937] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:42 2022] DELETE /identity/v3/users/09b69171df59489fa436908c30554048 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:43.062981 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4d739-e1f7-48f8-adcc-bc293e291561 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:43.063456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4d739-e1f7-48f8-adcc-bc293e291561 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:43.063725 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4d739-e1f7-48f8-adcc-bc293e291561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:43.098400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-82f4d739-e1f7-48f8-adcc-bc293e291561 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:43.099641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-82f4d739-e1f7-48f8-adcc-bc293e291561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:43.206495 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 969/1938] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:43.217389 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6ed34-7c6e-4fc8-8bc4-9d88f4f6e8da admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:43.219279 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-cae6ed34-7c6e-4fc8-8bc4-9d88f4f6e8da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:43.309691 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6ed34-7c6e-4fc8-8bc4-9d88f4f6e8da admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:43.317604 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48990e15-e02c-4748-91ee-99c6d570276d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:43.318983 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48990e15-e02c-4748-91ee-99c6d570276d service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:43.319786 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48990e15-e02c-4748-91ee-99c6d570276d service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:43.320262 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48990e15-e02c-4748-91ee-99c6d570276d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:43.335169 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48990e15-e02c-4748-91ee-99c6d570276d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:43.338126 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48990e15-e02c-4748-91ee-99c6d570276d service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:43.366727 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 970/1939] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:44.008651 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4d739-e1f7-48f8-adcc-bc293e291561 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:44.010428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-82f4d739-e1f7-48f8-adcc-bc293e291561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:44.046272 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4d739-e1f7-48f8-adcc-bc293e291561 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:44.062845 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6d072-b87b-47f9-81ef-52332499ce3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:44.064269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6d072-b87b-47f9-81ef-52332499ce3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:44.065246 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6d072-b87b-47f9-81ef-52332499ce3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:44.073121 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6d072-b87b-47f9-81ef-52332499ce3a admin admin] PATH_INFO: `/v3/projects/8d6556be08e44a929daaee4fcc1c1086` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:44.075806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6d072-b87b-47f9-81ef-52332499ce3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d6556be08e44a929daaee4fcc1c1086)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:44.081368 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6d072-b87b-47f9-81ef-52332499ce3a admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:44.192370 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ffe6d072-b87b-47f9-81ef-52332499ce3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d6556be08e44a929daaee4fcc1c1086', 'request_id': 'req-ffe6d072-b87b-47f9-81ef-52332499ce3a'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:44.201405 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ffe6d072-b87b-47f9-81ef-52332499ce3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d6556be08e44a929daaee4fcc1c1086', 'request_id': 'req-ffe6d072-b87b-47f9-81ef-52332499ce3a'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:44.214720 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ffe6d072-b87b-47f9-81ef-52332499ce3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d6556be08e44a929daaee4fcc1c1086', 'request_id': 'req-ffe6d072-b87b-47f9-81ef-52332499ce3a'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:44.228530 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ffe6d072-b87b-47f9-81ef-52332499ce3a admin admin] The token cache is being invalidate because project 8d6556be08e44a929daaee4fcc1c1086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:44.229160 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ffe6d072-b87b-47f9-81ef-52332499ce3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:44.229803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ffe6d072-b87b-47f9-81ef-52332499ce3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:44.231884 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 970/1940] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:44 2022] DELETE /identity/v3/projects/8d6556be08e44a929daaee4fcc1c1086 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:44.236680 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48990e15-e02c-4748-91ee-99c6d570276d service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:44.250549 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48990e15-e02c-4748-91ee-99c6d570276d service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:44.255926 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:44.359440 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695e92b-1b36-4a6a-94d0-0d0bd61b61c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:44.360105 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695e92b-1b36-4a6a-94d0-0d0bd61b61c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:44.360781 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695e92b-1b36-4a6a-94d0-0d0bd61b61c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:44.361162 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695e92b-1b36-4a6a-94d0-0d0bd61b61c7 admin admin] PATH_INFO: `/v3/users/32ad1cf4b5974b4781ac6f2e8b565de5` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:44.362462 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695e92b-1b36-4a6a-94d0-0d0bd61b61c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32ad1cf4b5974b4781ac6f2e8b565de5)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:44.364416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695e92b-1b36-4a6a-94d0-0d0bd61b61c7 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:44.457457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c695e92b-1b36-4a6a-94d0-0d0bd61b61c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32ad1cf4b5974b4781ac6f2e8b565de5'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:44.466863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c695e92b-1b36-4a6a-94d0-0d0bd61b61c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32ad1cf4b5974b4781ac6f2e8b565de5'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:44.492631 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c695e92b-1b36-4a6a-94d0-0d0bd61b61c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32ad1cf4b5974b4781ac6f2e8b565de5'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:44.493488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c695e92b-1b36-4a6a-94d0-0d0bd61b61c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32ad1cf4b5974b4781ac6f2e8b565de5'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:44.505945 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c695e92b-1b36-4a6a-94d0-0d0bd61b61c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32ad1cf4b5974b4781ac6f2e8b565de5'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:44.522978 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 971/1941] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:44 2022] DELETE /identity/v3/users/32ad1cf4b5974b4781ac6f2e8b565de5 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:44.946908 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6d072-b87b-47f9-81ef-52332499ce3a admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:44.948885 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-ffe6d072-b87b-47f9-81ef-52332499ce3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:44.972150 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6d072-b87b-47f9-81ef-52332499ce3a admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:45.118123 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c2416-c42e-4971-bf07-232a527f8ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:45.118807 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c2416-c42e-4971-bf07-232a527f8ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:45.119140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c2416-c42e-4971-bf07-232a527f8ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:45.119488 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c2416-c42e-4971-bf07-232a527f8ccf admin admin] PATH_INFO: `/v3/projects/561f0e02864a422f9107c0e4ec805cf5` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:45.120717 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c2416-c42e-4971-bf07-232a527f8ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=561f0e02864a422f9107c0e4ec805cf5)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:45.122916 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c2416-c42e-4971-bf07-232a527f8ccf admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:45.135913 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:45.226316 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-708c2416-c42e-4971-bf07-232a527f8ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561f0e02864a422f9107c0e4ec805cf5', 'request_id': 'req-708c2416-c42e-4971-bf07-232a527f8ccf'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:45.238997 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-708c2416-c42e-4971-bf07-232a527f8ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561f0e02864a422f9107c0e4ec805cf5', 'request_id': 'req-708c2416-c42e-4971-bf07-232a527f8ccf'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:45.246699 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-708c2416-c42e-4971-bf07-232a527f8ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561f0e02864a422f9107c0e4ec805cf5', 'request_id': 'req-708c2416-c42e-4971-bf07-232a527f8ccf'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:45.260811 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-708c2416-c42e-4971-bf07-232a527f8ccf admin admin] The token cache is being invalidate because project 561f0e02864a422f9107c0e4ec805cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:45.261443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-708c2416-c42e-4971-bf07-232a527f8ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:45.262892 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-708c2416-c42e-4971-bf07-232a527f8ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:45.270084 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 971/1942] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:44 2022] DELETE /identity/v3/projects/561f0e02864a422f9107c0e4ec805cf5 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:45.271812 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccb3b8-bda0-4124-ad96-a6d8f3b1ee7c None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:45.272282 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccb3b8-bda0-4124-ad96-a6d8f3b1ee7c None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:45.272367 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccb3b8-bda0-4124-ad96-a6d8f3b1ee7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:45.307721 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-75ccb3b8-bda0-4124-ad96-a6d8f3b1ee7c None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:45.309803 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-75ccb3b8-bda0-4124-ad96-a6d8f3b1ee7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:45.415101 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 972/1943] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:45.425913 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538535e0-714e-4822-ac5b-68cbeacb83a0 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:45.425913 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538535e0-714e-4822-ac5b-68cbeacb83a0 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:45.425913 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538535e0-714e-4822-ac5b-68cbeacb83a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:45.456176 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-538535e0-714e-4822-ac5b-68cbeacb83a0 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:45.458370 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-538535e0-714e-4822-ac5b-68cbeacb83a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:45.488231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 972/1944] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:45.491168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccb3b8-bda0-4124-ad96-a6d8f3b1ee7c None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:45.508937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccb3b8-bda0-4124-ad96-a6d8f3b1ee7c None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:45.519427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8346b85-2e4b-4f6b-aace-e2b3caf0dc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:45.520498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8346b85-2e4b-4f6b-aace-e2b3caf0dc44 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:45.521038 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8346b85-2e4b-4f6b-aace-e2b3caf0dc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:45.521490 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8346b85-2e4b-4f6b-aace-e2b3caf0dc44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:45.522842 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8346b85-2e4b-4f6b-aace-e2b3caf0dc44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:42:45.523348 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8346b85-2e4b-4f6b-aace-e2b3caf0dc44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:45.526642 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8346b85-2e4b-4f6b-aace-e2b3caf0dc44 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:45.549820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 973/1945] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:42:45.556178 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538535e0-714e-4822-ac5b-68cbeacb83a0 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:45.566090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538535e0-714e-4822-ac5b-68cbeacb83a0 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:45.573037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a524a-45b2-45c0-945b-5366eb71c838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:45.573807 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a524a-45b2-45c0-945b-5366eb71c838 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:45.574124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a524a-45b2-45c0-945b-5366eb71c838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:45.574394 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a524a-45b2-45c0-945b-5366eb71c838 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:45.575088 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a524a-45b2-45c0-945b-5366eb71c838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:45.577034 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a524a-45b2-45c0-945b-5366eb71c838 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:45.633502 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 973/1946] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:45 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:45.637398 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8346b85-2e4b-4f6b-aace-e2b3caf0dc44 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:45.652549 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8346b85-2e4b-4f6b-aace-e2b3caf0dc44 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:45.667677 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:45.775834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdd64b-c3c1-41b8-af05-358e498679da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:45.776472 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdd64b-c3c1-41b8-af05-358e498679da admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:45.776753 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdd64b-c3c1-41b8-af05-358e498679da admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:45.777027 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdd64b-c3c1-41b8-af05-358e498679da admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:45.777675 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdd64b-c3c1-41b8-af05-358e498679da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:45.779780 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdd64b-c3c1-41b8-af05-358e498679da admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:45.810698 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 974/1947] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:45 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:45.815424 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a524a-45b2-45c0-945b-5366eb71c838 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:45.827398 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a524a-45b2-45c0-945b-5366eb71c838 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:45.839246 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012ed80-17ee-4b9b-be8e-408d05fd8a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:45.839887 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012ed80-17ee-4b9b-be8e-408d05fd8a22 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:45.840312 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012ed80-17ee-4b9b-be8e-408d05fd8a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:45.840588 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012ed80-17ee-4b9b-be8e-408d05fd8a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:45.841264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012ed80-17ee-4b9b-be8e-408d05fd8a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:45.843103 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012ed80-17ee-4b9b-be8e-408d05fd8a22 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:45.868207 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 974/1948] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:45.868705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdd64b-c3c1-41b8-af05-358e498679da admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:45.886312 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdd64b-c3c1-41b8-af05-358e498679da admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:45.897125 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fbf57-0801-4b56-9cc4-bb6ed4b6c015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:45.897739 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fbf57-0801-4b56-9cc4-bb6ed4b6c015 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:45.898047 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fbf57-0801-4b56-9cc4-bb6ed4b6c015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:45.898314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fbf57-0801-4b56-9cc4-bb6ed4b6c015 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:45.898957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fbf57-0801-4b56-9cc4-bb6ed4b6c015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:45.900539 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fbf57-0801-4b56-9cc4-bb6ed4b6c015 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:45.914463 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 975/1949] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:42:45.926926 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012ed80-17ee-4b9b-be8e-408d05fd8a22 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:45.945483 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012ed80-17ee-4b9b-be8e-408d05fd8a22 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:45.951979 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ba3cc-5cc6-4122-a719-9bf27e6ef212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:45.952798 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ba3cc-5cc6-4122-a719-9bf27e6ef212 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:45.953184 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ba3cc-5cc6-4122-a719-9bf27e6ef212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:45.953522 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ba3cc-5cc6-4122-a719-9bf27e6ef212 admin admin] PATH_INFO: `/v3/projects/c2e3f9a42928407aaac2f1d17cbb320e/users/83f9f736bb2549848570d48c5cc62d48/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:45.975334 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ba3cc-5cc6-4122-a719-9bf27e6ef212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2e3f9a42928407aaac2f1d17cbb320e, user_id=83f9f736bb2549848570d48c5cc62d48, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:45.979379 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ba3cc-5cc6-4122-a719-9bf27e6ef212 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:46.014097 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 975/1950] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:45 2022] PUT /identity/v3/projects/c2e3f9a42928407aaac2f1d17cbb320e/users/83f9f736bb2549848570d48c5cc62d48/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:46.023476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e357e-fcaf-4eac-a65d-5c6beda1b4e5 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:46.023877 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e357e-fcaf-4eac-a65d-5c6beda1b4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:46.024269 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e357e-fcaf-4eac-a65d-5c6beda1b4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:46.071553 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-d26e357e-fcaf-4eac-a65d-5c6beda1b4e5 None None] MFA Rules not processed for user `83f9f736bb2549848570d48c5cc62d48`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:46.073197 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-d26e357e-fcaf-4eac-a65d-5c6beda1b4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:46.186361 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 976/1951] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:46.187560 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ba3cc-5cc6-4122-a719-9bf27e6ef212 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:46.296915 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ba3cc-5cc6-4122-a719-9bf27e6ef212 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:46.305438 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02b216-4560-4b0e-83b4-7ceea6e8088a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:46.306503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02b216-4560-4b0e-83b4-7ceea6e8088a admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:46.307652 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02b216-4560-4b0e-83b4-7ceea6e8088a admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:46.308141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02b216-4560-4b0e-83b4-7ceea6e8088a admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:46.309564 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02b216-4560-4b0e-83b4-7ceea6e8088a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:46.312033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02b216-4560-4b0e-83b4-7ceea6e8088a admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:46.366719 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 976/1952] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:46 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:46.367306 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e357e-fcaf-4eac-a65d-5c6beda1b4e5 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:46.381990 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e357e-fcaf-4eac-a65d-5c6beda1b4e5 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:46.466353 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99fe69-ec4a-48fc-936d-f1745fcf7433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:46.467299 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99fe69-ec4a-48fc-936d-f1745fcf7433 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:46.467299 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99fe69-ec4a-48fc-936d-f1745fcf7433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:46.467511 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99fe69-ec4a-48fc-936d-f1745fcf7433 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:46.468174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99fe69-ec4a-48fc-936d-f1745fcf7433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:46.470997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99fe69-ec4a-48fc-936d-f1745fcf7433 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:46.503290 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 977/1953] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:46 2022] POST /identity/v3/users => generated 296 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:42:46.509485 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02b216-4560-4b0e-83b4-7ceea6e8088a admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:46.522030 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02b216-4560-4b0e-83b4-7ceea6e8088a admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:46.535392 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80916a51-5a77-46da-ad85-9eea2aa56a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:46.536091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80916a51-5a77-46da-ad85-9eea2aa56a4e admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:46.536442 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80916a51-5a77-46da-ad85-9eea2aa56a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:46.536718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80916a51-5a77-46da-ad85-9eea2aa56a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:46.537460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80916a51-5a77-46da-ad85-9eea2aa56a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:46.539319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80916a51-5a77-46da-ad85-9eea2aa56a4e admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:46.556829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 977/1954] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:46.560931 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99fe69-ec4a-48fc-936d-f1745fcf7433 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:46.578102 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99fe69-ec4a-48fc-936d-f1745fcf7433 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:46.589033 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2094f-3218-429e-b428-290f60a08c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:46.589818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2094f-3218-429e-b428-290f60a08c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:46.590203 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2094f-3218-429e-b428-290f60a08c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:46.590553 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2094f-3218-429e-b428-290f60a08c2c admin admin] PATH_INFO: `/v3/projects/112577e9fe4c4fd59079af73249a56cf/users/bacf3694659a4b8b81a9b4a2a1c21779/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:46.607694 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:46.624289 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2094f-3218-429e-b428-290f60a08c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=112577e9fe4c4fd59079af73249a56cf, user_id=bacf3694659a4b8b81a9b4a2a1c21779, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:46.628169 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2094f-3218-429e-b428-290f60a08c2c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:46.672534 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 978/1955] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:46 2022] PUT /identity/v3/projects/112577e9fe4c4fd59079af73249a56cf/users/bacf3694659a4b8b81a9b4a2a1c21779/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:42:46.677144 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80916a51-5a77-46da-ad85-9eea2aa56a4e admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:46.700856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80916a51-5a77-46da-ad85-9eea2aa56a4e admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:46.714005 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:46.829763 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7a4f1-2bf6-4e9b-a7c7-6999dc01df30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:46.830463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7a4f1-2bf6-4e9b-a7c7-6999dc01df30 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:46.830750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7a4f1-2bf6-4e9b-a7c7-6999dc01df30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:46.831023 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7a4f1-2bf6-4e9b-a7c7-6999dc01df30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:46.832611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7a4f1-2bf6-4e9b-a7c7-6999dc01df30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:46.834425 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7a4f1-2bf6-4e9b-a7c7-6999dc01df30 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:46.850063 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 978/1956] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:46.851457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2094f-3218-429e-b428-290f60a08c2c admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:46.863713 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2094f-3218-429e-b428-290f60a08c2c admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:46.869097 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6da5e-7778-4458-b5ec-d4a10e2019e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:46.869782 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6da5e-7778-4458-b5ec-d4a10e2019e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:46.870095 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6da5e-7778-4458-b5ec-d4a10e2019e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:46.870434 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6da5e-7778-4458-b5ec-d4a10e2019e3 admin admin] PATH_INFO: `/v3/projects/112577e9fe4c4fd59079af73249a56cf/users/bacf3694659a4b8b81a9b4a2a1c21779/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:46.872834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6da5e-7778-4458-b5ec-d4a10e2019e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=112577e9fe4c4fd59079af73249a56cf, user_id=bacf3694659a4b8b81a9b4a2a1c21779, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:46.878973 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6da5e-7778-4458-b5ec-d4a10e2019e3 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:46.900495 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 979/1957] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:46 2022] PUT /identity/v3/projects/112577e9fe4c4fd59079af73249a56cf/users/bacf3694659a4b8b81a9b4a2a1c21779/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:46.902221 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea63e4-391c-468b-b963-cf64ca1e0f44 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:46.902706 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea63e4-391c-468b-b963-cf64ca1e0f44 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:46.903087 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea63e4-391c-468b-b963-cf64ca1e0f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:46.935799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-dfea63e4-391c-468b-b963-cf64ca1e0f44 None None] MFA Rules not processed for user `bacf3694659a4b8b81a9b4a2a1c21779`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:46.937187 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-dfea63e4-391c-468b-b963-cf64ca1e0f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:47.015814 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 979/1958] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:47.029377 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6da5e-7778-4458-b5ec-d4a10e2019e3 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:47.031157 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b0e6da5e-7778-4458-b5ec-d4a10e2019e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:47.113261 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6da5e-7778-4458-b5ec-d4a10e2019e3 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:47.118953 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdacc77-729f-4b7a-a8b2-3ad42f0e3366 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:47.119727 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdacc77-729f-4b7a-a8b2-3ad42f0e3366 service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:47.120005 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdacc77-729f-4b7a-a8b2-3ad42f0e3366 service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:47.120270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdacc77-729f-4b7a-a8b2-3ad42f0e3366 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:47.131696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdacc77-729f-4b7a-a8b2-3ad42f0e3366 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:47.135589 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdacc77-729f-4b7a-a8b2-3ad42f0e3366 service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:47.147704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 980/1959] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:47.254260 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea63e4-391c-468b-b963-cf64ca1e0f44 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:47.265768 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea63e4-391c-468b-b963-cf64ca1e0f44 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:47.272457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553b30f-55e9-4dff-b11a-a94ffc770e41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:47.273086 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553b30f-55e9-4dff-b11a-a94ffc770e41 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:47.273360 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553b30f-55e9-4dff-b11a-a94ffc770e41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:47.273631 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553b30f-55e9-4dff-b11a-a94ffc770e41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:47.347382 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553b30f-55e9-4dff-b11a-a94ffc770e41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:47.348834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553b30f-55e9-4dff-b11a-a94ffc770e41 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:47.359694 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 980/1960] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:47.768682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdacc77-729f-4b7a-a8b2-3ad42f0e3366 service cinder] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:47.855372 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdacc77-729f-4b7a-a8b2-3ad42f0e3366 service cinder] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:47.871840 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe34c16-2d6e-43bf-b42f-4a36e6e4ff60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:47.872645 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe34c16-2d6e-43bf-b42f-4a36e6e4ff60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:47.872867 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe34c16-2d6e-43bf-b42f-4a36e6e4ff60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:47.873145 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe34c16-2d6e-43bf-b42f-4a36e6e4ff60 admin admin] PATH_INFO: `/v3/users/83f9f736bb2549848570d48c5cc62d48` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:47.874347 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe34c16-2d6e-43bf-b42f-4a36e6e4ff60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83f9f736bb2549848570d48c5cc62d48)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:47.882559 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe34c16-2d6e-43bf-b42f-4a36e6e4ff60 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:47.992152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-9fe34c16-2d6e-43bf-b42f-4a36e6e4ff60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83f9f736bb2549848570d48c5cc62d48'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:48.012322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-9fe34c16-2d6e-43bf-b42f-4a36e6e4ff60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83f9f736bb2549848570d48c5cc62d48'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:48.049983 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-9fe34c16-2d6e-43bf-b42f-4a36e6e4ff60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83f9f736bb2549848570d48c5cc62d48'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:48.051568 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-9fe34c16-2d6e-43bf-b42f-4a36e6e4ff60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83f9f736bb2549848570d48c5cc62d48'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:48.062224 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:48.068257 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-9fe34c16-2d6e-43bf-b42f-4a36e6e4ff60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83f9f736bb2549848570d48c5cc62d48'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:48.092346 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 981/1961] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:47 2022] DELETE /identity/v3/users/83f9f736bb2549848570d48c5cc62d48 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:42:48.104966 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a0318-5c62-467d-b999-d8a0e63d5c03 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:48.105423 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a0318-5c62-467d-b999-d8a0e63d5c03 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:48.105796 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a0318-5c62-467d-b999-d8a0e63d5c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:48.127962 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-360a0318-5c62-467d-b999-d8a0e63d5c03 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:48.130809 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-360a0318-5c62-467d-b999-d8a0e63d5c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:48.190672 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:48.240338 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 981/1962] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:48.253279 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe34c16-2d6e-43bf-b42f-4a36e6e4ff60 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:48.255098 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-9fe34c16-2d6e-43bf-b42f-4a36e6e4ff60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:48.465140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe34c16-2d6e-43bf-b42f-4a36e6e4ff60 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:48.469247 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0355f-42a1-49ae-a46b-e940e7cec7e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:48.473012 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0355f-42a1-49ae-a46b-e940e7cec7e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:48.473326 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0355f-42a1-49ae-a46b-e940e7cec7e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:48.473593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0355f-42a1-49ae-a46b-e940e7cec7e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:48.502206 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0355f-42a1-49ae-a46b-e940e7cec7e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:48.504219 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0355f-42a1-49ae-a46b-e940e7cec7e3 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:48.532563 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 982/1963] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:48.945613 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a0318-5c62-467d-b999-d8a0e63d5c03 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:48.947291 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-360a0318-5c62-467d-b999-d8a0e63d5c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:48.981751 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a0318-5c62-467d-b999-d8a0e63d5c03 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:48.988874 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db8b35-82c1-4769-be29-2f64a66d6902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:48.989530 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db8b35-82c1-4769-be29-2f64a66d6902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:48.989811 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db8b35-82c1-4769-be29-2f64a66d6902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:48.990121 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db8b35-82c1-4769-be29-2f64a66d6902 admin admin] PATH_INFO: `/v3/projects/c2e3f9a42928407aaac2f1d17cbb320e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:48.991281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db8b35-82c1-4769-be29-2f64a66d6902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2e3f9a42928407aaac2f1d17cbb320e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:48.993190 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db8b35-82c1-4769-be29-2f64a66d6902 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:49.050629 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-32db8b35-82c1-4769-be29-2f64a66d6902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2e3f9a42928407aaac2f1d17cbb320e', 'request_id': 'req-32db8b35-82c1-4769-be29-2f64a66d6902'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:49.059167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-32db8b35-82c1-4769-be29-2f64a66d6902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2e3f9a42928407aaac2f1d17cbb320e', 'request_id': 'req-32db8b35-82c1-4769-be29-2f64a66d6902'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:49.068523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-32db8b35-82c1-4769-be29-2f64a66d6902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2e3f9a42928407aaac2f1d17cbb320e', 'request_id': 'req-32db8b35-82c1-4769-be29-2f64a66d6902'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:49.083494 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-32db8b35-82c1-4769-be29-2f64a66d6902 admin admin] The token cache is being invalidate because project c2e3f9a42928407aaac2f1d17cbb320e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:49.083812 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-32db8b35-82c1-4769-be29-2f64a66d6902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:49.084447 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-32db8b35-82c1-4769-be29-2f64a66d6902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:49.085969 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 982/1964] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:48 2022] DELETE /identity/v3/projects/c2e3f9a42928407aaac2f1d17cbb320e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:49.090151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0355f-42a1-49ae-a46b-e940e7cec7e3 service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:49.100639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0355f-42a1-49ae-a46b-e940e7cec7e3 service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:49.179247 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669d6f1-af28-43c1-84f6-9db958fbc6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:49.180074 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669d6f1-af28-43c1-84f6-9db958fbc6a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:49.180430 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669d6f1-af28-43c1-84f6-9db958fbc6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:49.180772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669d6f1-af28-43c1-84f6-9db958fbc6a4 admin admin] PATH_INFO: `/v3/users/bacf3694659a4b8b81a9b4a2a1c21779` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:49.183434 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669d6f1-af28-43c1-84f6-9db958fbc6a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bacf3694659a4b8b81a9b4a2a1c21779)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:49.185773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669d6f1-af28-43c1-84f6-9db958fbc6a4 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:49.244700 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-4669d6f1-af28-43c1-84f6-9db958fbc6a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bacf3694659a4b8b81a9b4a2a1c21779'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:49.285930 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-4669d6f1-af28-43c1-84f6-9db958fbc6a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bacf3694659a4b8b81a9b4a2a1c21779'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:49.305274 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-4669d6f1-af28-43c1-84f6-9db958fbc6a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bacf3694659a4b8b81a9b4a2a1c21779'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:49.306344 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-4669d6f1-af28-43c1-84f6-9db958fbc6a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bacf3694659a4b8b81a9b4a2a1c21779'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:49.316612 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-4669d6f1-af28-43c1-84f6-9db958fbc6a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bacf3694659a4b8b81a9b4a2a1c21779'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:49.324807 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 983/1965] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:49 2022] DELETE /identity/v3/users/bacf3694659a4b8b81a9b4a2a1c21779 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:49.377817 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0eab7-80c2-4caf-9b95-ac359d6c0ce6 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:49.378215 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0eab7-80c2-4caf-9b95-ac359d6c0ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:49.378537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0eab7-80c2-4caf-9b95-ac359d6c0ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:49.443121 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-30a0eab7-80c2-4caf-9b95-ac359d6c0ce6 None None] MFA Rules not processed for user `df2faf19a5bd4030ab36271632fa3e44`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:49.451189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-30a0eab7-80c2-4caf-9b95-ac359d6c0ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:49.516497 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 983/1966] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:49.755880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669d6f1-af28-43c1-84f6-9db958fbc6a4 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:49.757348 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-4669d6f1-af28-43c1-84f6-9db958fbc6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:49.799972 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:49.855604 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669d6f1-af28-43c1-84f6-9db958fbc6a4 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:49.860700 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa103f-0cf7-4192-b65b-0d89d6dad88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:49.861382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa103f-0cf7-4192-b65b-0d89d6dad88b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:49.861799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa103f-0cf7-4192-b65b-0d89d6dad88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:49.862097 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa103f-0cf7-4192-b65b-0d89d6dad88b admin admin] PATH_INFO: `/v3/projects/112577e9fe4c4fd59079af73249a56cf` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:49.863323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa103f-0cf7-4192-b65b-0d89d6dad88b admin admin] RBAC: Authorizing `identity:delete_project(project_id=112577e9fe4c4fd59079af73249a56cf)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:49.865259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa103f-0cf7-4192-b65b-0d89d6dad88b admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:49.918514 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8dfa103f-0cf7-4192-b65b-0d89d6dad88b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '112577e9fe4c4fd59079af73249a56cf', 'request_id': 'req-8dfa103f-0cf7-4192-b65b-0d89d6dad88b'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:49.927651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8dfa103f-0cf7-4192-b65b-0d89d6dad88b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '112577e9fe4c4fd59079af73249a56cf', 'request_id': 'req-8dfa103f-0cf7-4192-b65b-0d89d6dad88b'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:49.935857 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8dfa103f-0cf7-4192-b65b-0d89d6dad88b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '112577e9fe4c4fd59079af73249a56cf', 'request_id': 'req-8dfa103f-0cf7-4192-b65b-0d89d6dad88b'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:49.948394 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8dfa103f-0cf7-4192-b65b-0d89d6dad88b admin admin] The token cache is being invalidate because project 112577e9fe4c4fd59079af73249a56cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:49.948690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8dfa103f-0cf7-4192-b65b-0d89d6dad88b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:49.949332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8dfa103f-0cf7-4192-b65b-0d89d6dad88b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:49.950843 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 984/1967] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:49 2022] DELETE /identity/v3/projects/112577e9fe4c4fd59079af73249a56cf => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:49.956327 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d66a0b-5127-45f1-86a1-e29ace6680c9 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:49.956816 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d66a0b-5127-45f1-86a1-e29ace6680c9 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:49.957012 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d66a0b-5127-45f1-86a1-e29ace6680c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:49.976953 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-46d66a0b-5127-45f1-86a1-e29ace6680c9 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:49.978215 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-46d66a0b-5127-45f1-86a1-e29ace6680c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:50.031160 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:50.043950 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 984/1968] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:50.051943 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb41237-f15b-4f88-afa4-7df51280c2c0 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:50.052231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb41237-f15b-4f88-afa4-7df51280c2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:50.052506 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb41237-f15b-4f88-afa4-7df51280c2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:50.073607 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-adb41237-f15b-4f88-afa4-7df51280c2c0 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:50.074883 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-adb41237-f15b-4f88-afa4-7df51280c2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:50.089044 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 985/1969] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:50.093355 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d66a0b-5127-45f1-86a1-e29ace6680c9 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:50.103894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d66a0b-5127-45f1-86a1-e29ace6680c9 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:50.108882 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47ae95-6101-45a5-bc1f-50f8b589acb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:50.109501 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47ae95-6101-45a5-bc1f-50f8b589acb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:50.109784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47ae95-6101-45a5-bc1f-50f8b589acb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:50.110732 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47ae95-6101-45a5-bc1f-50f8b589acb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:50.111447 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47ae95-6101-45a5-bc1f-50f8b589acb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:42:50.111725 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47ae95-6101-45a5-bc1f-50f8b589acb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:50.113339 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47ae95-6101-45a5-bc1f-50f8b589acb0 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:50.130267 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 985/1970] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:42:50.131398 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb41237-f15b-4f88-afa4-7df51280c2c0 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:50.140805 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb41237-f15b-4f88-afa4-7df51280c2c0 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:50.146786 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e866c-0b79-4587-a065-0029ef88923f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:50.147577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e866c-0b79-4587-a065-0029ef88923f admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:50.147778 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e866c-0b79-4587-a065-0029ef88923f admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:50.148144 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e866c-0b79-4587-a065-0029ef88923f admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:50.148827 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e866c-0b79-4587-a065-0029ef88923f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:50.151012 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e866c-0b79-4587-a065-0029ef88923f admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:50.207591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 986/1971] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:50 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:50.207915 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47ae95-6101-45a5-bc1f-50f8b589acb0 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:50.227066 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47ae95-6101-45a5-bc1f-50f8b589acb0 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:50.263934 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977da669-9cd4-4648-b420-592e97a150f5 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:50.264609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977da669-9cd4-4648-b420-592e97a150f5 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:50.264951 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977da669-9cd4-4648-b420-592e97a150f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:50.297097 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-977da669-9cd4-4648-b420-592e97a150f5 None None] MFA Rules not processed for user `a1bdbce1b3d047cfa5ddf72f902ecd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:50.298743 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-977da669-9cd4-4648-b420-592e97a150f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:50.340933 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af842d-6b22-4f65-b005-de8d6cc4ba44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:50.341919 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af842d-6b22-4f65-b005-de8d6cc4ba44 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:50.342073 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af842d-6b22-4f65-b005-de8d6cc4ba44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:50.342276 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af842d-6b22-4f65-b005-de8d6cc4ba44 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:50.342939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af842d-6b22-4f65-b005-de8d6cc4ba44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:50.344901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af842d-6b22-4f65-b005-de8d6cc4ba44 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:50.386303 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 986/1972] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:50 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:42:50.394175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af842d-6b22-4f65-b005-de8d6cc4ba44 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:50.404117 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 987/1973] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Oct 20 14:42:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:50.412314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af842d-6b22-4f65-b005-de8d6cc4ba44 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:50.417353 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e437f2-8411-4fe2-94da-cb2bdd168814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:50.418126 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e437f2-8411-4fe2-94da-cb2bdd168814 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:50.418319 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977da669-9cd4-4648-b420-592e97a150f5 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:50.418440 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e437f2-8411-4fe2-94da-cb2bdd168814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:50.418717 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e437f2-8411-4fe2-94da-cb2bdd168814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:50.419518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e437f2-8411-4fe2-94da-cb2bdd168814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:50.420842 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-977da669-9cd4-4648-b420-592e97a150f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:50.421373 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e437f2-8411-4fe2-94da-cb2bdd168814 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:50.441491 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 987/1974] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:50.445115 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e437f2-8411-4fe2-94da-cb2bdd168814 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:50.459107 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e437f2-8411-4fe2-94da-cb2bdd168814 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:50.464285 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:50.481257 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c8f3e-a77e-43cb-be3b-e85e529c3a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:50.482012 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c8f3e-a77e-43cb-be3b-e85e529c3a20 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:50.482369 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c8f3e-a77e-43cb-be3b-e85e529c3a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:50.482556 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c8f3e-a77e-43cb-be3b-e85e529c3a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:50.483208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c8f3e-a77e-43cb-be3b-e85e529c3a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:50.485064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c8f3e-a77e-43cb-be3b-e85e529c3a20 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:50.498861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 988/1975] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:50.504512 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c8f3e-a77e-43cb-be3b-e85e529c3a20 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:50.521325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c8f3e-a77e-43cb-be3b-e85e529c3a20 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:50.527665 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14449a66-fb22-4623-a316-65ac1abb1cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:50.528623 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14449a66-fb22-4623-a316-65ac1abb1cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:50.528969 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14449a66-fb22-4623-a316-65ac1abb1cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:50.529380 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14449a66-fb22-4623-a316-65ac1abb1cc2 admin admin] PATH_INFO: `/v3/projects/3dfb75c0283448fe8871cc25e0ca2452/users/bf8a363891cd42edbd9523a1473bba47/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:50.540463 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977da669-9cd4-4648-b420-592e97a150f5 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:50.551526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14449a66-fb22-4623-a316-65ac1abb1cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dfb75c0283448fe8871cc25e0ca2452, user_id=bf8a363891cd42edbd9523a1473bba47, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:50.554556 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14449a66-fb22-4623-a316-65ac1abb1cc2 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:50.559953 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8386eb1-d146-4658-98fe-6d6dfc9e0a78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60d62d14cd4042ab1bff5509e30f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:50.560910 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8386eb1-d146-4658-98fe-6d6dfc9e0a78 service swift] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:50.561366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8386eb1-d146-4658-98fe-6d6dfc9e0a78 service swift] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:50.561739 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8386eb1-d146-4658-98fe-6d6dfc9e0a78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:50.574780 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8386eb1-d146-4658-98fe-6d6dfc9e0a78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:50.575647 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 989/1976] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:50 2022] PUT /identity/v3/projects/3dfb75c0283448fe8871cc25e0ca2452/users/bf8a363891cd42edbd9523a1473bba47/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:42:50.576769 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8386eb1-d146-4658-98fe-6d6dfc9e0a78 service swift] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:50.586357 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3032b-efa2-4fea-8924-0800231dc75a None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:50.586939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3032b-efa2-4fea-8924-0800231dc75a None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:50.587294 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3032b-efa2-4fea-8924-0800231dc75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:50.594018 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 988/1977] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Oct 20 14:42:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 20 14:42:50.640282 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-fcb3032b-efa2-4fea-8924-0800231dc75a None None] MFA Rules not processed for user `bf8a363891cd42edbd9523a1473bba47`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:50.641907 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-fcb3032b-efa2-4fea-8924-0800231dc75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:50.791515 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 990/1978] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:50.796119 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8386eb1-d146-4658-98fe-6d6dfc9e0a78 service swift] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:50.810549 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8386eb1-d146-4658-98fe-6d6dfc9e0a78 service swift] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:50.953512 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f00bda-436a-4d13-8abc-56261b9a239b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:50.954590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f00bda-436a-4d13-8abc-56261b9a239b admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:50.957552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f00bda-436a-4d13-8abc-56261b9a239b admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:50.958072 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f00bda-436a-4d13-8abc-56261b9a239b admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:50.958797 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f00bda-436a-4d13-8abc-56261b9a239b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:50.961225 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f00bda-436a-4d13-8abc-56261b9a239b admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:51.014714 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 989/1979] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:50 2022] POST /identity/v3/projects => generated 385 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:51.017603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3032b-efa2-4fea-8924-0800231dc75a None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:51.040902 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3032b-efa2-4fea-8924-0800231dc75a None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:51.064353 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:51.146830 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744a6bf-ed08-4628-89c2-a037c07717ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:51.147770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744a6bf-ed08-4628-89c2-a037c07717ee admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:51.148256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744a6bf-ed08-4628-89c2-a037c07717ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:51.148533 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744a6bf-ed08-4628-89c2-a037c07717ee admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:51.149191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744a6bf-ed08-4628-89c2-a037c07717ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:51.166068 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744a6bf-ed08-4628-89c2-a037c07717ee admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:51.193089 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 991/1980] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:51 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:42:51.197107 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f00bda-436a-4d13-8abc-56261b9a239b admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:51.217256 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f00bda-436a-4d13-8abc-56261b9a239b admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:51.237775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5214ca-2d66-499c-859a-cede0db3f79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:51.238447 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5214ca-2d66-499c-859a-cede0db3f79c admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:51.238889 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5214ca-2d66-499c-859a-cede0db3f79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:51.239339 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5214ca-2d66-499c-859a-cede0db3f79c admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:51.240150 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5214ca-2d66-499c-859a-cede0db3f79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:51.241957 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5214ca-2d66-499c-859a-cede0db3f79c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:51.271001 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 990/1981] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:51.279137 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744a6bf-ed08-4628-89c2-a037c07717ee admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:51.300428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744a6bf-ed08-4628-89c2-a037c07717ee admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:51.307990 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f022555-44e6-41ce-a4f8-edb0d860e337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:51.308831 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f022555-44e6-41ce-a4f8-edb0d860e337 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:51.309125 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f022555-44e6-41ce-a4f8-edb0d860e337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:51.309369 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f022555-44e6-41ce-a4f8-edb0d860e337 admin admin] PATH_INFO: `/v3/projects/938359796880401cb08512b5a74e3851/users/e8ae4ea6d1f74f098aabe46344ad95e9/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:51.336353 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f022555-44e6-41ce-a4f8-edb0d860e337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=938359796880401cb08512b5a74e3851, user_id=e8ae4ea6d1f74f098aabe46344ad95e9, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:51.341060 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f022555-44e6-41ce-a4f8-edb0d860e337 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:51.371063 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 992/1982] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:51 2022] PUT /identity/v3/projects/938359796880401cb08512b5a74e3851/users/e8ae4ea6d1f74f098aabe46344ad95e9/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:51.372964 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5214ca-2d66-499c-859a-cede0db3f79c admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:51.387121 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5214ca-2d66-499c-859a-cede0db3f79c admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:51.496494 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed1ff5-20e6-406d-b44d-4bb3043a0652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:51.497234 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed1ff5-20e6-406d-b44d-4bb3043a0652 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:51.497659 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed1ff5-20e6-406d-b44d-4bb3043a0652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:51.497973 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed1ff5-20e6-406d-b44d-4bb3043a0652 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:51.498688 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed1ff5-20e6-406d-b44d-4bb3043a0652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:51.501775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed1ff5-20e6-406d-b44d-4bb3043a0652 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:51.514723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 991/1983] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:51.519620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f022555-44e6-41ce-a4f8-edb0d860e337 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:51.537268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed1ff5-20e6-406d-b44d-4bb3043a0652 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:51.541520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-9eed1ff5-20e6-406d-b44d-4bb3043a0652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:51.546451 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f022555-44e6-41ce-a4f8-edb0d860e337 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:51.556966 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed1ff5-20e6-406d-b44d-4bb3043a0652 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:51.557896 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5855a-2145-42df-bdbc-af7602d7663d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:51.559144 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5855a-2145-42df-bdbc-af7602d7663d admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:51.559743 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5855a-2145-42df-bdbc-af7602d7663d admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:51.560028 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5855a-2145-42df-bdbc-af7602d7663d admin admin] PATH_INFO: `/v3/projects/938359796880401cb08512b5a74e3851/users/e8ae4ea6d1f74f098aabe46344ad95e9/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:51.564330 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5855a-2145-42df-bdbc-af7602d7663d admin admin] RBAC: Authorizing `identity:create_grant(project_id=938359796880401cb08512b5a74e3851, user_id=e8ae4ea6d1f74f098aabe46344ad95e9, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:51.566668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6849f09-8f96-4a31-bef7-2323bb393def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:51.567592 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6849f09-8f96-4a31-bef7-2323bb393def admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:51.568052 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6849f09-8f96-4a31-bef7-2323bb393def admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:51.568563 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6849f09-8f96-4a31-bef7-2323bb393def admin admin] PATH_INFO: `/v3/users/b60f8f6c092843c3aafdbe02f15221e4` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:51.569196 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5855a-2145-42df-bdbc-af7602d7663d admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:51.570620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6849f09-8f96-4a31-bef7-2323bb393def admin admin] RBAC: Authorizing `identity:delete_user(user_id=b60f8f6c092843c3aafdbe02f15221e4)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:51.572989 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6849f09-8f96-4a31-bef7-2323bb393def admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:51.591350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 993/1984] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:51 2022] PUT /identity/v3/projects/938359796880401cb08512b5a74e3851/users/e8ae4ea6d1f74f098aabe46344ad95e9/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:51.604224 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdace6d8-f6f3-460a-986f-2ca12e3bb101 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:51.604510 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdace6d8-f6f3-460a-986f-2ca12e3bb101 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:51.604810 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdace6d8-f6f3-460a-986f-2ca12e3bb101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:51.617276 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:51.645670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-fdace6d8-f6f3-460a-986f-2ca12e3bb101 None None] MFA Rules not processed for user `e8ae4ea6d1f74f098aabe46344ad95e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:51.649506 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-fdace6d8-f6f3-460a-986f-2ca12e3bb101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:51.673349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e6849f09-8f96-4a31-bef7-2323bb393def admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b60f8f6c092843c3aafdbe02f15221e4'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:51.693383 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e6849f09-8f96-4a31-bef7-2323bb393def admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b60f8f6c092843c3aafdbe02f15221e4'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:51.719632 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e6849f09-8f96-4a31-bef7-2323bb393def admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b60f8f6c092843c3aafdbe02f15221e4'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:51.723117 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e6849f09-8f96-4a31-bef7-2323bb393def admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b60f8f6c092843c3aafdbe02f15221e4'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:51.739820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e6849f09-8f96-4a31-bef7-2323bb393def admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b60f8f6c092843c3aafdbe02f15221e4'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:51.757207 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 994/1985] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:51.761918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 992/1986] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:42:51 2022] DELETE /identity/v3/users/b60f8f6c092843c3aafdbe02f15221e4 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:42:51.763670 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c34ee5-cf2b-4350-9f6f-1246df4738a1 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:51.764023 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c34ee5-cf2b-4350-9f6f-1246df4738a1 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:51.764391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c34ee5-cf2b-4350-9f6f-1246df4738a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:51.789180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdace6d8-f6f3-460a-986f-2ca12e3bb101 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:51.790812 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-fdace6d8-f6f3-460a-986f-2ca12e3bb101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:51.795256 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-f7c34ee5-cf2b-4350-9f6f-1246df4738a1 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:51.796691 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-f7c34ee5-cf2b-4350-9f6f-1246df4738a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:51.889213 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdace6d8-f6f3-460a-986f-2ca12e3bb101 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:51.901622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:51.918484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 993/1987] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:51.929203 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c34ee5-cf2b-4350-9f6f-1246df4738a1 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:51.932576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-f7c34ee5-cf2b-4350-9f6f-1246df4738a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:52.026678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9faac-8943-4282-89c3-81c64e869eaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:52.027769 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9faac-8943-4282-89c3-81c64e869eaf service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:52.028122 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9faac-8943-4282-89c3-81c64e869eaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:52.028471 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9faac-8943-4282-89c3-81c64e869eaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:52.034671 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-60c9faac-8943-4282-89c3-81c64e869eaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:52.036428 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c34ee5-cf2b-4350-9f6f-1246df4738a1 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:52.040737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e7110-afb7-4674-a141-7c4ea8d0c24c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:52.041789 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e7110-afb7-4674-a141-7c4ea8d0c24c service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:52.042357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e7110-afb7-4674-a141-7c4ea8d0c24c service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:52.042859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e7110-afb7-4674-a141-7c4ea8d0c24c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:52.083673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e7110-afb7-4674-a141-7c4ea8d0c24c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:52.089549 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e7110-afb7-4674-a141-7c4ea8d0c24c service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:52.114958 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 994/1988] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:52.131013 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9faac-8943-4282-89c3-81c64e869eaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:52.133020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9faac-8943-4282-89c3-81c64e869eaf service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:52.150084 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 995/1989] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:42:52.720254 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e7110-afb7-4674-a141-7c4ea8d0c24c service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:52.721833 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ee0e7110-afb7-4674-a141-7c4ea8d0c24c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:52.747107 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e7110-afb7-4674-a141-7c4ea8d0c24c service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:52.758622 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffa8b1-d572-4248-8988-81e57cde726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:52.760527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffa8b1-d572-4248-8988-81e57cde726f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:52.760835 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffa8b1-d572-4248-8988-81e57cde726f admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:52.761135 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffa8b1-d572-4248-8988-81e57cde726f admin admin] PATH_INFO: `/v3/projects/897a3c9a55594ae999a6d991bb517d08` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:52.782278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffa8b1-d572-4248-8988-81e57cde726f admin admin] RBAC: Authorizing `identity:delete_project(project_id=897a3c9a55594ae999a6d991bb517d08)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:52.789658 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffa8b1-d572-4248-8988-81e57cde726f admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:52.969230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:53.022816 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-21ffa8b1-d572-4248-8988-81e57cde726f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '897a3c9a55594ae999a6d991bb517d08', 'request_id': 'req-21ffa8b1-d572-4248-8988-81e57cde726f'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:53.040284 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-21ffa8b1-d572-4248-8988-81e57cde726f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '897a3c9a55594ae999a6d991bb517d08', 'request_id': 'req-21ffa8b1-d572-4248-8988-81e57cde726f'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:53.066121 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-21ffa8b1-d572-4248-8988-81e57cde726f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '897a3c9a55594ae999a6d991bb517d08', 'request_id': 'req-21ffa8b1-d572-4248-8988-81e57cde726f'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:53.119002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-21ffa8b1-d572-4248-8988-81e57cde726f admin admin] The token cache is being invalidate because project 897a3c9a55594ae999a6d991bb517d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:42:53.119002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-21ffa8b1-d572-4248-8988-81e57cde726f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:53.119669 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-21ffa8b1-d572-4248-8988-81e57cde726f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:42:53.122602 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 995/1990] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:42:52 2022] DELETE /identity/v3/projects/897a3c9a55594ae999a6d991bb517d08 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:53.128999 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0435651-9a34-4518-abf7-bcf000537a30 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:53.130172 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0435651-9a34-4518-abf7-bcf000537a30 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:53.130677 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0435651-9a34-4518-abf7-bcf000537a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:53.180210 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-c0435651-9a34-4518-abf7-bcf000537a30 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:53.181702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-c0435651-9a34-4518-abf7-bcf000537a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:53.322262 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 996/1991] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:42:53.331110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d68369-ab95-4245-950f-25bc4ea582ac None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:53.331392 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d68369-ab95-4245-950f-25bc4ea582ac None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:53.331716 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d68369-ab95-4245-950f-25bc4ea582ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:53.355995 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-a9d68369-ab95-4245-950f-25bc4ea582ac None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:53.358179 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a9d68369-ab95-4245-950f-25bc4ea582ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:53.367123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 996/1992] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:53.371576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0435651-9a34-4518-abf7-bcf000537a30 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:53.384383 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0435651-9a34-4518-abf7-bcf000537a30 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:53.395060 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cdf95-b5f3-4845-bddc-1615d2f84a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:53.395957 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cdf95-b5f3-4845-bddc-1615d2f84a72 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:53.396397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cdf95-b5f3-4845-bddc-1615d2f84a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:53.396794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cdf95-b5f3-4845-bddc-1615d2f84a72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:53.400314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cdf95-b5f3-4845-bddc-1615d2f84a72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:42:53.400828 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cdf95-b5f3-4845-bddc-1615d2f84a72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:53.402680 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cdf95-b5f3-4845-bddc-1615d2f84a72 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:53.417964 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 997/1993] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:42:53.423189 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d68369-ab95-4245-950f-25bc4ea582ac None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:53.432648 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d68369-ab95-4245-950f-25bc4ea582ac None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:53.438459 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6aaf1-4ad9-4e01-a645-28cfde8aaf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:53.439437 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6aaf1-4ad9-4e01-a645-28cfde8aaf0c admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:53.439715 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6aaf1-4ad9-4e01-a645-28cfde8aaf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:53.439991 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6aaf1-4ad9-4e01-a645-28cfde8aaf0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:53.440651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6aaf1-4ad9-4e01-a645-28cfde8aaf0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:53.443089 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6aaf1-4ad9-4e01-a645-28cfde8aaf0c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:53.502560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 997/1994] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:42:53 2022] POST /identity/v3/projects => generated 379 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:42:53.506701 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cdf95-b5f3-4845-bddc-1615d2f84a72 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:53.519382 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cdf95-b5f3-4845-bddc-1615d2f84a72 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:53.597147 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:53.617062 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5f537-1713-4d43-80d6-a73383c4ca3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:53.617686 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5f537-1713-4d43-80d6-a73383c4ca3a admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:53.618013 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5f537-1713-4d43-80d6-a73383c4ca3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:53.618448 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5f537-1713-4d43-80d6-a73383c4ca3a admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:53.621493 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5f537-1713-4d43-80d6-a73383c4ca3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:53.629607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5f537-1713-4d43-80d6-a73383c4ca3a admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:53.661390 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 998/1995] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:42:53 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:42:53.665634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6aaf1-4ad9-4e01-a645-28cfde8aaf0c admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:53.681556 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6aaf1-4ad9-4e01-a645-28cfde8aaf0c admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:53.689633 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b749c0c-ae9d-4194-91b2-da4d0434bb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:53.690870 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b749c0c-ae9d-4194-91b2-da4d0434bb1f admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:53.691274 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b749c0c-ae9d-4194-91b2-da4d0434bb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:53.691516 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b749c0c-ae9d-4194-91b2-da4d0434bb1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:53.692214 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b749c0c-ae9d-4194-91b2-da4d0434bb1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:53.694127 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b749c0c-ae9d-4194-91b2-da4d0434bb1f admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:53.708238 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 998/1996] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:53.713293 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5f537-1713-4d43-80d6-a73383c4ca3a admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:53.728693 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5f537-1713-4d43-80d6-a73383c4ca3a admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:53.734438 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a610d3e-3dd2-408e-849c-9b6ba94638ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:53.735869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a610d3e-3dd2-408e-849c-9b6ba94638ad admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:53.736331 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a610d3e-3dd2-408e-849c-9b6ba94638ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:53.736901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a610d3e-3dd2-408e-849c-9b6ba94638ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:53.737729 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a610d3e-3dd2-408e-849c-9b6ba94638ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:53.740443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a610d3e-3dd2-408e-849c-9b6ba94638ad admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:53.756618 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 999/1997] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:42:53.761712 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b749c0c-ae9d-4194-91b2-da4d0434bb1f admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:53.792231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b749c0c-ae9d-4194-91b2-da4d0434bb1f admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:53.802570 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cfae6-d375-4012-b6bd-d5c50a404f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:53.803567 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cfae6-d375-4012-b6bd-d5c50a404f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:53.804093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cfae6-d375-4012-b6bd-d5c50a404f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:53.804554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cfae6-d375-4012-b6bd-d5c50a404f3a admin admin] PATH_INFO: `/v3/projects/e9a8a9257a0d455cb2480dabd2ce8ea2/users/6445476af9cc4a8cae816cae680c2b1c/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:53.835164 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711cfae6-d375-4012-b6bd-d5c50a404f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a8a9257a0d455cb2480dabd2ce8ea2, user_id=6445476af9cc4a8cae816cae680c2b1c, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:53.838069 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711cfae6-d375-4012-b6bd-d5c50a404f3a admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:53.858507 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 999/1998] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:42:53 2022] PUT /identity/v3/projects/e9a8a9257a0d455cb2480dabd2ce8ea2/users/6445476af9cc4a8cae816cae680c2b1c/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:42:53.864044 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa6340-89b2-44fd-9105-059233c1e354 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:53.864957 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa6340-89b2-44fd-9105-059233c1e354 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:53.864957 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa6340-89b2-44fd-9105-059233c1e354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:53.889258 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-d4fa6340-89b2-44fd-9105-059233c1e354 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:53.891035 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d4fa6340-89b2-44fd-9105-059233c1e354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:54.026908 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1000/1999] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:54.044472 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cfae6-d375-4012-b6bd-d5c50a404f3a admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:54.047784 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-711cfae6-d375-4012-b6bd-d5c50a404f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:54.225182 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cfae6-d375-4012-b6bd-d5c50a404f3a admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:54.236413 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea8adf-c9eb-4a22-9fec-8a8fec63525d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:54.237593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea8adf-c9eb-4a22-9fec-8a8fec63525d service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:54.238356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea8adf-c9eb-4a22-9fec-8a8fec63525d service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:54.238643 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea8adf-c9eb-4a22-9fec-8a8fec63525d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:54.254234 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea8adf-c9eb-4a22-9fec-8a8fec63525d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:54.255699 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea8adf-c9eb-4a22-9fec-8a8fec63525d service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:54.285128 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1000/2000] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:56.539536 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5a2c2-2009-47a4-9ae2-32f39f21a810 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:56.540094 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5a2c2-2009-47a4-9ae2-32f39f21a810 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:56.540094 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5a2c2-2009-47a4-9ae2-32f39f21a810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:56.597734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-b4d5a2c2-2009-47a4-9ae2-32f39f21a810 None None] MFA Rules not processed for user `6445476af9cc4a8cae816cae680c2b1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:56.599108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-b4d5a2c2-2009-47a4-9ae2-32f39f21a810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:56.826669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1001/2001] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:56.851602 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea8adf-c9eb-4a22-9fec-8a8fec63525d service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:56.854009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-10ea8adf-c9eb-4a22-9fec-8a8fec63525d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:56.951184 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea8adf-c9eb-4a22-9fec-8a8fec63525d service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:56.955749 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373c4b0-b4c3-4c23-ae2d-c7db3eb8bd17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:56.956235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373c4b0-b4c3-4c23-ae2d-c7db3eb8bd17 service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:56.956648 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373c4b0-b4c3-4c23-ae2d-c7db3eb8bd17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:56.969469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373c4b0-b4c3-4c23-ae2d-c7db3eb8bd17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:56.990975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373c4b0-b4c3-4c23-ae2d-c7db3eb8bd17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:56.992461 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373c4b0-b4c3-4c23-ae2d-c7db3eb8bd17 service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:57.014094 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1001/2002] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:42:57.730098 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ceb1ae-3799-4875-af95-e03d90b363b2 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:57.730651 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ceb1ae-3799-4875-af95-e03d90b363b2 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:57.730920 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ceb1ae-3799-4875-af95-e03d90b363b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:57.768819 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-96ceb1ae-3799-4875-af95-e03d90b363b2 None None] MFA Rules not processed for user `a1bdbce1b3d047cfa5ddf72f902ecd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:57.770222 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-96ceb1ae-3799-4875-af95-e03d90b363b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:57.861496 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1002/2003] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Oct 20 14:42:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:42:57.885333 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373c4b0-b4c3-4c23-ae2d-c7db3eb8bd17 service cinder] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:57.891649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-0373c4b0-b4c3-4c23-ae2d-c7db3eb8bd17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:57.908455 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:58.070892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373c4b0-b4c3-4c23-ae2d-c7db3eb8bd17 service cinder] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:58.077766 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e60dba-5634-42a1-95e7-69a218e19275 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60d62d14cd4042ab1bff5509e30f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:58.079364 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e60dba-5634-42a1-95e7-69a218e19275 service swift] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:58.079819 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e60dba-5634-42a1-95e7-69a218e19275 service swift] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:58.080233 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e60dba-5634-42a1-95e7-69a218e19275 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:58.090581 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e60dba-5634-42a1-95e7-69a218e19275 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:58.091041 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ceb1ae-3799-4875-af95-e03d90b363b2 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:42:58.092417 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e60dba-5634-42a1-95e7-69a218e19275 service swift] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:58.093242 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-96ceb1ae-3799-4875-af95-e03d90b363b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:58.105746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ceb1ae-3799-4875-af95-e03d90b363b2 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:42:58.109738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d410e-c9c7-48c2-8c92-ea33d59af612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:42:58.110596 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d410e-c9c7-48c2-8c92-ea33d59af612 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:58.110720 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1002/2004] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Oct 20 14:42:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 14:42:58.111168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d410e-c9c7-48c2-8c92-ea33d59af612 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:58.111467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d410e-c9c7-48c2-8c92-ea33d59af612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:58.116333 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-449d410e-c9c7-48c2-8c92-ea33d59af612 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:58.122459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:58.223182 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d410e-c9c7-48c2-8c92-ea33d59af612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:42:58.226705 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d410e-c9c7-48c2-8c92-ea33d59af612 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:42:58.258128 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1003/2005] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:42:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:42:58.675519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36541645-9a29-40ed-8217-3a28cc815cac None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:42:58.676562 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36541645-9a29-40ed-8217-3a28cc815cac None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:42:58.677116 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36541645-9a29-40ed-8217-3a28cc815cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:42:58.783028 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-36541645-9a29-40ed-8217-3a28cc815cac None None] MFA Rules not processed for user `6445476af9cc4a8cae816cae680c2b1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:42:58.790751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-36541645-9a29-40ed-8217-3a28cc815cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:42:58.831697 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1003/2006] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:42:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:43:04.375152 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d410e-c9c7-48c2-8c92-ea33d59af612 service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:04.377085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-449d410e-c9c7-48c2-8c92-ea33d59af612 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:04.409998 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d410e-c9c7-48c2-8c92-ea33d59af612 service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:04.415201 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab6abb-7eb3-4cb0-8bec-15245f87c1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:04.415940 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab6abb-7eb3-4cb0-8bec-15245f87c1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:04.416293 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab6abb-7eb3-4cb0-8bec-15245f87c1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:04.416644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab6abb-7eb3-4cb0-8bec-15245f87c1f4 admin admin] PATH_INFO: `/v3/users/bf8a363891cd42edbd9523a1473bba47` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:04.418406 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab6abb-7eb3-4cb0-8bec-15245f87c1f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf8a363891cd42edbd9523a1473bba47)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:04.420939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab6abb-7eb3-4cb0-8bec-15245f87c1f4 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:04.501337 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-c0ab6abb-7eb3-4cb0-8bec-15245f87c1f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf8a363891cd42edbd9523a1473bba47'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:04.513574 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-c0ab6abb-7eb3-4cb0-8bec-15245f87c1f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf8a363891cd42edbd9523a1473bba47'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:04.514902 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-c0ab6abb-7eb3-4cb0-8bec-15245f87c1f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf8a363891cd42edbd9523a1473bba47'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:04.516825 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-c0ab6abb-7eb3-4cb0-8bec-15245f87c1f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf8a363891cd42edbd9523a1473bba47'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:04.532548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-c0ab6abb-7eb3-4cb0-8bec-15245f87c1f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf8a363891cd42edbd9523a1473bba47'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:04.558102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1004/2007] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:43:04 2022] DELETE /identity/v3/users/bf8a363891cd42edbd9523a1473bba47 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:43:04.563627 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddb8f0-37cb-4aba-adc8-7bd23123a99e None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:04.564789 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddb8f0-37cb-4aba-adc8-7bd23123a99e None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:04.565353 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddb8f0-37cb-4aba-adc8-7bd23123a99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:04.601295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-2cddb8f0-37cb-4aba-adc8-7bd23123a99e None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:43:04.603050 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2cddb8f0-37cb-4aba-adc8-7bd23123a99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:04.718176 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1004/2008] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:43:04.729065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab6abb-7eb3-4cb0-8bec-15245f87c1f4 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:04.730975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-c0ab6abb-7eb3-4cb0-8bec-15245f87c1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:04.868289 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab6abb-7eb3-4cb0-8bec-15245f87c1f4 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:04.877826 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede35605-6d3c-4ed8-9a61-54189b110ff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:04.878561 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede35605-6d3c-4ed8-9a61-54189b110ff3 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:04.878844 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede35605-6d3c-4ed8-9a61-54189b110ff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:04.879121 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede35605-6d3c-4ed8-9a61-54189b110ff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:04.904232 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede35605-6d3c-4ed8-9a61-54189b110ff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:04.905695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede35605-6d3c-4ed8-9a61-54189b110ff3 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:04.945457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1005/2009] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:43:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:43:05.841453 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddb8f0-37cb-4aba-adc8-7bd23123a99e None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:05.844147 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2cddb8f0-37cb-4aba-adc8-7bd23123a99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:05.866272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddb8f0-37cb-4aba-adc8-7bd23123a99e None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:05.871780 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57eabc-e099-4a56-8406-f11b4486efd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:05.872456 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57eabc-e099-4a56-8406-f11b4486efd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:05.872733 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57eabc-e099-4a56-8406-f11b4486efd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:05.873003 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57eabc-e099-4a56-8406-f11b4486efd7 admin admin] PATH_INFO: `/v3/projects/3dfb75c0283448fe8871cc25e0ca2452` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:05.874635 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57eabc-e099-4a56-8406-f11b4486efd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dfb75c0283448fe8871cc25e0ca2452)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:05.879501 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57eabc-e099-4a56-8406-f11b4486efd7 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:05.982483 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fe57eabc-e099-4a56-8406-f11b4486efd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dfb75c0283448fe8871cc25e0ca2452', 'request_id': 'req-fe57eabc-e099-4a56-8406-f11b4486efd7'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:05.998577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fe57eabc-e099-4a56-8406-f11b4486efd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dfb75c0283448fe8871cc25e0ca2452', 'request_id': 'req-fe57eabc-e099-4a56-8406-f11b4486efd7'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:06.019739 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fe57eabc-e099-4a56-8406-f11b4486efd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dfb75c0283448fe8871cc25e0ca2452', 'request_id': 'req-fe57eabc-e099-4a56-8406-f11b4486efd7'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:06.054283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fe57eabc-e099-4a56-8406-f11b4486efd7 admin admin] The token cache is being invalidate because project 3dfb75c0283448fe8871cc25e0ca2452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:43:06.054652 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fe57eabc-e099-4a56-8406-f11b4486efd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:06.055364 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-fe57eabc-e099-4a56-8406-f11b4486efd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:06.060074 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1005/2010] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:43:05 2022] DELETE /identity/v3/projects/3dfb75c0283448fe8871cc25e0ca2452 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:43:06.062619 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede35605-6d3c-4ed8-9a61-54189b110ff3 service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:06.075094 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede35605-6d3c-4ed8-9a61-54189b110ff3 service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:06.106514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:06.239137 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b12b41-5150-4703-ab72-20d701b0ee1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:06.241171 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b12b41-5150-4703-ab72-20d701b0ee1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:06.241445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b12b41-5150-4703-ab72-20d701b0ee1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:06.243847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b12b41-5150-4703-ab72-20d701b0ee1d admin admin] PATH_INFO: `/v3/users/e8ae4ea6d1f74f098aabe46344ad95e9` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:06.249876 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b12b41-5150-4703-ab72-20d701b0ee1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8ae4ea6d1f74f098aabe46344ad95e9)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:06.254877 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b12b41-5150-4703-ab72-20d701b0ee1d admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:06.356894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-66b12b41-5150-4703-ab72-20d701b0ee1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8ae4ea6d1f74f098aabe46344ad95e9'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:06.376664 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-66b12b41-5150-4703-ab72-20d701b0ee1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8ae4ea6d1f74f098aabe46344ad95e9'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:06.377425 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-66b12b41-5150-4703-ab72-20d701b0ee1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8ae4ea6d1f74f098aabe46344ad95e9'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:06.379011 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-66b12b41-5150-4703-ab72-20d701b0ee1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8ae4ea6d1f74f098aabe46344ad95e9'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:06.391621 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-66b12b41-5150-4703-ab72-20d701b0ee1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8ae4ea6d1f74f098aabe46344ad95e9'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:06.469555 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1006/2011] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:43:06 2022] DELETE /identity/v3/users/e8ae4ea6d1f74f098aabe46344ad95e9 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:43:07.007455 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57eabc-e099-4a56-8406-f11b4486efd7 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:07.008909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-fe57eabc-e099-4a56-8406-f11b4486efd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:07.035554 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57eabc-e099-4a56-8406-f11b4486efd7 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:07.065018 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:07.240621 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180f8dd-3ea7-49da-abb1-5476021e6011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:07.247853 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180f8dd-3ea7-49da-abb1-5476021e6011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:07.247853 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180f8dd-3ea7-49da-abb1-5476021e6011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:07.248460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180f8dd-3ea7-49da-abb1-5476021e6011 admin admin] PATH_INFO: `/v3/projects/938359796880401cb08512b5a74e3851` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:07.252845 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180f8dd-3ea7-49da-abb1-5476021e6011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=938359796880401cb08512b5a74e3851)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:07.257834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180f8dd-3ea7-49da-abb1-5476021e6011 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:07.487895 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-9180f8dd-3ea7-49da-abb1-5476021e6011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938359796880401cb08512b5a74e3851', 'request_id': 'req-9180f8dd-3ea7-49da-abb1-5476021e6011'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:07.514486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-9180f8dd-3ea7-49da-abb1-5476021e6011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938359796880401cb08512b5a74e3851', 'request_id': 'req-9180f8dd-3ea7-49da-abb1-5476021e6011'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:07.525882 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-9180f8dd-3ea7-49da-abb1-5476021e6011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938359796880401cb08512b5a74e3851', 'request_id': 'req-9180f8dd-3ea7-49da-abb1-5476021e6011'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:07.548920 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-9180f8dd-3ea7-49da-abb1-5476021e6011 admin admin] The token cache is being invalidate because project 938359796880401cb08512b5a74e3851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:43:07.549174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-9180f8dd-3ea7-49da-abb1-5476021e6011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:07.550152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-9180f8dd-3ea7-49da-abb1-5476021e6011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:07.552188 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1006/2012] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:43:07 2022] DELETE /identity/v3/projects/938359796880401cb08512b5a74e3851 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:43:11.035439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe44ea-960d-4226-ae37-ccd726901d50 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:11.036670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe44ea-960d-4226-ae37-ccd726901d50 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:11.037201 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe44ea-960d-4226-ae37-ccd726901d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:11.111638 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-3bfe44ea-960d-4226-ae37-ccd726901d50 None None] MFA Rules not processed for user `a1bdbce1b3d047cfa5ddf72f902ecd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:43:11.112896 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-3bfe44ea-960d-4226-ae37-ccd726901d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:11.226159 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1007/2013] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Oct 20 14:43:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:43:11.249672 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180f8dd-3ea7-49da-abb1-5476021e6011 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:11.251369 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-9180f8dd-3ea7-49da-abb1-5476021e6011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:11.348652 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180f8dd-3ea7-49da-abb1-5476021e6011 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:11.354888 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0da10-9be9-42f4-b624-715f09cc970a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60d62d14cd4042ab1bff5509e30f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:11.356302 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0da10-9be9-42f4-b624-715f09cc970a service swift] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:11.357020 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0da10-9be9-42f4-b624-715f09cc970a service swift] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:11.357602 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0da10-9be9-42f4-b624-715f09cc970a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:11.368309 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0da10-9be9-42f4-b624-715f09cc970a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:11.371108 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0da10-9be9-42f4-b624-715f09cc970a service swift] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:11.382067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1007/2014] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Oct 20 14:43:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 14:43:16.220758 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c72c1d-eb4c-456b-af4e-0b9179797054 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:16.221370 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c72c1d-eb4c-456b-af4e-0b9179797054 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:16.221370 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c72c1d-eb4c-456b-af4e-0b9179797054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:16.253358 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-d6c72c1d-eb4c-456b-af4e-0b9179797054 None None] MFA Rules not processed for user `a1bdbce1b3d047cfa5ddf72f902ecd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:43:16.255125 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d6c72c1d-eb4c-456b-af4e-0b9179797054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:16.264079 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1008/2015] 10.222.0.17 () {58 vars in 967 bytes} [Thu Oct 20 14:43:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:43:16.282537 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0da10-9be9-42f4-b624-715f09cc970a service swift] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:16.294964 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0da10-9be9-42f4-b624-715f09cc970a service swift] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:16.302331 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0a60e-5bac-4690-ad94-03bbc7053c50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60d62d14cd4042ab1bff5509e30f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:16.305603 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0a60e-5bac-4690-ad94-03bbc7053c50 service swift] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:16.306142 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0a60e-5bac-4690-ad94-03bbc7053c50 service swift] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:16.306601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0a60e-5bac-4690-ad94-03bbc7053c50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:16.316914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0a60e-5bac-4690-ad94-03bbc7053c50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:16.319055 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0a60e-5bac-4690-ad94-03bbc7053c50 service swift] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:16.330770 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1008/2016] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Oct 20 14:43:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 14:43:19.079794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c72c1d-eb4c-456b-af4e-0b9179797054 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:19.082214 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d6c72c1d-eb4c-456b-af4e-0b9179797054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:19.158146 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:19.220701 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c72c1d-eb4c-456b-af4e-0b9179797054 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:19.225837 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1b7c9-2f43-48a7-a2b7-3e3808ea6167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:19.226782 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1b7c9-2f43-48a7-a2b7-3e3808ea6167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:19.227211 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1b7c9-2f43-48a7-a2b7-3e3808ea6167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:19.227622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1b7c9-2f43-48a7-a2b7-3e3808ea6167 admin admin] PATH_INFO: `/v3/users/8ed7e68f243f44f4886ccf366b49ae6a` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:19.229552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1b7c9-2f43-48a7-a2b7-3e3808ea6167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed7e68f243f44f4886ccf366b49ae6a)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:19.232691 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1b7c9-2f43-48a7-a2b7-3e3808ea6167 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:19.302493 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-34b1b7c9-2f43-48a7-a2b7-3e3808ea6167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed7e68f243f44f4886ccf366b49ae6a'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:19.311804 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-34b1b7c9-2f43-48a7-a2b7-3e3808ea6167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed7e68f243f44f4886ccf366b49ae6a'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:19.313483 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-34b1b7c9-2f43-48a7-a2b7-3e3808ea6167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed7e68f243f44f4886ccf366b49ae6a'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:19.317097 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-34b1b7c9-2f43-48a7-a2b7-3e3808ea6167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed7e68f243f44f4886ccf366b49ae6a'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:19.328168 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-34b1b7c9-2f43-48a7-a2b7-3e3808ea6167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed7e68f243f44f4886ccf366b49ae6a'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:19.356451 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1009/2017] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:43:19 2022] DELETE /identity/v3/users/8ed7e68f243f44f4886ccf366b49ae6a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:43:19.573228 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0a60e-5bac-4690-ad94-03bbc7053c50 service swift] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:19.588512 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0a60e-5bac-4690-ad94-03bbc7053c50 service swift] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:19.623877 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:19.705382 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83b8e1-9224-4bca-a56c-4f7dd905b254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:19.706064 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83b8e1-9224-4bca-a56c-4f7dd905b254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:19.706534 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83b8e1-9224-4bca-a56c-4f7dd905b254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:19.706804 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83b8e1-9224-4bca-a56c-4f7dd905b254 admin admin] PATH_INFO: `/v3/projects/472237e6dfa74f2ea65e7f935c797ace` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:19.708105 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83b8e1-9224-4bca-a56c-4f7dd905b254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=472237e6dfa74f2ea65e7f935c797ace)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:19.710076 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83b8e1-9224-4bca-a56c-4f7dd905b254 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:19.794373 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-5d83b8e1-9224-4bca-a56c-4f7dd905b254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '472237e6dfa74f2ea65e7f935c797ace', 'request_id': 'req-5d83b8e1-9224-4bca-a56c-4f7dd905b254'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:19.839832 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-5d83b8e1-9224-4bca-a56c-4f7dd905b254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '472237e6dfa74f2ea65e7f935c797ace', 'request_id': 'req-5d83b8e1-9224-4bca-a56c-4f7dd905b254'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:19.897910 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-5d83b8e1-9224-4bca-a56c-4f7dd905b254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '472237e6dfa74f2ea65e7f935c797ace', 'request_id': 'req-5d83b8e1-9224-4bca-a56c-4f7dd905b254'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:19.924460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-5d83b8e1-9224-4bca-a56c-4f7dd905b254 admin admin] The token cache is being invalidate because project 472237e6dfa74f2ea65e7f935c797ace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:43:19.924991 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-5d83b8e1-9224-4bca-a56c-4f7dd905b254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:19.926023 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-5d83b8e1-9224-4bca-a56c-4f7dd905b254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:19.928491 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1009/2018] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:43:19 2022] DELETE /identity/v3/projects/472237e6dfa74f2ea65e7f935c797ace => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:43:19.933729 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec066b7-7a71-4141-bf45-c56179787053 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:19.933969 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec066b7-7a71-4141-bf45-c56179787053 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:19.934420 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec066b7-7a71-4141-bf45-c56179787053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:19.982043 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-6ec066b7-7a71-4141-bf45-c56179787053 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:43:19.989029 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-6ec066b7-7a71-4141-bf45-c56179787053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:20.136376 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1010/2019] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:43:20.145911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26a0b7-575f-4f8f-ad4e-e123872dfc6d None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:20.146368 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26a0b7-575f-4f8f-ad4e-e123872dfc6d None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:20.146814 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26a0b7-575f-4f8f-ad4e-e123872dfc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:20.187152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-de26a0b7-575f-4f8f-ad4e-e123872dfc6d None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:43:20.188599 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-de26a0b7-575f-4f8f-ad4e-e123872dfc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:20.210104 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec066b7-7a71-4141-bf45-c56179787053 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:20.217910 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1010/2020] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:43:20.224860 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec066b7-7a71-4141-bf45-c56179787053 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:20.233836 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268910dd-fdea-4f35-ad04-a02155c3e47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:20.234787 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268910dd-fdea-4f35-ad04-a02155c3e47e admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:20.235277 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268910dd-fdea-4f35-ad04-a02155c3e47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:20.235755 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268910dd-fdea-4f35-ad04-a02155c3e47e admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:20.236577 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268910dd-fdea-4f35-ad04-a02155c3e47e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:43:20.237829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268910dd-fdea-4f35-ad04-a02155c3e47e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:20.240513 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268910dd-fdea-4f35-ad04-a02155c3e47e admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:20.278511 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26a0b7-575f-4f8f-ad4e-e123872dfc6d None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:20.289626 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1011/2021] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:43:20.290187 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26a0b7-575f-4f8f-ad4e-e123872dfc6d None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:20.296044 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40db7b2-5263-4984-8a13-4cfed99c9932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:20.296883 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40db7b2-5263-4984-8a13-4cfed99c9932 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:20.297334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40db7b2-5263-4984-8a13-4cfed99c9932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:20.297695 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40db7b2-5263-4984-8a13-4cfed99c9932 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:20.298375 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40db7b2-5263-4984-8a13-4cfed99c9932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:20.300316 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40db7b2-5263-4984-8a13-4cfed99c9932 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:20.339262 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1011/2022] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:43:20 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:43:20.344169 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268910dd-fdea-4f35-ad04-a02155c3e47e admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:20.357717 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268910dd-fdea-4f35-ad04-a02155c3e47e admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:20.447140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:20.476884 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf8b3b-cb63-4c2b-a249-cfe7528a9fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:20.478542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf8b3b-cb63-4c2b-a249-cfe7528a9fba admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:20.479246 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf8b3b-cb63-4c2b-a249-cfe7528a9fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:20.479526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf8b3b-cb63-4c2b-a249-cfe7528a9fba admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:20.480200 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf8b3b-cb63-4c2b-a249-cfe7528a9fba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:20.483386 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf8b3b-cb63-4c2b-a249-cfe7528a9fba admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:20.511316 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1012/2023] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:43:20 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:43:20.515990 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40db7b2-5263-4984-8a13-4cfed99c9932 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:20.526988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40db7b2-5263-4984-8a13-4cfed99c9932 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:20.532718 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d7258-8404-4d6c-bddb-55db7e888a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:20.533839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d7258-8404-4d6c-bddb-55db7e888a7c admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:20.534366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d7258-8404-4d6c-bddb-55db7e888a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:20.534815 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d7258-8404-4d6c-bddb-55db7e888a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:20.535697 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d7258-8404-4d6c-bddb-55db7e888a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:20.537747 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d7258-8404-4d6c-bddb-55db7e888a7c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:20.567923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1012/2024] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:43:20.573202 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d7258-8404-4d6c-bddb-55db7e888a7c admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:20.573888 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5054301-958e-4643-973a-296c5d147235 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:20.574343 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5054301-958e-4643-973a-296c5d147235 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:20.574763 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5054301-958e-4643-973a-296c5d147235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:20.581722 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d7258-8404-4d6c-bddb-55db7e888a7c admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:20.589380 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e71432-8b26-4a1b-b86c-2e77e9c35e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:20.590717 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e71432-8b26-4a1b-b86c-2e77e9c35e71 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:20.591201 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e71432-8b26-4a1b-b86c-2e77e9c35e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:20.591729 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e71432-8b26-4a1b-b86c-2e77e9c35e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:20.593048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e71432-8b26-4a1b-b86c-2e77e9c35e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:20.594884 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e71432-8b26-4a1b-b86c-2e77e9c35e71 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:20.596530 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-d5054301-958e-4643-973a-296c5d147235 None None] MFA Rules not processed for user `ebadd4bd1ec1442789777438c6d16414`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:43:20.597807 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d5054301-958e-4643-973a-296c5d147235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:20.609837 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1013/2025] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:43:20.614242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e71432-8b26-4a1b-b86c-2e77e9c35e71 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:20.628013 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e71432-8b26-4a1b-b86c-2e77e9c35e71 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:20.635547 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce1163-3245-4152-9394-014bfa6ca95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:20.636887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce1163-3245-4152-9394-014bfa6ca95f admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:20.637358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce1163-3245-4152-9394-014bfa6ca95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:20.637985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce1163-3245-4152-9394-014bfa6ca95f admin admin] PATH_INFO: `/v3/projects/ea4f379c43f0413aadff4f78b6c62254/users/ed3673c1284b4f54ad4ebd0d569fe9ed/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:20.663007 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce1163-3245-4152-9394-014bfa6ca95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea4f379c43f0413aadff4f78b6c62254, user_id=ed3673c1284b4f54ad4ebd0d569fe9ed, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:20.664820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1013/2026] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:43:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:43:20.666368 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce1163-3245-4152-9394-014bfa6ca95f admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:20.703478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1014/2027] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:43:20 2022] PUT /identity/v3/projects/ea4f379c43f0413aadff4f78b6c62254/users/ed3673c1284b4f54ad4ebd0d569fe9ed/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:43:20.713951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf0f04-43f7-4227-b706-269512ae5a43 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:20.714719 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf0f04-43f7-4227-b706-269512ae5a43 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:20.715079 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf0f04-43f7-4227-b706-269512ae5a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:20.768428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-d5bf0f04-43f7-4227-b706-269512ae5a43 None None] MFA Rules not processed for user `ed3673c1284b4f54ad4ebd0d569fe9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:43:20.770441 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d5bf0f04-43f7-4227-b706-269512ae5a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:20.909823 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1014/2028] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:43:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:43:20.923059 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce1163-3245-4152-9394-014bfa6ca95f admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:20.926259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-20ce1163-3245-4152-9394-014bfa6ca95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:21.026713 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:21.074043 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce1163-3245-4152-9394-014bfa6ca95f admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:21.079763 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260089a7-b26f-4ce6-ac30-db3601731891 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:21.094525 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260089a7-b26f-4ce6-ac30-db3601731891 service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:21.096300 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260089a7-b26f-4ce6-ac30-db3601731891 service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:21.096681 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260089a7-b26f-4ce6-ac30-db3601731891 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:21.129760 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260089a7-b26f-4ce6-ac30-db3601731891 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:21.134981 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260089a7-b26f-4ce6-ac30-db3601731891 service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:21.173700 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1015/2029] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:43:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:43:21.211299 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf0f04-43f7-4227-b706-269512ae5a43 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:21.370083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf0f04-43f7-4227-b706-269512ae5a43 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:21.375113 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209395f-de7d-44a6-8779-91df510d9bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:21.375898 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209395f-de7d-44a6-8779-91df510d9bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:21.376281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209395f-de7d-44a6-8779-91df510d9bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:21.376661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209395f-de7d-44a6-8779-91df510d9bd4 admin admin] PATH_INFO: `/v3/users/ed3673c1284b4f54ad4ebd0d569fe9ed` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:21.378006 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209395f-de7d-44a6-8779-91df510d9bd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed3673c1284b4f54ad4ebd0d569fe9ed)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:21.381800 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209395f-de7d-44a6-8779-91df510d9bd4 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:21.392010 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:21.450954 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-c209395f-de7d-44a6-8779-91df510d9bd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed3673c1284b4f54ad4ebd0d569fe9ed'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:21.462828 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-c209395f-de7d-44a6-8779-91df510d9bd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed3673c1284b4f54ad4ebd0d569fe9ed'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:21.463600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-c209395f-de7d-44a6-8779-91df510d9bd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed3673c1284b4f54ad4ebd0d569fe9ed'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:21.464205 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-c209395f-de7d-44a6-8779-91df510d9bd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed3673c1284b4f54ad4ebd0d569fe9ed'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:21.479015 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-c209395f-de7d-44a6-8779-91df510d9bd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed3673c1284b4f54ad4ebd0d569fe9ed'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:21.510896 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1015/2030] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:43:21 2022] DELETE /identity/v3/users/ed3673c1284b4f54ad4ebd0d569fe9ed => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:43:21.512750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1dc45-cc2e-4517-b26b-6ac89ac88b35 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:21.513099 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1dc45-cc2e-4517-b26b-6ac89ac88b35 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:21.513453 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1dc45-cc2e-4517-b26b-6ac89ac88b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:21.539895 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-78f1dc45-cc2e-4517-b26b-6ac89ac88b35 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:43:21.541697 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-78f1dc45-cc2e-4517-b26b-6ac89ac88b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:21.616378 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1016/2031] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:43:21.627075 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209395f-de7d-44a6-8779-91df510d9bd4 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:21.629169 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-c209395f-de7d-44a6-8779-91df510d9bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:21.694896 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209395f-de7d-44a6-8779-91df510d9bd4 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:21.700636 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9ad1f-afd4-43bf-96be-829ad78a0cbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:21.701323 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9ad1f-afd4-43bf-96be-829ad78a0cbe service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:21.701635 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9ad1f-afd4-43bf-96be-829ad78a0cbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:21.701921 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9ad1f-afd4-43bf-96be-829ad78a0cbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:21.713693 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9ad1f-afd4-43bf-96be-829ad78a0cbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:21.717694 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9ad1f-afd4-43bf-96be-829ad78a0cbe service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:21.729555 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1016/2032] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:43:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:43:22.125461 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1dc45-cc2e-4517-b26b-6ac89ac88b35 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:22.127709 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-78f1dc45-cc2e-4517-b26b-6ac89ac88b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:22.173894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1dc45-cc2e-4517-b26b-6ac89ac88b35 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:22.219108 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b994d7-0913-476f-a159-6c5b2a2b88c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:22.220055 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b994d7-0913-476f-a159-6c5b2a2b88c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:22.221090 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b994d7-0913-476f-a159-6c5b2a2b88c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:22.221690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b994d7-0913-476f-a159-6c5b2a2b88c4 admin admin] PATH_INFO: `/v3/projects/ea4f379c43f0413aadff4f78b6c62254` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:22.223255 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b994d7-0913-476f-a159-6c5b2a2b88c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea4f379c43f0413aadff4f78b6c62254)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:22.225412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b994d7-0913-476f-a159-6c5b2a2b88c4 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:22.339823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-89b994d7-0913-476f-a159-6c5b2a2b88c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea4f379c43f0413aadff4f78b6c62254', 'request_id': 'req-89b994d7-0913-476f-a159-6c5b2a2b88c4'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:22.346358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-89b994d7-0913-476f-a159-6c5b2a2b88c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea4f379c43f0413aadff4f78b6c62254', 'request_id': 'req-89b994d7-0913-476f-a159-6c5b2a2b88c4'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:22.357205 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-89b994d7-0913-476f-a159-6c5b2a2b88c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea4f379c43f0413aadff4f78b6c62254', 'request_id': 'req-89b994d7-0913-476f-a159-6c5b2a2b88c4'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:22.370426 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-89b994d7-0913-476f-a159-6c5b2a2b88c4 admin admin] The token cache is being invalidate because project ea4f379c43f0413aadff4f78b6c62254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:43:22.375364 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-89b994d7-0913-476f-a159-6c5b2a2b88c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:22.377187 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-89b994d7-0913-476f-a159-6c5b2a2b88c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:22.379751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1017/2033] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:43:22 2022] DELETE /identity/v3/projects/ea4f379c43f0413aadff4f78b6c62254 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:43:22.384584 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddfa17-1936-42bf-bdf0-0ccea06e426e None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:22.385740 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddfa17-1936-42bf-bdf0-0ccea06e426e None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:22.386308 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddfa17-1936-42bf-bdf0-0ccea06e426e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:22.412001 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-11ddfa17-1936-42bf-bdf0-0ccea06e426e None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:43:22.413715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-11ddfa17-1936-42bf-bdf0-0ccea06e426e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:22.578870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1017/2034] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:43:22.603141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c37b2-257a-4752-b217-a253756a750b None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:22.603524 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c37b2-257a-4752-b217-a253756a750b None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:22.603918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c37b2-257a-4752-b217-a253756a750b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:22.638774 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-667c37b2-257a-4752-b217-a253756a750b None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:43:22.641190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-667c37b2-257a-4752-b217-a253756a750b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:22.654555 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1018/2035] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:43:22.658547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ddfa17-1936-42bf-bdf0-0ccea06e426e None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:22.675267 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ddfa17-1936-42bf-bdf0-0ccea06e426e None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:22.688178 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500bbc8-aef1-4d7b-a52d-c27876a3b668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:22.689035 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500bbc8-aef1-4d7b-a52d-c27876a3b668 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:22.689477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500bbc8-aef1-4d7b-a52d-c27876a3b668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:22.689962 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500bbc8-aef1-4d7b-a52d-c27876a3b668 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:22.690965 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500bbc8-aef1-4d7b-a52d-c27876a3b668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:43:22.691417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500bbc8-aef1-4d7b-a52d-c27876a3b668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:22.693301 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500bbc8-aef1-4d7b-a52d-c27876a3b668 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:22.710662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1018/2036] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:43:22.715905 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c37b2-257a-4752-b217-a253756a750b None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:22.751377 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c37b2-257a-4752-b217-a253756a750b None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:22.759656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1386ae-1de0-4737-8c35-85fea5f85acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:22.760279 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1386ae-1de0-4737-8c35-85fea5f85acf admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:22.761206 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1386ae-1de0-4737-8c35-85fea5f85acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:22.761770 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1386ae-1de0-4737-8c35-85fea5f85acf admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:22.763509 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1386ae-1de0-4737-8c35-85fea5f85acf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:22.768143 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1386ae-1de0-4737-8c35-85fea5f85acf admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:22.809938 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1019/2037] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:43:22 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:43:22.814965 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500bbc8-aef1-4d7b-a52d-c27876a3b668 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:22.855370 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500bbc8-aef1-4d7b-a52d-c27876a3b668 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:22.877857 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:22.967527 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd2878-ecac-406d-84aa-77a49b677091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:22.968592 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd2878-ecac-406d-84aa-77a49b677091 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:22.969148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd2878-ecac-406d-84aa-77a49b677091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:22.969615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd2878-ecac-406d-84aa-77a49b677091 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:22.970628 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd2878-ecac-406d-84aa-77a49b677091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:22.973035 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd2878-ecac-406d-84aa-77a49b677091 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:22.999055 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1019/2038] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:43:22 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:43:23.006566 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1386ae-1de0-4737-8c35-85fea5f85acf admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:23.020937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1386ae-1de0-4737-8c35-85fea5f85acf admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:23.030376 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bf7b3-c6ec-4932-91e5-4008a16d9818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:23.031502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bf7b3-c6ec-4932-91e5-4008a16d9818 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:23.032122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bf7b3-c6ec-4932-91e5-4008a16d9818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:23.032555 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bf7b3-c6ec-4932-91e5-4008a16d9818 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:23.033391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bf7b3-c6ec-4932-91e5-4008a16d9818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:23.037548 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bf7b3-c6ec-4932-91e5-4008a16d9818 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:23.051372 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1020/2039] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:43:23.054805 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd2878-ecac-406d-84aa-77a49b677091 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:23.072542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd2878-ecac-406d-84aa-77a49b677091 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:23.082284 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185377e7-c92c-4fd3-88d1-84ebf4041da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:23.082918 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185377e7-c92c-4fd3-88d1-84ebf4041da5 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:23.083210 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185377e7-c92c-4fd3-88d1-84ebf4041da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:23.084100 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185377e7-c92c-4fd3-88d1-84ebf4041da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:23.084746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185377e7-c92c-4fd3-88d1-84ebf4041da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:23.087019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185377e7-c92c-4fd3-88d1-84ebf4041da5 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:23.110963 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1020/2040] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:43:23.115977 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bf7b3-c6ec-4932-91e5-4008a16d9818 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:23.131366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bf7b3-c6ec-4932-91e5-4008a16d9818 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:23.166225 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd8341-daf8-4bcd-949b-6605cad93042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:23.167571 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd8341-daf8-4bcd-949b-6605cad93042 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:23.168014 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd8341-daf8-4bcd-949b-6605cad93042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:23.169237 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd8341-daf8-4bcd-949b-6605cad93042 admin admin] PATH_INFO: `/v3/projects/306f887cc6ca435c88781bd078c16b8a/users/cc3b44667a01411bbfd41bc7f5bd6f78/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:23.220595 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd8341-daf8-4bcd-949b-6605cad93042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=306f887cc6ca435c88781bd078c16b8a, user_id=cc3b44667a01411bbfd41bc7f5bd6f78, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:23.226658 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd8341-daf8-4bcd-949b-6605cad93042 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:23.230261 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:23.258238 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1021/2041] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:43:23 2022] PUT /identity/v3/projects/306f887cc6ca435c88781bd078c16b8a/users/cc3b44667a01411bbfd41bc7f5bd6f78/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:43:23.265986 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179ace2-52d1-43fd-bfbf-dc31e0a47c82 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:23.266099 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179ace2-52d1-43fd-bfbf-dc31e0a47c82 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:23.267086 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179ace2-52d1-43fd-bfbf-dc31e0a47c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:23.340217 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-b179ace2-52d1-43fd-bfbf-dc31e0a47c82 None None] MFA Rules not processed for user `cc3b44667a01411bbfd41bc7f5bd6f78`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:43:23.341462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-b179ace2-52d1-43fd-bfbf-dc31e0a47c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:23.488119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1021/2042] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:43:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:43:23.501432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd8341-daf8-4bcd-949b-6605cad93042 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:23.503513 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-9ddd8341-daf8-4bcd-949b-6605cad93042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:23.592980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd8341-daf8-4bcd-949b-6605cad93042 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:23.597948 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5fdde-bc0c-4332-ac37-5aed0faf423f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:23.598564 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5fdde-bc0c-4332-ac37-5aed0faf423f service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:23.599019 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5fdde-bc0c-4332-ac37-5aed0faf423f service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:23.599312 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5fdde-bc0c-4332-ac37-5aed0faf423f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:23.612073 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5fdde-bc0c-4332-ac37-5aed0faf423f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:23.613662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5fdde-bc0c-4332-ac37-5aed0faf423f service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:23.627663 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1022/2043] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:43:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:43:24.825520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179ace2-52d1-43fd-bfbf-dc31e0a47c82 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:24.827645 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-b179ace2-52d1-43fd-bfbf-dc31e0a47c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:24.905998 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179ace2-52d1-43fd-bfbf-dc31e0a47c82 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:24.911387 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33198586-b135-4f91-8800-b4f942d15f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:24.912038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33198586-b135-4f91-8800-b4f942d15f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:24.912319 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33198586-b135-4f91-8800-b4f942d15f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:24.912596 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33198586-b135-4f91-8800-b4f942d15f8f admin admin] PATH_INFO: `/v3/users/7a070b7fa5074d6ea71aad94783d0c69` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:24.913817 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33198586-b135-4f91-8800-b4f942d15f8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a070b7fa5074d6ea71aad94783d0c69)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:24.915921 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33198586-b135-4f91-8800-b4f942d15f8f admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:24.949756 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:24.984809 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-33198586-b135-4f91-8800-b4f942d15f8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a070b7fa5074d6ea71aad94783d0c69'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:24.993044 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-33198586-b135-4f91-8800-b4f942d15f8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a070b7fa5074d6ea71aad94783d0c69'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:24.993962 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-33198586-b135-4f91-8800-b4f942d15f8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a070b7fa5074d6ea71aad94783d0c69'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:24.994644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-33198586-b135-4f91-8800-b4f942d15f8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a070b7fa5074d6ea71aad94783d0c69'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:25.006332 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-33198586-b135-4f91-8800-b4f942d15f8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a070b7fa5074d6ea71aad94783d0c69'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:25.032391 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1022/2044] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:43:24 2022] DELETE /identity/v3/users/7a070b7fa5074d6ea71aad94783d0c69 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:43:25.037396 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c9e50-0bbe-4d5f-a241-c9e5658166bf None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:25.038058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c9e50-0bbe-4d5f-a241-c9e5658166bf None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:25.038058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c9e50-0bbe-4d5f-a241-c9e5658166bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:25.062368 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-0c9c9e50-0bbe-4d5f-a241-c9e5658166bf None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:43:25.063693 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-0c9c9e50-0bbe-4d5f-a241-c9e5658166bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:25.175352 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1023/2045] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:43:25.188392 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33198586-b135-4f91-8800-b4f942d15f8f admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:25.190408 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-33198586-b135-4f91-8800-b4f942d15f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:25.294582 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084fa70-1d63-4aa5-998b-b394219234b0 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:25.294837 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084fa70-1d63-4aa5-998b-b394219234b0 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:25.295303 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084fa70-1d63-4aa5-998b-b394219234b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:25.313419 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33198586-b135-4f91-8800-b4f942d15f8f admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:25.317592 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacb4c1-c7e1-47c2-a567-d4b1aba0fb0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:25.318473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacb4c1-c7e1-47c2-a567-d4b1aba0fb0b service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:25.318860 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacb4c1-c7e1-47c2-a567-d4b1aba0fb0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:25.319197 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacb4c1-c7e1-47c2-a567-d4b1aba0fb0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:25.349733 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-f084fa70-1d63-4aa5-998b-b394219234b0 None None] MFA Rules not processed for user `cc3b44667a01411bbfd41bc7f5bd6f78`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:43:25.350709 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacb4c1-c7e1-47c2-a567-d4b1aba0fb0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:25.352221 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacb4c1-c7e1-47c2-a567-d4b1aba0fb0b service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:25.355669 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-f084fa70-1d63-4aa5-998b-b394219234b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:25.381962 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1023/2046] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:43:25.632062 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1024/2047] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:43:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:43:26.034312 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacb4c1-c7e1-47c2-a567-d4b1aba0fb0b service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:26.036135 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-0aacb4c1-c7e1-47c2-a567-d4b1aba0fb0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:26.057478 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacb4c1-c7e1-47c2-a567-d4b1aba0fb0b service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:26.067063 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8963faa-f6c8-4545-86b3-da79f2475bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:26.068187 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8963faa-f6c8-4545-86b3-da79f2475bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:26.074010 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8963faa-f6c8-4545-86b3-da79f2475bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:26.080871 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8963faa-f6c8-4545-86b3-da79f2475bee admin admin] PATH_INFO: `/v3/projects/5e8ec1a394f8410db119af892121ddc9` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:26.088723 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8963faa-f6c8-4545-86b3-da79f2475bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e8ec1a394f8410db119af892121ddc9)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:26.090405 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8963faa-f6c8-4545-86b3-da79f2475bee admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:26.160568 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a8963faa-f6c8-4545-86b3-da79f2475bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e8ec1a394f8410db119af892121ddc9', 'request_id': 'req-a8963faa-f6c8-4545-86b3-da79f2475bee'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:26.188362 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a8963faa-f6c8-4545-86b3-da79f2475bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e8ec1a394f8410db119af892121ddc9', 'request_id': 'req-a8963faa-f6c8-4545-86b3-da79f2475bee'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:26.195513 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a8963faa-f6c8-4545-86b3-da79f2475bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e8ec1a394f8410db119af892121ddc9', 'request_id': 'req-a8963faa-f6c8-4545-86b3-da79f2475bee'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:26.219770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a8963faa-f6c8-4545-86b3-da79f2475bee admin admin] The token cache is being invalidate because project 5e8ec1a394f8410db119af892121ddc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:43:26.220316 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a8963faa-f6c8-4545-86b3-da79f2475bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:26.221635 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-a8963faa-f6c8-4545-86b3-da79f2475bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:43:26.225836 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1024/2048] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:43:26 2022] DELETE /identity/v3/projects/5e8ec1a394f8410db119af892121ddc9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:43:26.331349 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084fa70-1d63-4aa5-998b-b394219234b0 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:26.347521 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084fa70-1d63-4aa5-998b-b394219234b0 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:26.484863 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=100 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:26.494935 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2c7c4-3d07-4ed4-9233-6c4768e73ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:26.495830 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2c7c4-3d07-4ed4-9233-6c4768e73ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:26.496286 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2c7c4-3d07-4ed4-9233-6c4768e73ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:26.496748 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2c7c4-3d07-4ed4-9233-6c4768e73ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:26.506213 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-95d2c7c4-3d07-4ed4-9233-6c4768e73ed6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:26.663194 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2c7c4-3d07-4ed4-9233-6c4768e73ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:26.664827 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2c7c4-3d07-4ed4-9233-6c4768e73ed6 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:26.692294 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1025/2049] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:43:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:43:34.923938 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5168a6-ea41-4d8c-8a01-e4767af26fd8 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:34.924997 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5168a6-ea41-4d8c-8a01-e4767af26fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:34.925640 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5168a6-ea41-4d8c-8a01-e4767af26fd8 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:34.927857 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1025/2050] 10.222.0.17 () {54 vars in 921 bytes} [Thu Oct 20 14:43:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:43:34.937626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920b215-d89c-4de9-acaf-60232a9599fb None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:34.938251 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920b215-d89c-4de9-acaf-60232a9599fb None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:34.938251 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920b215-d89c-4de9-acaf-60232a9599fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:34.958800 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-a920b215-d89c-4de9-acaf-60232a9599fb None None] MFA Rules not processed for user `172b859c0d774c8f8a98ce23bdc237d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:43:34.959935 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a920b215-d89c-4de9-acaf-60232a9599fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:35.031090 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1026/2051] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Oct 20 14:43:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:43:35.042892 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5168a6-ea41-4d8c-8a01-e4767af26fd8 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:35.045237 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-1b5168a6-ea41-4d8c-8a01-e4767af26fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:35.077412 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:35.114079 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5168a6-ea41-4d8c-8a01-e4767af26fd8 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:35.118486 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6b0ba-5630-4762-a55a-9df8f2cec1d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '077f50ca034b4d12817543377815393b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:35.119287 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6b0ba-5630-4762-a55a-9df8f2cec1d7 service glance] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:35.119741 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6b0ba-5630-4762-a55a-9df8f2cec1d7 service glance] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:35.120176 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6b0ba-5630-4762-a55a-9df8f2cec1d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:35.134203 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6b0ba-5630-4762-a55a-9df8f2cec1d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:35.136952 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6b0ba-5630-4762-a55a-9df8f2cec1d7 service glance] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:35.150725 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1026/2052] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:43:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:43:35.250461 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0a8c0-edf1-4346-8a00-0b99c558396a None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:35.250741 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0a8c0-edf1-4346-8a00-0b99c558396a None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:35.251114 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0a8c0-edf1-4346-8a00-0b99c558396a None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:35.252886 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1027/2053] 10.222.0.17 () {54 vars in 921 bytes} [Thu Oct 20 14:43:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:43:35.259750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb43b0-28e0-42ca-b47b-a27ab99b41ef None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:35.260031 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb43b0-28e0-42ca-b47b-a27ab99b41ef None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:35.260330 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb43b0-28e0-42ca-b47b-a27ab99b41ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:35.282439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-12fb43b0-28e0-42ca-b47b-a27ab99b41ef None None] MFA Rules not processed for user `359e9d904b0d43acae86337c1eb6a71d`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:43:35.283794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-12fb43b0-28e0-42ca-b47b-a27ab99b41ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:35.291838 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1027/2054] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Oct 20 14:43:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:43:35.311244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0a8c0-edf1-4346-8a00-0b99c558396a None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:35.313162 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-43e0a8c0-edf1-4346-8a00-0b99c558396a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:35.330430 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0a8c0-edf1-4346-8a00-0b99c558396a None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:35.334085 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e578fe-2ef7-444f-ba87-a054097329ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:35.334778 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e578fe-2ef7-444f-ba87-a054097329ef service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:35.335059 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e578fe-2ef7-444f-ba87-a054097329ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:35.335393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e578fe-2ef7-444f-ba87-a054097329ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:35.343377 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e578fe-2ef7-444f-ba87-a054097329ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:35.344877 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e578fe-2ef7-444f-ba87-a054097329ef service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:35.352832 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1028/2055] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:43:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:43:35.438915 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cfb38-dd4e-41d6-9964-ba57c40cb6d8 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:35.439214 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cfb38-dd4e-41d6-9964-ba57c40cb6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:35.440145 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cfb38-dd4e-41d6-9964-ba57c40cb6d8 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:35.440906 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1028/2056] 10.222.0.17 () {54 vars in 921 bytes} [Thu Oct 20 14:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:43:35.447163 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9989362-e829-42f0-a9ea-439245450561 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:35.447453 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9989362-e829-42f0-a9ea-439245450561 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:35.447729 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9989362-e829-42f0-a9ea-439245450561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:35.473318 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-a9989362-e829-42f0-a9ea-439245450561 None None] MFA Rules not processed for user `172b859c0d774c8f8a98ce23bdc237d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:43:35.474501 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a9989362-e829-42f0-a9ea-439245450561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:35.483829 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1029/2057] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Oct 20 14:43:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:43:35.494407 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cfb38-dd4e-41d6-9964-ba57c40cb6d8 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:35.505224 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cfb38-dd4e-41d6-9964-ba57c40cb6d8 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:35.508740 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f01f98-28a8-4afa-aabc-5c8ab19c72a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:35.509363 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f01f98-28a8-4afa-aabc-5c8ab19c72a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:35.509644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f01f98-28a8-4afa-aabc-5c8ab19c72a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:35.510002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f01f98-28a8-4afa-aabc-5c8ab19c72a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:35.521001 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f01f98-28a8-4afa-aabc-5c8ab19c72a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:35.522546 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f01f98-28a8-4afa-aabc-5c8ab19c72a0 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:35.533694 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1029/2058] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:43:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:43:38.742968 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a32b3-361d-46ee-8953-624537245757 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:38.743391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a32b3-361d-46ee-8953-624537245757 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:38.743524 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a32b3-361d-46ee-8953-624537245757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:38.762696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-a51a32b3-361d-46ee-8953-624537245757 None None] MFA Rules not processed for user `a1bdbce1b3d047cfa5ddf72f902ecd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:43:38.763928 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a51a32b3-361d-46ee-8953-624537245757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:38.817994 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1030/2059] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Oct 20 14:43:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:43:38.841895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f01f98-28a8-4afa-aabc-5c8ab19c72a0 service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:38.843948 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d6f01f98-28a8-4afa-aabc-5c8ab19c72a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:38.912678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f01f98-28a8-4afa-aabc-5c8ab19c72a0 service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:38.917757 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3ef80-24ea-4f78-93c0-c43575e7ff0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60d62d14cd4042ab1bff5509e30f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:38.918954 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3ef80-24ea-4f78-93c0-c43575e7ff0f service swift] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:38.919230 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3ef80-24ea-4f78-93c0-c43575e7ff0f service swift] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:38.919532 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3ef80-24ea-4f78-93c0-c43575e7ff0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:38.928146 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3ef80-24ea-4f78-93c0-c43575e7ff0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:38.929731 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3ef80-24ea-4f78-93c0-c43575e7ff0f service swift] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:38.937981 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1030/2060] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Oct 20 14:43:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 14:43:48.811246 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=95 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:48.935068 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=55 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:57.356283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a5d21-dac9-49e7-9ee8-aab3058211b6 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:57.357117 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a5d21-dac9-49e7-9ee8-aab3058211b6 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:57.357803 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a5d21-dac9-49e7-9ee8-aab3058211b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:57.394950 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-7e4a5d21-dac9-49e7-9ee8-aab3058211b6 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:43:57.397007 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-7e4a5d21-dac9-49e7-9ee8-aab3058211b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:57.478091 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1031/2061] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 20 14:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:43:57.497356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3ef80-24ea-4f78-93c0-c43575e7ff0f service swift] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:57.499453 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-93c3ef80-24ea-4f78-93c0-c43575e7ff0f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:57.516002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3ef80-24ea-4f78-93c0-c43575e7ff0f service swift] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:57.521394 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed138b7-b21d-4ec4-bf07-3e0b4e8800d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:57.522051 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed138b7-b21d-4ec4-bf07-3e0b4e8800d0 service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:57.522332 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed138b7-b21d-4ec4-bf07-3e0b4e8800d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:57.522603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed138b7-b21d-4ec4-bf07-3e0b4e8800d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:57.531996 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed138b7-b21d-4ec4-bf07-3e0b4e8800d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:57.534030 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed138b7-b21d-4ec4-bf07-3e0b4e8800d0 service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:57.545325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1031/2062] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:43:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:43:58.799432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0d2c4-801a-4d39-aff5-3d8f6e9626e3 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:58.799897 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0d2c4-801a-4d39-aff5-3d8f6e9626e3 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:58.800018 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0d2c4-801a-4d39-aff5-3d8f6e9626e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:58.818978 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-60d0d2c4-801a-4d39-aff5-3d8f6e9626e3 None None] MFA Rules not processed for user `a1bdbce1b3d047cfa5ddf72f902ecd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:43:58.820173 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-60d0d2c4-801a-4d39-aff5-3d8f6e9626e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:43:58.827827 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1032/2063] 10.222.0.17 () {58 vars in 967 bytes} [Thu Oct 20 14:43:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:43:58.840205 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed138b7-b21d-4ec4-bf07-3e0b4e8800d0 service nova] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:43:58.851897 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed138b7-b21d-4ec4-bf07-3e0b4e8800d0 service nova] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:43:58.856795 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea4325-966d-496f-b231-96f81685ca3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60d62d14cd4042ab1bff5509e30f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:43:58.857414 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea4325-966d-496f-b231-96f81685ca3f service swift] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:43:58.857690 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea4325-966d-496f-b231-96f81685ca3f service swift] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:43:58.858000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea4325-966d-496f-b231-96f81685ca3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:43:58.865676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea4325-966d-496f-b231-96f81685ca3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:43:58.867288 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea4325-966d-496f-b231-96f81685ca3f service swift] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:43:58.875534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1032/2064] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Oct 20 14:43:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 14:44:01.420648 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f81393-d5c8-49c3-8278-b51e289ba4c1 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:01.421158 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f81393-d5c8-49c3-8278-b51e289ba4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:01.421158 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f81393-d5c8-49c3-8278-b51e289ba4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:01.440550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-40f81393-d5c8-49c3-8278-b51e289ba4c1 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:44:01.441757 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-40f81393-d5c8-49c3-8278-b51e289ba4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:01.449549 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1033/2065] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 20 14:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:44:01.463690 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea4325-966d-496f-b231-96f81685ca3f service swift] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:44:01.476562 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea4325-966d-496f-b231-96f81685ca3f service swift] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:44:01.482684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113739f8-a719-4a7d-855c-b2ab668921c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:44:01.483238 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113739f8-a719-4a7d-855c-b2ab668921c1 service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:01.483517 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113739f8-a719-4a7d-855c-b2ab668921c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:01.483813 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113739f8-a719-4a7d-855c-b2ab668921c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:01.491895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113739f8-a719-4a7d-855c-b2ab668921c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:44:01.493462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113739f8-a719-4a7d-855c-b2ab668921c1 service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:44:01.502725 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1033/2066] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:44:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:44:01.999318 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21023ae8-8ad0-4a7c-84e7-df962d941e94 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:01.999599 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21023ae8-8ad0-4a7c-84e7-df962d941e94 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:01.999871 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21023ae8-8ad0-4a7c-84e7-df962d941e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:02.020409 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-21023ae8-8ad0-4a7c-84e7-df962d941e94 None None] MFA Rules not processed for user `a1bdbce1b3d047cfa5ddf72f902ecd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:44:02.021605 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-21023ae8-8ad0-4a7c-84e7-df962d941e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:02.028711 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1034/2067] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Oct 20 14:44:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:44:02.041479 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113739f8-a719-4a7d-855c-b2ab668921c1 service nova] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:44:02.052445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113739f8-a719-4a7d-855c-b2ab668921c1 service nova] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:44:02.057376 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbfda0-88a2-4012-ab30-1b18dc28ba61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60d62d14cd4042ab1bff5509e30f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:44:02.058022 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbfda0-88a2-4012-ab30-1b18dc28ba61 service swift] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:02.058304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbfda0-88a2-4012-ab30-1b18dc28ba61 service swift] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:02.058577 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbfda0-88a2-4012-ab30-1b18dc28ba61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:02.067131 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbfda0-88a2-4012-ab30-1b18dc28ba61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:44:02.068697 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbfda0-88a2-4012-ab30-1b18dc28ba61 service swift] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:44:02.077229 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1034/2068] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Oct 20 14:44:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 14:44:02.585498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8063256-2753-47e3-b1af-f25f7306c76a None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:02.585988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8063256-2753-47e3-b1af-f25f7306c76a None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:02.586082 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8063256-2753-47e3-b1af-f25f7306c76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:02.605280 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-b8063256-2753-47e3-b1af-f25f7306c76a None None] MFA Rules not processed for user `a1bdbce1b3d047cfa5ddf72f902ecd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:44:02.606490 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b8063256-2753-47e3-b1af-f25f7306c76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:02.613609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1035/2069] 10.222.0.17 () {58 vars in 967 bytes} [Thu Oct 20 14:44:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:44:02.626643 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbfda0-88a2-4012-ab30-1b18dc28ba61 service swift] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:44:02.637077 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbfda0-88a2-4012-ab30-1b18dc28ba61 service swift] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:44:02.643279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a8c10-39bb-40b2-9736-3fca82a439cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60d62d14cd4042ab1bff5509e30f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:44:02.643880 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a8c10-39bb-40b2-9736-3fca82a439cb service swift] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:02.644156 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a8c10-39bb-40b2-9736-3fca82a439cb service swift] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:02.644424 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a8c10-39bb-40b2-9736-3fca82a439cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:02.652985 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a8c10-39bb-40b2-9736-3fca82a439cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:44:02.654840 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a8c10-39bb-40b2-9736-3fca82a439cb service swift] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:44:02.663284 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1035/2070] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Oct 20 14:44:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 14:44:02.884904 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe86468-be67-4995-90b8-6b248aa76cd7 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:02.885188 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe86468-be67-4995-90b8-6b248aa76cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:02.885460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe86468-be67-4995-90b8-6b248aa76cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:02.904997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-ebe86468-be67-4995-90b8-6b248aa76cd7 None None] MFA Rules not processed for user `a1bdbce1b3d047cfa5ddf72f902ecd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:44:02.906208 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ebe86468-be67-4995-90b8-6b248aa76cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:02.913080 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1036/2071] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Oct 20 14:44:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:44:02.924999 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a8c10-39bb-40b2-9736-3fca82a439cb service swift] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:44:02.936250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a8c10-39bb-40b2-9736-3fca82a439cb service swift] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:44:02.941312 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eedddb-500b-4653-9624-a4c1066b98c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60d62d14cd4042ab1bff5509e30f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:44:02.941939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eedddb-500b-4653-9624-a4c1066b98c3 service swift] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:02.942223 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eedddb-500b-4653-9624-a4c1066b98c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:02.942497 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eedddb-500b-4653-9624-a4c1066b98c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:02.950345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eedddb-500b-4653-9624-a4c1066b98c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:44:02.952098 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eedddb-500b-4653-9624-a4c1066b98c3 service swift] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:44:02.960146 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1036/2072] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Oct 20 14:44:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 14:44:03.281288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba0837-9023-49ab-9f3b-9ed2ecc88c88 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:03.281575 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba0837-9023-49ab-9f3b-9ed2ecc88c88 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:03.281876 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba0837-9023-49ab-9f3b-9ed2ecc88c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:03.301686 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-d0ba0837-9023-49ab-9f3b-9ed2ecc88c88 None None] MFA Rules not processed for user `a1bdbce1b3d047cfa5ddf72f902ecd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:44:03.302900 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-d0ba0837-9023-49ab-9f3b-9ed2ecc88c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:03.310088 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1037/2073] 10.222.0.17 () {58 vars in 967 bytes} [Thu Oct 20 14:44:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:44:03.322561 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eedddb-500b-4653-9624-a4c1066b98c3 service swift] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:44:03.334088 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eedddb-500b-4653-9624-a4c1066b98c3 service swift] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:44:03.339458 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec9d92-0f31-4240-a650-3517225aa576 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60d62d14cd4042ab1bff5509e30f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:44:03.340126 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec9d92-0f31-4240-a650-3517225aa576 service swift] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:03.340513 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec9d92-0f31-4240-a650-3517225aa576 service swift] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:03.340846 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec9d92-0f31-4240-a650-3517225aa576 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:03.350505 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec9d92-0f31-4240-a650-3517225aa576 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:44:03.352182 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec9d92-0f31-4240-a650-3517225aa576 service swift] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:44:03.365143 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1037/2074] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Oct 20 14:44:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 14:44:04.214456 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4793028-4d26-46ed-af7c-3698e885a753 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:04.214456 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4793028-4d26-46ed-af7c-3698e885a753 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:04.214456 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4793028-4d26-46ed-af7c-3698e885a753 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:04.215026 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1038/2075] 10.222.0.17 () {54 vars in 961 bytes} [Thu Oct 20 14:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:44:04.220491 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd061ea-eff9-48e1-b445-71f67b1e4582 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:04.220914 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd061ea-eff9-48e1-b445-71f67b1e4582 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:04.221179 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd061ea-eff9-48e1-b445-71f67b1e4582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:04.243374 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-3bd061ea-eff9-48e1-b445-71f67b1e4582 None None] MFA Rules not processed for user `1e94a60e43914cf38a5f2f88b182083f`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:44:04.244586 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-3bd061ea-eff9-48e1-b445-71f67b1e4582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:04.316235 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1038/2076] 10.222.0.17 () {58 vars in 1058 bytes} [Thu Oct 20 14:44:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:44:04.323820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4793028-4d26-46ed-af7c-3698e885a753 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:44:04.337177 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4793028-4d26-46ed-af7c-3698e885a753 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:44:04.342734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9f647-a8f4-4918-bdba-2016e23c6cd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e94a60e43914cf38a5f2f88b182083f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:44:04.343332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9f647-a8f4-4918-bdba-2016e23c6cd1 service placement] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:04.343607 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9f647-a8f4-4918-bdba-2016e23c6cd1 service placement] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:04.343875 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9f647-a8f4-4918-bdba-2016e23c6cd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:04.345588 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-f0b9f647-a8f4-4918-bdba-2016e23c6cd1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:04.358107 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9f647-a8f4-4918-bdba-2016e23c6cd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:44:04.359750 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9f647-a8f4-4918-bdba-2016e23c6cd1 service placement] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:44:04.370482 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1039/2077] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:44:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:44:04.723019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723a179-1430-407c-b2e1-d9dad27c3d48 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:04.723307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723a179-1430-407c-b2e1-d9dad27c3d48 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:04.723581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723a179-1430-407c-b2e1-d9dad27c3d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:04.743783 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-e723a179-1430-407c-b2e1-d9dad27c3d48 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:44:04.744965 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e723a179-1430-407c-b2e1-d9dad27c3d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:04.753798 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1039/2078] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 20 14:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:44:04.769667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9f647-a8f4-4918-bdba-2016e23c6cd1 service placement] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:44:04.782891 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9f647-a8f4-4918-bdba-2016e23c6cd1 service placement] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:44:04.788616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad283ee9-c7bf-4c18-9e83-074614f43a41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:44:04.789212 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad283ee9-c7bf-4c18-9e83-074614f43a41 service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:04.789489 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad283ee9-c7bf-4c18-9e83-074614f43a41 service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:04.789759 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad283ee9-c7bf-4c18-9e83-074614f43a41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:04.798810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad283ee9-c7bf-4c18-9e83-074614f43a41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:44:04.800387 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad283ee9-c7bf-4c18-9e83-074614f43a41 service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:44:04.809639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1040/2079] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:44:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:44:05.502940 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723a179-1430-407c-b2e1-d9dad27c3d48 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:44:05.504400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e723a179-1430-407c-b2e1-d9dad27c3d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:05.517305 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723a179-1430-407c-b2e1-d9dad27c3d48 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:44:05.521834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327ca94-d5ba-4ed0-bc87-fecd0fb43aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:44:05.522479 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327ca94-d5ba-4ed0-bc87-fecd0fb43aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:05.522761 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327ca94-d5ba-4ed0-bc87-fecd0fb43aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:05.523036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327ca94-d5ba-4ed0-bc87-fecd0fb43aec admin admin] PATH_INFO: `/v3/users/cc3b44667a01411bbfd41bc7f5bd6f78` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:05.524152 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327ca94-d5ba-4ed0-bc87-fecd0fb43aec admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc3b44667a01411bbfd41bc7f5bd6f78)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:44:05.526100 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327ca94-d5ba-4ed0-bc87-fecd0fb43aec admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:44:05.572606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8327ca94-d5ba-4ed0-bc87-fecd0fb43aec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc3b44667a01411bbfd41bc7f5bd6f78'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:44:05.577631 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:05.581608 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8327ca94-d5ba-4ed0-bc87-fecd0fb43aec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc3b44667a01411bbfd41bc7f5bd6f78'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:44:05.582719 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8327ca94-d5ba-4ed0-bc87-fecd0fb43aec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc3b44667a01411bbfd41bc7f5bd6f78'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:44:05.583327 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8327ca94-d5ba-4ed0-bc87-fecd0fb43aec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc3b44667a01411bbfd41bc7f5bd6f78'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:44:05.590313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8327ca94-d5ba-4ed0-bc87-fecd0fb43aec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc3b44667a01411bbfd41bc7f5bd6f78'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:44:05.608995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1040/2080] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:44:05 2022] DELETE /identity/v3/users/cc3b44667a01411bbfd41bc7f5bd6f78 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:44:05.613261 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f975f-2535-455f-ae41-9e4bb8923531 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:05.613705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f975f-2535-455f-ae41-9e4bb8923531 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:05.613818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f975f-2535-455f-ae41-9e4bb8923531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:05.633711 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-5e5f975f-2535-455f-ae41-9e4bb8923531 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:44:05.634951 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-5e5f975f-2535-455f-ae41-9e4bb8923531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:05.693169 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1041/2081] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:44:05.703261 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327ca94-d5ba-4ed0-bc87-fecd0fb43aec admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:44:05.704673 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-8327ca94-d5ba-4ed0-bc87-fecd0fb43aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:05.760854 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327ca94-d5ba-4ed0-bc87-fecd0fb43aec admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:44:05.765394 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526d177-414d-44b8-a416-133189e5d4a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:44:05.766032 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526d177-414d-44b8-a416-133189e5d4a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:05.766318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526d177-414d-44b8-a416-133189e5d4a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:05.766590 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526d177-414d-44b8-a416-133189e5d4a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:05.775887 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526d177-414d-44b8-a416-133189e5d4a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:44:05.777317 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526d177-414d-44b8-a416-133189e5d4a8 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:44:05.786860 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1041/2082] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:44:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:44:05.955643 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f975f-2535-455f-ae41-9e4bb8923531 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:44:05.957069 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-5e5f975f-2535-455f-ae41-9e4bb8923531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:05.970788 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f975f-2535-455f-ae41-9e4bb8923531 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:44:05.975733 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae03463-6824-47ff-95d3-9de558623484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:44:05.976370 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae03463-6824-47ff-95d3-9de558623484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:05.976649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae03463-6824-47ff-95d3-9de558623484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:05.976918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae03463-6824-47ff-95d3-9de558623484 admin admin] PATH_INFO: `/v3/projects/306f887cc6ca435c88781bd078c16b8a` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:05.978078 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae03463-6824-47ff-95d3-9de558623484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=306f887cc6ca435c88781bd078c16b8a)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:44:05.979995 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae03463-6824-47ff-95d3-9de558623484 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:44:06.015880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:06.029579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-6ae03463-6824-47ff-95d3-9de558623484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '306f887cc6ca435c88781bd078c16b8a', 'request_id': 'req-6ae03463-6824-47ff-95d3-9de558623484'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:44:06.035253 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-6ae03463-6824-47ff-95d3-9de558623484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '306f887cc6ca435c88781bd078c16b8a', 'request_id': 'req-6ae03463-6824-47ff-95d3-9de558623484'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:44:06.041892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-6ae03463-6824-47ff-95d3-9de558623484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '306f887cc6ca435c88781bd078c16b8a', 'request_id': 'req-6ae03463-6824-47ff-95d3-9de558623484'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:44:06.053668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-6ae03463-6824-47ff-95d3-9de558623484 admin admin] The token cache is being invalidate because project 306f887cc6ca435c88781bd078c16b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:44:06.054202 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-6ae03463-6824-47ff-95d3-9de558623484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:44:06.054837 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-6ae03463-6824-47ff-95d3-9de558623484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:44:06.056327 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1042/2083] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:44:05 2022] DELETE /identity/v3/projects/306f887cc6ca435c88781bd078c16b8a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:44:07.802294 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d09ec-3668-4226-b2ea-27123ce8e93b None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:07.802762 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d09ec-3668-4226-b2ea-27123ce8e93b None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:07.802854 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d09ec-3668-4226-b2ea-27123ce8e93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:07.822668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-108d09ec-3668-4226-b2ea-27123ce8e93b None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:44:07.823856 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-108d09ec-3668-4226-b2ea-27123ce8e93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:07.888143 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1042/2084] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 20 14:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:44:07.906989 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae03463-6824-47ff-95d3-9de558623484 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:44:07.910359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-6ae03463-6824-47ff-95d3-9de558623484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:07.989580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae03463-6824-47ff-95d3-9de558623484 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:44:07.995131 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8372eff-34f9-49ae-88f1-2a7f27a6e441 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:44:07.995739 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8372eff-34f9-49ae-88f1-2a7f27a6e441 service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:07.996012 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8372eff-34f9-49ae-88f1-2a7f27a6e441 service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:07.996279 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8372eff-34f9-49ae-88f1-2a7f27a6e441 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:08.004165 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8372eff-34f9-49ae-88f1-2a7f27a6e441 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:44:08.005747 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8372eff-34f9-49ae-88f1-2a7f27a6e441 service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:44:08.015197 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1043/2085] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:44:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:44:10.951011 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0d3d3-2d43-4ac1-9eac-60b5a6754280 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:10.952222 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0d3d3-2d43-4ac1-9eac-60b5a6754280 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:10.952222 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0d3d3-2d43-4ac1-9eac-60b5a6754280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:10.972094 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-58c0d3d3-2d43-4ac1-9eac-60b5a6754280 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:44:10.973177 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-58c0d3d3-2d43-4ac1-9eac-60b5a6754280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:10.981595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1043/2086] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 20 14:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:44:10.996346 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8372eff-34f9-49ae-88f1-2a7f27a6e441 service nova] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:44:10.997728 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-d8372eff-34f9-49ae-88f1-2a7f27a6e441 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:11.011959 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8372eff-34f9-49ae-88f1-2a7f27a6e441 service nova] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:44:11.017546 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa4531-8784-46b7-ac4c-ab286d366f63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:44:11.018144 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa4531-8784-46b7-ac4c-ab286d366f63 service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:11.018420 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa4531-8784-46b7-ac4c-ab286d366f63 service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:11.018685 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa4531-8784-46b7-ac4c-ab286d366f63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:11.026589 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa4531-8784-46b7-ac4c-ab286d366f63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:44:11.028157 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa4531-8784-46b7-ac4c-ab286d366f63 service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:44:11.037819 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1044/2087] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:44:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:44:14.113896 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10055b-e3ae-40ac-9892-cde49679485b None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:14.114360 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10055b-e3ae-40ac-9892-cde49679485b None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:14.114452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10055b-e3ae-40ac-9892-cde49679485b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:14.133417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-de10055b-e3ae-40ac-9892-cde49679485b None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:44:14.134619 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-de10055b-e3ae-40ac-9892-cde49679485b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:14.142540 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1044/2088] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 20 14:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:44:14.158426 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa4531-8784-46b7-ac4c-ab286d366f63 service nova] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:44:14.169338 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa4531-8784-46b7-ac4c-ab286d366f63 service nova] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:44:14.175720 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67663c19-2a78-46bf-82af-207b3e9c9380 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:44:14.176320 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67663c19-2a78-46bf-82af-207b3e9c9380 service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:14.176596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67663c19-2a78-46bf-82af-207b3e9c9380 service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:14.176864 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67663c19-2a78-46bf-82af-207b3e9c9380 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:14.185280 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67663c19-2a78-46bf-82af-207b3e9c9380 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:44:14.187113 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67663c19-2a78-46bf-82af-207b3e9c9380 service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:44:14.196661 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1045/2089] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:44:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:44:24.128196 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=69,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:24.192253 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=59,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:32.439862 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c3008-5bab-46e7-af25-dd7bd19ba39d None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:32.440371 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c3008-5bab-46e7-af25-dd7bd19ba39d None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:32.440371 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c3008-5bab-46e7-af25-dd7bd19ba39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:32.460573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-412c3008-5bab-46e7-af25-dd7bd19ba39d None None] MFA Rules not processed for user `6445476af9cc4a8cae816cae680c2b1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:44:32.461754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-412c3008-5bab-46e7-af25-dd7bd19ba39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:32.514042 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1045/2090] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:44:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:44:42.507511 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=25 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:48.989561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629f827-4c96-4ddf-9554-85019152ad0a None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:48.990426 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629f827-4c96-4ddf-9554-85019152ad0a None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:48.990730 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629f827-4c96-4ddf-9554-85019152ad0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:49.012072 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-f629f827-4c96-4ddf-9554-85019152ad0a None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:44:49.013766 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-f629f827-4c96-4ddf-9554-85019152ad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:49.021976 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1046/2091] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 20 14:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:44:49.043798 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c3008-5bab-46e7-af25-dd7bd19ba39d None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:44:49.056980 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c3008-5bab-46e7-af25-dd7bd19ba39d None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:44:49.063683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfc645-42ab-48e3-92ca-22ce940c86ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:44:49.064243 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfc645-42ab-48e3-92ca-22ce940c86ce service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:49.064632 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfc645-42ab-48e3-92ca-22ce940c86ce service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:49.064805 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfc645-42ab-48e3-92ca-22ce940c86ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:49.074356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfc645-42ab-48e3-92ca-22ce940c86ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:44:49.075983 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfc645-42ab-48e3-92ca-22ce940c86ce service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:44:49.086876 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1046/2092] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:44:52.320111 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8a238-8c22-45b5-9c64-e690709b18fe None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:52.320649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8a238-8c22-45b5-9c64-e690709b18fe None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:52.320649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8a238-8c22-45b5-9c64-e690709b18fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:52.340254 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-e5c8a238-8c22-45b5-9c64-e690709b18fe None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:44:52.342093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e5c8a238-8c22-45b5-9c64-e690709b18fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:52.350469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1047/2093] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 20 14:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:44:52.364872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfc645-42ab-48e3-92ca-22ce940c86ce service nova] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:44:52.376257 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfc645-42ab-48e3-92ca-22ce940c86ce service nova] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:44:52.382806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0bbce-cd86-4bf9-b58c-2de185a76db0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:44:52.383434 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0bbce-cd86-4bf9-b58c-2de185a76db0 service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:52.383733 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0bbce-cd86-4bf9-b58c-2de185a76db0 service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:52.384026 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0bbce-cd86-4bf9-b58c-2de185a76db0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:52.393622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0bbce-cd86-4bf9-b58c-2de185a76db0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:44:52.395229 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0bbce-cd86-4bf9-b58c-2de185a76db0 service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:44:52.405361 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1047/2094] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:44:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:44:53.755378 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50284329-146a-4627-9293-88f00e07a983 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:53.755860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50284329-146a-4627-9293-88f00e07a983 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:53.755980 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50284329-146a-4627-9293-88f00e07a983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:53.774650 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-50284329-146a-4627-9293-88f00e07a983 None None] MFA Rules not processed for user `f6eeeea7a6e84461aa1945595c7bf398`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:44:53.775841 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-50284329-146a-4627-9293-88f00e07a983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:53.833995 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1048/2095] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:44:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:44:55.372131 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47bd29-ba8a-4266-846d-63a661a84f9e None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:55.373184 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47bd29-ba8a-4266-846d-63a661a84f9e None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:55.373313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47bd29-ba8a-4266-846d-63a661a84f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:55.394534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-ec47bd29-ba8a-4266-846d-63a661a84f9e None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:44:55.395729 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-ec47bd29-ba8a-4266-846d-63a661a84f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:55.403585 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1048/2096] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 20 14:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:44:55.418903 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50284329-146a-4627-9293-88f00e07a983 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:44:55.431857 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50284329-146a-4627-9293-88f00e07a983 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:44:55.437902 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c616f3-4473-4103-83ac-25a5b717a4f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:44:55.438525 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c616f3-4473-4103-83ac-25a5b717a4f1 service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:55.438798 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c616f3-4473-4103-83ac-25a5b717a4f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:55.439065 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c616f3-4473-4103-83ac-25a5b717a4f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:55.446962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c616f3-4473-4103-83ac-25a5b717a4f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:44:55.448530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c616f3-4473-4103-83ac-25a5b717a4f1 service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:44:55.457693 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1049/2097] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:44:58.521863 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615767f0-7c77-4d82-a7cf-4c0da45b141c None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:58.522398 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615767f0-7c77-4d82-a7cf-4c0da45b141c None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:58.522398 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615767f0-7c77-4d82-a7cf-4c0da45b141c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:58.543146 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-615767f0-7c77-4d82-a7cf-4c0da45b141c None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:44:58.544351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-615767f0-7c77-4d82-a7cf-4c0da45b141c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:44:58.553127 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1049/2098] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 20 14:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:44:58.568128 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c616f3-4473-4103-83ac-25a5b717a4f1 service nova] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:44:58.579566 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c616f3-4473-4103-83ac-25a5b717a4f1 service nova] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:44:58.584999 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb30532-1f16-426d-afcf-1cf9e00f6043 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:44:58.585593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb30532-1f16-426d-afcf-1cf9e00f6043 service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:44:58.585899 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb30532-1f16-426d-afcf-1cf9e00f6043 service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:44:58.586176 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb30532-1f16-426d-afcf-1cf9e00f6043 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:44:58.595310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb30532-1f16-426d-afcf-1cf9e00f6043 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:44:58.596916 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb30532-1f16-426d-afcf-1cf9e00f6043 service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:44:58.606672 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1050/2099] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:44:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:45:01.702727 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fe533-ae8d-455a-963c-5fed8c0f9415 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:01.703174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fe533-ae8d-455a-963c-5fed8c0f9415 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:01.703274 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fe533-ae8d-455a-963c-5fed8c0f9415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:01.722711 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-4b1fe533-ae8d-455a-963c-5fed8c0f9415 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:45:01.724101 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-4b1fe533-ae8d-455a-963c-5fed8c0f9415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:45:01.732551 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1050/2100] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 20 14:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:45:01.751268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb30532-1f16-426d-afcf-1cf9e00f6043 service nova] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:45:01.762683 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb30532-1f16-426d-afcf-1cf9e00f6043 service nova] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:45:01.768901 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba52ad-9ba8-4dc9-8fa8-2f541cc0a8db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:45:01.769494 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba52ad-9ba8-4dc9-8fa8-2f541cc0a8db service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:01.769776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba52ad-9ba8-4dc9-8fa8-2f541cc0a8db service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:01.770085 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba52ad-9ba8-4dc9-8fa8-2f541cc0a8db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:01.778166 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba52ad-9ba8-4dc9-8fa8-2f541cc0a8db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:45:01.779809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba52ad-9ba8-4dc9-8fa8-2f541cc0a8db service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:45:01.789355 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1051/2101] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:45:07.167900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03d8bb-d458-4300-b489-437561cc46bd None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:07.168424 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03d8bb-d458-4300-b489-437561cc46bd None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:07.168645 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03d8bb-d458-4300-b489-437561cc46bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:07.189208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-bf03d8bb-d458-4300-b489-437561cc46bd None None] MFA Rules not processed for user `ebadd4bd1ec1442789777438c6d16414`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:45:07.190478 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-bf03d8bb-d458-4300-b489-437561cc46bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:45:07.252598 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1051/2102] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:45:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:45:11.785242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=49 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:17.244001 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=46 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:22.143971 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd4ba9-1fbd-4d00-b88f-083a7c88ed86 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:22.144533 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd4ba9-1fbd-4d00-b88f-083a7c88ed86 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:22.144827 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd4ba9-1fbd-4d00-b88f-083a7c88ed86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:22.167559 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-61bd4ba9-1fbd-4d00-b88f-083a7c88ed86 None None] MFA Rules not processed for user `b5b9894a359c48dcbf10f55565191e39`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:45:22.169086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-61bd4ba9-1fbd-4d00-b88f-083a7c88ed86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:45:22.232992 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1052/2103] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:45:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:45:25.724030 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc421f-a824-43d7-926d-c638700bb621 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:25.724567 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc421f-a824-43d7-926d-c638700bb621 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:25.724567 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc421f-a824-43d7-926d-c638700bb621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:25.744388 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-96bc421f-a824-43d7-926d-c638700bb621 None None] MFA Rules not processed for user `a1bdbce1b3d047cfa5ddf72f902ecd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:45:25.746327 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-96bc421f-a824-43d7-926d-c638700bb621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:45:25.804790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1052/2104] 10.222.0.17 () {58 vars in 967 bytes} [Thu Oct 20 14:45:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:45:25.851607 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd4ba9-1fbd-4d00-b88f-083a7c88ed86 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:45:25.853124 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-61bd4ba9-1fbd-4d00-b88f-083a7c88ed86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:45:25.923603 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd4ba9-1fbd-4d00-b88f-083a7c88ed86 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:45:25.928495 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16565698-2da1-49bf-8ec1-455620dc7c6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60d62d14cd4042ab1bff5509e30f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:45:25.929102 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16565698-2da1-49bf-8ec1-455620dc7c6d service swift] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:25.929377 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16565698-2da1-49bf-8ec1-455620dc7c6d service swift] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:25.929644 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16565698-2da1-49bf-8ec1-455620dc7c6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:25.938593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16565698-2da1-49bf-8ec1-455620dc7c6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:45:25.940323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16565698-2da1-49bf-8ec1-455620dc7c6d service swift] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:45:25.949412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1053/2105] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Oct 20 14:45:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 14:45:30.547668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09924e13-2994-4bc0-ba6a-225f79375dfc None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:30.548249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09924e13-2994-4bc0-ba6a-225f79375dfc None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:30.548249 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09924e13-2994-4bc0-ba6a-225f79375dfc None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:30.549576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1053/2106] 10.222.0.17 () {54 vars in 921 bytes} [Thu Oct 20 14:45:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:45:30.576332 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf74484-ad8d-43ee-b2f0-cdc3f721c671 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:30.576878 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf74484-ad8d-43ee-b2f0-cdc3f721c671 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:30.576878 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf74484-ad8d-43ee-b2f0-cdc3f721c671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:30.601139 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-dcf74484-ad8d-43ee-b2f0-cdc3f721c671 None None] MFA Rules not processed for user `1e94a60e43914cf38a5f2f88b182083f`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:45:30.602400 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-dcf74484-ad8d-43ee-b2f0-cdc3f721c671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:45:30.690606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1054/2107] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Oct 20 14:45:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:45:30.701688 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09924e13-2994-4bc0-ba6a-225f79375dfc None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:45:30.703557 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-09924e13-2994-4bc0-ba6a-225f79375dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:45:30.721187 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09924e13-2994-4bc0-ba6a-225f79375dfc None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:45:30.726746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89485d24-7655-4f22-b06c-b494b54e12c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e94a60e43914cf38a5f2f88b182083f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:45:30.727434 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89485d24-7655-4f22-b06c-b494b54e12c4 service placement] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:30.727786 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89485d24-7655-4f22-b06c-b494b54e12c4 service placement] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:30.728273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89485d24-7655-4f22-b06c-b494b54e12c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:30.737615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89485d24-7655-4f22-b06c-b494b54e12c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:45:30.739450 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89485d24-7655-4f22-b06c-b494b54e12c4 service placement] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:45:30.750034 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1054/2108] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:45:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:45:34.243794 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf74484-ad8d-43ee-b2f0-cdc3f721c671 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:45:34.245551 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-dcf74484-ad8d-43ee-b2f0-cdc3f721c671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:45:34.260851 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf74484-ad8d-43ee-b2f0-cdc3f721c671 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:45:34.266027 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c22cf8-da95-4ebc-8f75-9a89b22fc13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:45:34.266910 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c22cf8-da95-4ebc-8f75-9a89b22fc13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:34.267186 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c22cf8-da95-4ebc-8f75-9a89b22fc13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:34.267455 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c22cf8-da95-4ebc-8f75-9a89b22fc13a admin admin] PATH_INFO: `/v3/users/df2faf19a5bd4030ab36271632fa3e44` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:34.268578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c22cf8-da95-4ebc-8f75-9a89b22fc13a admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2faf19a5bd4030ab36271632fa3e44)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:45:34.270547 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c22cf8-da95-4ebc-8f75-9a89b22fc13a admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:45:34.300812 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:34.325239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-96c22cf8-da95-4ebc-8f75-9a89b22fc13a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2faf19a5bd4030ab36271632fa3e44'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:34.334428 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-96c22cf8-da95-4ebc-8f75-9a89b22fc13a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2faf19a5bd4030ab36271632fa3e44'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:34.349087 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-96c22cf8-da95-4ebc-8f75-9a89b22fc13a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2faf19a5bd4030ab36271632fa3e44'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:34.349809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-96c22cf8-da95-4ebc-8f75-9a89b22fc13a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2faf19a5bd4030ab36271632fa3e44'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:34.357819 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-96c22cf8-da95-4ebc-8f75-9a89b22fc13a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2faf19a5bd4030ab36271632fa3e44'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:34.364129 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1055/2109] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:45:34 2022] DELETE /identity/v3/users/df2faf19a5bd4030ab36271632fa3e44 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:45:34.541293 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89485d24-7655-4f22-b06c-b494b54e12c4 service placement] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:45:34.553107 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89485d24-7655-4f22-b06c-b494b54e12c4 service placement] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:45:34.623781 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9c6bb-f5df-422f-8e76-d25f49aeb550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:45:34.624432 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9c6bb-f5df-422f-8e76-d25f49aeb550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:34.624802 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9c6bb-f5df-422f-8e76-d25f49aeb550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:34.625146 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9c6bb-f5df-422f-8e76-d25f49aeb550 admin admin] PATH_INFO: `/v3/projects/36c46080c95e4176bf6ff90b684c9f0b` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:34.626374 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9c6bb-f5df-422f-8e76-d25f49aeb550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36c46080c95e4176bf6ff90b684c9f0b)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:45:34.628379 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9c6bb-f5df-422f-8e76-d25f49aeb550 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:45:34.676450 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-83a9c6bb-f5df-422f-8e76-d25f49aeb550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c46080c95e4176bf6ff90b684c9f0b', 'request_id': 'req-83a9c6bb-f5df-422f-8e76-d25f49aeb550'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:34.684121 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-83a9c6bb-f5df-422f-8e76-d25f49aeb550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c46080c95e4176bf6ff90b684c9f0b', 'request_id': 'req-83a9c6bb-f5df-422f-8e76-d25f49aeb550'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:34.690352 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-83a9c6bb-f5df-422f-8e76-d25f49aeb550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c46080c95e4176bf6ff90b684c9f0b', 'request_id': 'req-83a9c6bb-f5df-422f-8e76-d25f49aeb550'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:34.703402 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-83a9c6bb-f5df-422f-8e76-d25f49aeb550 admin admin] The token cache is being invalidate because project 36c46080c95e4176bf6ff90b684c9f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:45:34.703700 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-83a9c6bb-f5df-422f-8e76-d25f49aeb550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:34.705115 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-83a9c6bb-f5df-422f-8e76-d25f49aeb550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:34.706678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1055/2110] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:45:34 2022] DELETE /identity/v3/projects/36c46080c95e4176bf6ff90b684c9f0b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:45:34.710786 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c22cf8-da95-4ebc-8f75-9a89b22fc13a admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:45:34.712287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-96c22cf8-da95-4ebc-8f75-9a89b22fc13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:45:34.725896 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c22cf8-da95-4ebc-8f75-9a89b22fc13a admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:45:34.795481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c1b26-9554-4e2f-86cd-01ec02a68140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:45:34.796185 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c1b26-9554-4e2f-86cd-01ec02a68140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:34.796600 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c1b26-9554-4e2f-86cd-01ec02a68140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:34.796975 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c1b26-9554-4e2f-86cd-01ec02a68140 admin admin] PATH_INFO: `/v3/users/6d30389ea7d2448597b280575266946c` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:34.798416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c1b26-9554-4e2f-86cd-01ec02a68140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d30389ea7d2448597b280575266946c)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:45:34.800911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c1b26-9554-4e2f-86cd-01ec02a68140 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:45:34.881124 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-946c1b26-9554-4e2f-86cd-01ec02a68140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d30389ea7d2448597b280575266946c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:34.888575 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-946c1b26-9554-4e2f-86cd-01ec02a68140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d30389ea7d2448597b280575266946c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:34.901344 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-946c1b26-9554-4e2f-86cd-01ec02a68140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d30389ea7d2448597b280575266946c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:34.902153 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-946c1b26-9554-4e2f-86cd-01ec02a68140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d30389ea7d2448597b280575266946c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:34.912485 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-946c1b26-9554-4e2f-86cd-01ec02a68140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d30389ea7d2448597b280575266946c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:34.926534 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1056/2111] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:45:34 2022] DELETE /identity/v3/users/6d30389ea7d2448597b280575266946c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:45:35.109555 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9c6bb-f5df-422f-8e76-d25f49aeb550 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:45:35.111335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-83a9c6bb-f5df-422f-8e76-d25f49aeb550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:45:35.127618 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9c6bb-f5df-422f-8e76-d25f49aeb550 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:45:35.153480 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:35.196786 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a2b0c-1fbc-4480-84d1-0000ce6894e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:45:35.197536 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a2b0c-1fbc-4480-84d1-0000ce6894e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:35.197946 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a2b0c-1fbc-4480-84d1-0000ce6894e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:35.198350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a2b0c-1fbc-4480-84d1-0000ce6894e0 admin admin] PATH_INFO: `/v3/projects/cc3558f144fb46738c0e6b5a5ba67b21` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:35.199503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a2b0c-1fbc-4480-84d1-0000ce6894e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc3558f144fb46738c0e6b5a5ba67b21)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:45:35.201423 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a2b0c-1fbc-4480-84d1-0000ce6894e0 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:45:35.249161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ab4a2b0c-1fbc-4480-84d1-0000ce6894e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc3558f144fb46738c0e6b5a5ba67b21', 'request_id': 'req-ab4a2b0c-1fbc-4480-84d1-0000ce6894e0'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:35.256973 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ab4a2b0c-1fbc-4480-84d1-0000ce6894e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc3558f144fb46738c0e6b5a5ba67b21', 'request_id': 'req-ab4a2b0c-1fbc-4480-84d1-0000ce6894e0'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:35.264550 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ab4a2b0c-1fbc-4480-84d1-0000ce6894e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc3558f144fb46738c0e6b5a5ba67b21', 'request_id': 'req-ab4a2b0c-1fbc-4480-84d1-0000ce6894e0'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:35.276277 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ab4a2b0c-1fbc-4480-84d1-0000ce6894e0 admin admin] The token cache is being invalidate because project cc3558f144fb46738c0e6b5a5ba67b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:45:35.276750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ab4a2b0c-1fbc-4480-84d1-0000ce6894e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:35.277367 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ab4a2b0c-1fbc-4480-84d1-0000ce6894e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:35.278886 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1056/2112] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:45:35 2022] DELETE /identity/v3/projects/cc3558f144fb46738c0e6b5a5ba67b21 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:45:36.486745 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c1b26-9554-4e2f-86cd-01ec02a68140 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:45:36.488317 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-946c1b26-9554-4e2f-86cd-01ec02a68140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:45:36.504366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c1b26-9554-4e2f-86cd-01ec02a68140 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:45:36.525244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:36.568578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec27338-872f-44a4-a692-2077329bf992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:45:36.569218 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec27338-872f-44a4-a692-2077329bf992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:36.569498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec27338-872f-44a4-a692-2077329bf992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:36.569773 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec27338-872f-44a4-a692-2077329bf992 admin admin] PATH_INFO: `/v3/users/6445476af9cc4a8cae816cae680c2b1c` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:36.570917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec27338-872f-44a4-a692-2077329bf992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6445476af9cc4a8cae816cae680c2b1c)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:45:36.573370 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec27338-872f-44a4-a692-2077329bf992 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:45:36.617997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-4ec27338-872f-44a4-a692-2077329bf992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6445476af9cc4a8cae816cae680c2b1c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:36.624761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-4ec27338-872f-44a4-a692-2077329bf992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6445476af9cc4a8cae816cae680c2b1c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:36.637653 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-4ec27338-872f-44a4-a692-2077329bf992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6445476af9cc4a8cae816cae680c2b1c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:36.638345 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-4ec27338-872f-44a4-a692-2077329bf992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6445476af9cc4a8cae816cae680c2b1c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:36.645278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-4ec27338-872f-44a4-a692-2077329bf992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6445476af9cc4a8cae816cae680c2b1c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:36.651686 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1057/2113] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:45:36 2022] DELETE /identity/v3/users/6445476af9cc4a8cae816cae680c2b1c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:45:36.825820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a2b0c-1fbc-4480-84d1-0000ce6894e0 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:45:36.827273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-ab4a2b0c-1fbc-4480-84d1-0000ce6894e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:45:36.840317 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a2b0c-1fbc-4480-84d1-0000ce6894e0 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:45:36.898606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1ab16-2271-42e5-afc3-ea6e6d0c97cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:45:36.899231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1ab16-2271-42e5-afc3-ea6e6d0c97cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:36.899512 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1ab16-2271-42e5-afc3-ea6e6d0c97cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:36.899785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1ab16-2271-42e5-afc3-ea6e6d0c97cb admin admin] PATH_INFO: `/v3/projects/e9a8a9257a0d455cb2480dabd2ce8ea2` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:36.901505 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1ab16-2271-42e5-afc3-ea6e6d0c97cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a8a9257a0d455cb2480dabd2ce8ea2)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:45:36.903455 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1ab16-2271-42e5-afc3-ea6e6d0c97cb admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:45:36.951457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-71b1ab16-2271-42e5-afc3-ea6e6d0c97cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a8a9257a0d455cb2480dabd2ce8ea2', 'request_id': 'req-71b1ab16-2271-42e5-afc3-ea6e6d0c97cb'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:36.954980 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:36.958293 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-71b1ab16-2271-42e5-afc3-ea6e6d0c97cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a8a9257a0d455cb2480dabd2ce8ea2', 'request_id': 'req-71b1ab16-2271-42e5-afc3-ea6e6d0c97cb'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:36.964898 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-71b1ab16-2271-42e5-afc3-ea6e6d0c97cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a8a9257a0d455cb2480dabd2ce8ea2', 'request_id': 'req-71b1ab16-2271-42e5-afc3-ea6e6d0c97cb'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:36.976932 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-71b1ab16-2271-42e5-afc3-ea6e6d0c97cb admin admin] The token cache is being invalidate because project e9a8a9257a0d455cb2480dabd2ce8ea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:45:36.977214 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-71b1ab16-2271-42e5-afc3-ea6e6d0c97cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:36.977858 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-71b1ab16-2271-42e5-afc3-ea6e6d0c97cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:36.979586 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1057/2114] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:45:36 2022] DELETE /identity/v3/projects/e9a8a9257a0d455cb2480dabd2ce8ea2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:45:36.984583 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0a1ea-e45c-416d-a506-2b144c56a996 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:36.984865 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0a1ea-e45c-416d-a506-2b144c56a996 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:36.985132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0a1ea-e45c-416d-a506-2b144c56a996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:37.004912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-6aa0a1ea-e45c-416d-a506-2b144c56a996 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:45:37.006061 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-6aa0a1ea-e45c-416d-a506-2b144c56a996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:45:37.064213 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1058/2115] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:45:37.072455 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ce120-67d2-499f-aae6-f80d05901e41 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:37.072743 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ce120-67d2-499f-aae6-f80d05901e41 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:37.073018 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ce120-67d2-499f-aae6-f80d05901e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:37.092472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-e14ce120-67d2-499f-aae6-f80d05901e41 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:45:37.093671 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e14ce120-67d2-499f-aae6-f80d05901e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:45:37.101585 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1058/2116] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:45:37.106365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0a1ea-e45c-416d-a506-2b144c56a996 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:45:37.116025 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0a1ea-e45c-416d-a506-2b144c56a996 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:45:37.121295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d16464-2419-4174-863e-20cbf1c494a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:45:37.121924 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d16464-2419-4174-863e-20cbf1c494a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:37.122209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d16464-2419-4174-863e-20cbf1c494a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:37.122483 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d16464-2419-4174-863e-20cbf1c494a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:37.123131 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d16464-2419-4174-863e-20cbf1c494a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:45:37.123432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d16464-2419-4174-863e-20cbf1c494a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:45:37.125039 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d16464-2419-4174-863e-20cbf1c494a1 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:45:37.136817 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1059/2117] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:45:37.141018 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ce120-67d2-499f-aae6-f80d05901e41 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:45:37.150672 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ce120-67d2-499f-aae6-f80d05901e41 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:45:37.155894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a62209-57d8-4756-a711-625cf2e3cd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:45:37.156478 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a62209-57d8-4756-a711-625cf2e3cd29 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:37.157012 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a62209-57d8-4756-a711-625cf2e3cd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:37.157282 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a62209-57d8-4756-a711-625cf2e3cd29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:37.158223 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a62209-57d8-4756-a711-625cf2e3cd29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:45:37.160149 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a62209-57d8-4756-a711-625cf2e3cd29 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:45:37.189463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1059/2118] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:45:37 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:45:37.193811 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d16464-2419-4174-863e-20cbf1c494a1 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:45:37.203857 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d16464-2419-4174-863e-20cbf1c494a1 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:45:37.229311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:37.261456 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22623f57-c0b1-40a0-8642-4665d32f45d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:45:37.262024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22623f57-c0b1-40a0-8642-4665d32f45d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:37.262305 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22623f57-c0b1-40a0-8642-4665d32f45d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:37.262577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22623f57-c0b1-40a0-8642-4665d32f45d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:37.263201 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22623f57-c0b1-40a0-8642-4665d32f45d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:45:37.265120 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22623f57-c0b1-40a0-8642-4665d32f45d9 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:45:37.285917 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1060/2119] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:45:37 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:45:37.290404 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a62209-57d8-4756-a711-625cf2e3cd29 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:45:37.300581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a62209-57d8-4756-a711-625cf2e3cd29 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:45:37.305101 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12341e0f-b64a-47fe-b8dc-3117c305701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:45:37.305691 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12341e0f-b64a-47fe-b8dc-3117c305701c admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:37.306018 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12341e0f-b64a-47fe-b8dc-3117c305701c admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:37.306292 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12341e0f-b64a-47fe-b8dc-3117c305701c admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:37.306978 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12341e0f-b64a-47fe-b8dc-3117c305701c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:45:37.308620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12341e0f-b64a-47fe-b8dc-3117c305701c admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:45:37.318313 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1060/2120] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:45:37.322160 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22623f57-c0b1-40a0-8642-4665d32f45d9 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:45:37.332439 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22623f57-c0b1-40a0-8642-4665d32f45d9 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:45:37.336931 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808185dd-7cfb-402a-a4b9-365c0e1f5bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:45:37.337524 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808185dd-7cfb-402a-a4b9-365c0e1f5bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:37.337798 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808185dd-7cfb-402a-a4b9-365c0e1f5bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:37.338159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808185dd-7cfb-402a-a4b9-365c0e1f5bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:37.339447 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808185dd-7cfb-402a-a4b9-365c0e1f5bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:45:37.341032 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808185dd-7cfb-402a-a4b9-365c0e1f5bd3 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:45:37.350619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1061/2121] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:45:37.354752 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12341e0f-b64a-47fe-b8dc-3117c305701c admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:45:37.364417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12341e0f-b64a-47fe-b8dc-3117c305701c admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:45:37.368957 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4488d5-ffc2-4dc8-8e99-b8baca546c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:45:37.369773 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4488d5-ffc2-4dc8-8e99-b8baca546c43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:37.370096 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4488d5-ffc2-4dc8-8e99-b8baca546c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:37.370373 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4488d5-ffc2-4dc8-8e99-b8baca546c43 admin admin] PATH_INFO: `/v3/projects/2884209aa08b456cbf0f1a0e6ae66f6f/users/a37a082e09f744598e274c9d86137f0b/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:37.385588 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4488d5-ffc2-4dc8-8e99-b8baca546c43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2884209aa08b456cbf0f1a0e6ae66f6f, user_id=a37a082e09f744598e274c9d86137f0b, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:45:37.388271 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4488d5-ffc2-4dc8-8e99-b8baca546c43 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:45:37.400954 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1061/2122] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:45:37 2022] PUT /identity/v3/projects/2884209aa08b456cbf0f1a0e6ae66f6f/users/a37a082e09f744598e274c9d86137f0b/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:45:37.411308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75fd5f-bcbb-4a7a-9fad-c687ecae3f44 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:37.411591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75fd5f-bcbb-4a7a-9fad-c687ecae3f44 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:37.411864 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75fd5f-bcbb-4a7a-9fad-c687ecae3f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:37.440222 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-0a75fd5f-bcbb-4a7a-9fad-c687ecae3f44 None None] MFA Rules not processed for user `a37a082e09f744598e274c9d86137f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:45:37.441417 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-0a75fd5f-bcbb-4a7a-9fad-c687ecae3f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:45:37.505658 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1062/2123] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:45:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:45:37.517030 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4488d5-ffc2-4dc8-8e99-b8baca546c43 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:45:37.518663 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-af4488d5-ffc2-4dc8-8e99-b8baca546c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:45:37.575507 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4488d5-ffc2-4dc8-8e99-b8baca546c43 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:45:37.579037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37cf36-7bb7-4210-9193-69bcd661e641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:45:37.579628 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37cf36-7bb7-4210-9193-69bcd661e641 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:37.579904 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37cf36-7bb7-4210-9193-69bcd661e641 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:37.580173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37cf36-7bb7-4210-9193-69bcd661e641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:37.588687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37cf36-7bb7-4210-9193-69bcd661e641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:45:37.590121 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37cf36-7bb7-4210-9193-69bcd661e641 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:45:37.599208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1062/2124] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:45:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:45:47.502873 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:47.594737 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=59,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:47.661958 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75fd5f-bcbb-4a7a-9fad-c687ecae3f44 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:45:47.721234 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75fd5f-bcbb-4a7a-9fad-c687ecae3f44 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:45:47.725598 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285347b-6e51-4f30-9c33-cf918f8fa067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:45:47.726245 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285347b-6e51-4f30-9c33-cf918f8fa067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:47.726515 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285347b-6e51-4f30-9c33-cf918f8fa067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:47.726780 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285347b-6e51-4f30-9c33-cf918f8fa067 admin admin] PATH_INFO: `/v3/users/a37a082e09f744598e274c9d86137f0b` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:47.727862 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285347b-6e51-4f30-9c33-cf918f8fa067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a37a082e09f744598e274c9d86137f0b)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:45:47.730571 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285347b-6e51-4f30-9c33-cf918f8fa067 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:45:47.775920 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b285347b-6e51-4f30-9c33-cf918f8fa067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a37a082e09f744598e274c9d86137f0b'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:47.783477 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b285347b-6e51-4f30-9c33-cf918f8fa067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a37a082e09f744598e274c9d86137f0b'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:47.795561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b285347b-6e51-4f30-9c33-cf918f8fa067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a37a082e09f744598e274c9d86137f0b'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:47.796228 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b285347b-6e51-4f30-9c33-cf918f8fa067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a37a082e09f744598e274c9d86137f0b'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:47.803285 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b285347b-6e51-4f30-9c33-cf918f8fa067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a37a082e09f744598e274c9d86137f0b'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:47.809199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1063/2125] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:45:47 2022] DELETE /identity/v3/users/a37a082e09f744598e274c9d86137f0b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:45:47.813912 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc1575-8729-4970-b2fd-a6643ba18c71 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:47.814300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc1575-8729-4970-b2fd-a6643ba18c71 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:47.814634 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc1575-8729-4970-b2fd-a6643ba18c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:47.833290 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-76fc1575-8729-4970-b2fd-a6643ba18c71 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:45:47.834517 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-76fc1575-8729-4970-b2fd-a6643ba18c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:45:47.893500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1063/2126] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:45:47.903884 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285347b-6e51-4f30-9c33-cf918f8fa067 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:45:47.905282 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b285347b-6e51-4f30-9c33-cf918f8fa067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:45:47.961498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285347b-6e51-4f30-9c33-cf918f8fa067 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:45:47.965725 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238702c0-65ff-41dd-9bc2-738a54a49e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:45:47.966354 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238702c0-65ff-41dd-9bc2-738a54a49e29 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:47.966637 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238702c0-65ff-41dd-9bc2-738a54a49e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:47.966907 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238702c0-65ff-41dd-9bc2-738a54a49e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:47.975688 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238702c0-65ff-41dd-9bc2-738a54a49e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:45:47.977135 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238702c0-65ff-41dd-9bc2-738a54a49e29 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:45:47.986493 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1064/2127] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:45:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:45:48.255113 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc1575-8729-4970-b2fd-a6643ba18c71 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:45:48.256656 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-76fc1575-8729-4970-b2fd-a6643ba18c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:45:48.268825 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc1575-8729-4970-b2fd-a6643ba18c71 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:45:48.273769 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14033427-0317-48fa-90f5-db9556168156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:45:48.274429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14033427-0317-48fa-90f5-db9556168156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:45:48.274708 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14033427-0317-48fa-90f5-db9556168156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:45:48.274985 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14033427-0317-48fa-90f5-db9556168156 admin admin] PATH_INFO: `/v3/projects/2884209aa08b456cbf0f1a0e6ae66f6f` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:45:48.276103 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14033427-0317-48fa-90f5-db9556168156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2884209aa08b456cbf0f1a0e6ae66f6f)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:45:48.278541 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14033427-0317-48fa-90f5-db9556168156 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:45:48.325231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-14033427-0317-48fa-90f5-db9556168156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2884209aa08b456cbf0f1a0e6ae66f6f', 'request_id': 'req-14033427-0317-48fa-90f5-db9556168156'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:48.332458 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-14033427-0317-48fa-90f5-db9556168156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2884209aa08b456cbf0f1a0e6ae66f6f', 'request_id': 'req-14033427-0317-48fa-90f5-db9556168156'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:48.337915 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-14033427-0317-48fa-90f5-db9556168156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2884209aa08b456cbf0f1a0e6ae66f6f', 'request_id': 'req-14033427-0317-48fa-90f5-db9556168156'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:48.349015 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-14033427-0317-48fa-90f5-db9556168156 admin admin] The token cache is being invalidate because project 2884209aa08b456cbf0f1a0e6ae66f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:45:48.349296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-14033427-0317-48fa-90f5-db9556168156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:48.349935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-14033427-0317-48fa-90f5-db9556168156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:45:48.351389 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1064/2128] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:45:48 2022] DELETE /identity/v3/projects/2884209aa08b456cbf0f1a0e6ae66f6f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:45:57.982368 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:58.346026 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:00.335151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238702c0-65ff-41dd-9bc2-738a54a49e29 service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:00.336688 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-238702c0-65ff-41dd-9bc2-738a54a49e29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:00.351208 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238702c0-65ff-41dd-9bc2-738a54a49e29 service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:00.426985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d705d-77fa-479a-8929-cd962da2281b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:00.427659 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d705d-77fa-479a-8929-cd962da2281b service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:00.427943 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d705d-77fa-479a-8929-cd962da2281b service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:00.428217 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d705d-77fa-479a-8929-cd962da2281b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:00.430237 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-248d705d-77fa-479a-8929-cd962da2281b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:00.525068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d705d-77fa-479a-8929-cd962da2281b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:00.527184 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d705d-77fa-479a-8929-cd962da2281b service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:00.543786 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1065/2129] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:46:00.617030 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14033427-0317-48fa-90f5-db9556168156 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:00.618400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-14033427-0317-48fa-90f5-db9556168156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:00.633309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14033427-0317-48fa-90f5-db9556168156 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:00.638531 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd9fc2-4b35-4127-bb6e-8c3ca173a527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:00.639207 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd9fc2-4b35-4127-bb6e-8c3ca173a527 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:00.639905 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd9fc2-4b35-4127-bb6e-8c3ca173a527 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:00.639905 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd9fc2-4b35-4127-bb6e-8c3ca173a527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:00.641769 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-81cd9fc2-4b35-4127-bb6e-8c3ca173a527 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:00.656373 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd9fc2-4b35-4127-bb6e-8c3ca173a527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:00.657960 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd9fc2-4b35-4127-bb6e-8c3ca173a527 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:00.673955 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1065/2130] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:46:10.537416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=54 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:10.664838 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=6 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:13.674857 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316b05f-ee9c-4bd2-8e04-d962ce246e0d None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:13.675313 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316b05f-ee9c-4bd2-8e04-d962ce246e0d None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:13.675428 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316b05f-ee9c-4bd2-8e04-d962ce246e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:13.696882 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-a316b05f-ee9c-4bd2-8e04-d962ce246e0d None None] MFA Rules not processed for user `a1bdbce1b3d047cfa5ddf72f902ecd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:13.698978 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a316b05f-ee9c-4bd2-8e04-d962ce246e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:13.763596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1066/2131] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Oct 20 14:46:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:46:13.777949 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd9fc2-4b35-4127-bb6e-8c3ca173a527 service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:13.779454 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-81cd9fc2-4b35-4127-bb6e-8c3ca173a527 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:13.864187 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd9fc2-4b35-4127-bb6e-8c3ca173a527 service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:13.870061 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d5e65-0d87-4a40-8086-f48b8fef599d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60d62d14cd4042ab1bff5509e30f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:13.870795 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d5e65-0d87-4a40-8086-f48b8fef599d service swift] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:13.871073 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d5e65-0d87-4a40-8086-f48b8fef599d service swift] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:13.871358 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d5e65-0d87-4a40-8086-f48b8fef599d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:13.879634 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d5e65-0d87-4a40-8086-f48b8fef599d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:13.881209 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d5e65-0d87-4a40-8086-f48b8fef599d service swift] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:13.889931 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1066/2132] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Oct 20 14:46:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 14:46:15.434776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316b05f-ee9c-4bd2-8e04-d962ce246e0d None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:15.436442 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a316b05f-ee9c-4bd2-8e04-d962ce246e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:15.449155 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316b05f-ee9c-4bd2-8e04-d962ce246e0d None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:15.453270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebbe60-7839-4edc-9b4f-df2d29c05f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:15.453991 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebbe60-7839-4edc-9b4f-df2d29c05f39 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:15.456786 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebbe60-7839-4edc-9b4f-df2d29c05f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:15.456786 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebbe60-7839-4edc-9b4f-df2d29c05f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:15.458264 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ecebbe60-7839-4edc-9b4f-df2d29c05f39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:15.534538 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebbe60-7839-4edc-9b4f-df2d29c05f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:15.535985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebbe60-7839-4edc-9b4f-df2d29c05f39 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:15.547761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1067/2133] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:46:15.800944 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d5e65-0d87-4a40-8086-f48b8fef599d service swift] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:15.802298 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-3c9d5e65-0d87-4a40-8086-f48b8fef599d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:15.820743 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d5e65-0d87-4a40-8086-f48b8fef599d service swift] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:15.827355 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d69d00-ef3b-4738-ab13-8587f5f94129 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:15.827968 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d69d00-ef3b-4738-ab13-8587f5f94129 service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:15.828505 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d69d00-ef3b-4738-ab13-8587f5f94129 service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:15.828776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d69d00-ef3b-4738-ab13-8587f5f94129 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:15.832196 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-88d69d00-ef3b-4738-ab13-8587f5f94129 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:15.954908 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d69d00-ef3b-4738-ab13-8587f5f94129 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:15.956518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d69d00-ef3b-4738-ab13-8587f5f94129 service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:15.970079 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1067/2134] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:46:20.323126 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebbe60-7839-4edc-9b4f-df2d29c05f39 service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:20.324843 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ecebbe60-7839-4edc-9b4f-df2d29c05f39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:20.346994 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebbe60-7839-4edc-9b4f-df2d29c05f39 service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:20.353186 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797e517-3a68-42d7-bc73-84271a393256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:20.354913 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797e517-3a68-42d7-bc73-84271a393256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:20.354913 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797e517-3a68-42d7-bc73-84271a393256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:20.355288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797e517-3a68-42d7-bc73-84271a393256 admin admin] PATH_INFO: `/v3/users/ebadd4bd1ec1442789777438c6d16414` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:20.356621 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797e517-3a68-42d7-bc73-84271a393256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebadd4bd1ec1442789777438c6d16414)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:20.359502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797e517-3a68-42d7-bc73-84271a393256 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:20.421983 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-a797e517-3a68-42d7-bc73-84271a393256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebadd4bd1ec1442789777438c6d16414'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:20.429013 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-a797e517-3a68-42d7-bc73-84271a393256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebadd4bd1ec1442789777438c6d16414'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:20.450023 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-a797e517-3a68-42d7-bc73-84271a393256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebadd4bd1ec1442789777438c6d16414'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:20.451103 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-a797e517-3a68-42d7-bc73-84271a393256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebadd4bd1ec1442789777438c6d16414'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:20.497273 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-a797e517-3a68-42d7-bc73-84271a393256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebadd4bd1ec1442789777438c6d16414'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:20.503952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1068/2135] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:46:20 2022] DELETE /identity/v3/users/ebadd4bd1ec1442789777438c6d16414 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:20.716216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d69d00-ef3b-4738-ab13-8587f5f94129 service nova] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:20.745104 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d69d00-ef3b-4738-ab13-8587f5f94129 service nova] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:20.839654 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e2879-f0b4-4e71-8fa4-9a9c58ca9864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:20.840462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e2879-f0b4-4e71-8fa4-9a9c58ca9864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:20.840857 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e2879-f0b4-4e71-8fa4-9a9c58ca9864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:20.841302 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e2879-f0b4-4e71-8fa4-9a9c58ca9864 admin admin] PATH_INFO: `/v3/projects/e5e30a880ba54c91ae5be5b86b6b7be9` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:20.842803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e2879-f0b4-4e71-8fa4-9a9c58ca9864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5e30a880ba54c91ae5be5b86b6b7be9)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:20.845363 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e2879-f0b4-4e71-8fa4-9a9c58ca9864 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:20.911283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:20.953796 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-739e2879-f0b4-4e71-8fa4-9a9c58ca9864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5e30a880ba54c91ae5be5b86b6b7be9', 'request_id': 'req-739e2879-f0b4-4e71-8fa4-9a9c58ca9864'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:20.966280 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-739e2879-f0b4-4e71-8fa4-9a9c58ca9864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5e30a880ba54c91ae5be5b86b6b7be9', 'request_id': 'req-739e2879-f0b4-4e71-8fa4-9a9c58ca9864'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:20.983785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-739e2879-f0b4-4e71-8fa4-9a9c58ca9864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5e30a880ba54c91ae5be5b86b6b7be9', 'request_id': 'req-739e2879-f0b4-4e71-8fa4-9a9c58ca9864'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:21.009660 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-739e2879-f0b4-4e71-8fa4-9a9c58ca9864 admin admin] The token cache is being invalidate because project e5e30a880ba54c91ae5be5b86b6b7be9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:46:21.010675 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-739e2879-f0b4-4e71-8fa4-9a9c58ca9864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:21.011372 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-739e2879-f0b4-4e71-8fa4-9a9c58ca9864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:21.013342 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1068/2136] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:46:20 2022] DELETE /identity/v3/projects/e5e30a880ba54c91ae5be5b86b6b7be9 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:21.020844 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b1bf5-cb9e-4139-bdf7-2f3af7b1cbfe None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:21.021133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b1bf5-cb9e-4139-bdf7-2f3af7b1cbfe None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:21.021404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b1bf5-cb9e-4139-bdf7-2f3af7b1cbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:21.047764 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-113b1bf5-cb9e-4139-bdf7-2f3af7b1cbfe None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:21.049431 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-113b1bf5-cb9e-4139-bdf7-2f3af7b1cbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:21.057528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:21.138533 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1069/2137] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:46:21.146288 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074224b5-80d3-49b3-a4ed-7e0d3805ac4d None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:21.147160 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074224b5-80d3-49b3-a4ed-7e0d3805ac4d None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:21.147511 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074224b5-80d3-49b3-a4ed-7e0d3805ac4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:21.197066 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-074224b5-80d3-49b3-a4ed-7e0d3805ac4d None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:21.197066 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-074224b5-80d3-49b3-a4ed-7e0d3805ac4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:21.212628 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1069/2138] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:46:21.216753 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b1bf5-cb9e-4139-bdf7-2f3af7b1cbfe None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:21.227514 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b1bf5-cb9e-4139-bdf7-2f3af7b1cbfe None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:21.233286 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ff17c-a9af-4eb8-b493-0239f893bc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:21.234050 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ff17c-a9af-4eb8-b493-0239f893bc4a admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:21.234419 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ff17c-a9af-4eb8-b493-0239f893bc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:21.234712 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ff17c-a9af-4eb8-b493-0239f893bc4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:21.235393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ff17c-a9af-4eb8-b493-0239f893bc4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:46:21.235696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ff17c-a9af-4eb8-b493-0239f893bc4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:21.237354 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ff17c-a9af-4eb8-b493-0239f893bc4a admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:21.253893 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1070/2139] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:46:21.257239 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074224b5-80d3-49b3-a4ed-7e0d3805ac4d None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:21.277782 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074224b5-80d3-49b3-a4ed-7e0d3805ac4d None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:21.284065 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60621736-52a6-45c5-be5f-329bd3abf6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:21.285820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60621736-52a6-45c5-be5f-329bd3abf6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:21.286330 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60621736-52a6-45c5-be5f-329bd3abf6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:21.286896 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60621736-52a6-45c5-be5f-329bd3abf6d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:21.288450 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60621736-52a6-45c5-be5f-329bd3abf6d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:21.291725 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60621736-52a6-45c5-be5f-329bd3abf6d4 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:21.349671 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1070/2140] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:46:21 2022] POST /identity/v3/projects => generated 405 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:46:21.355052 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ff17c-a9af-4eb8-b493-0239f893bc4a admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:21.365424 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ff17c-a9af-4eb8-b493-0239f893bc4a admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:21.441252 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc47369-3a15-4fad-bf37-ea258bfd86df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:21.441955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc47369-3a15-4fad-bf37-ea258bfd86df admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:21.442346 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc47369-3a15-4fad-bf37-ea258bfd86df admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:21.443094 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc47369-3a15-4fad-bf37-ea258bfd86df admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:21.445645 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc47369-3a15-4fad-bf37-ea258bfd86df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:21.448249 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc47369-3a15-4fad-bf37-ea258bfd86df admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:21.473398 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1071/2141] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:46:21 2022] POST /identity/v3/users => generated 303 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:46:21.477654 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60621736-52a6-45c5-be5f-329bd3abf6d4 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:21.492005 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60621736-52a6-45c5-be5f-329bd3abf6d4 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:21.498142 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2164184-62ae-4dd1-b539-121c729e4e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:21.499157 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2164184-62ae-4dd1-b539-121c729e4e41 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:21.499545 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2164184-62ae-4dd1-b539-121c729e4e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:21.499920 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2164184-62ae-4dd1-b539-121c729e4e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:21.500635 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2164184-62ae-4dd1-b539-121c729e4e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:21.502479 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2164184-62ae-4dd1-b539-121c729e4e41 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:21.517274 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1071/2142] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:46:21.519821 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc47369-3a15-4fad-bf37-ea258bfd86df admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:21.537067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc47369-3a15-4fad-bf37-ea258bfd86df admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:21.545175 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbc69b-0508-4189-b7ae-fa760b7b2215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:21.545754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbc69b-0508-4189-b7ae-fa760b7b2215 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:21.546086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbc69b-0508-4189-b7ae-fa760b7b2215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:21.546360 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbc69b-0508-4189-b7ae-fa760b7b2215 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:21.547011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbc69b-0508-4189-b7ae-fa760b7b2215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:21.548646 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbc69b-0508-4189-b7ae-fa760b7b2215 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:21.561506 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1072/2143] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:46:21.566939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2164184-62ae-4dd1-b539-121c729e4e41 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:21.580106 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2164184-62ae-4dd1-b539-121c729e4e41 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:21.584986 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc4343-6b76-43ba-8351-7a25ce60d036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:21.585719 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc4343-6b76-43ba-8351-7a25ce60d036 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:21.586105 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc4343-6b76-43ba-8351-7a25ce60d036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:21.586391 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc4343-6b76-43ba-8351-7a25ce60d036 admin admin] PATH_INFO: `/v3/projects/31b84a5d99bf40aea811f16204908b91/users/66b84938166f4ac9aac2ba131fa3f28a/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:21.603050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc4343-6b76-43ba-8351-7a25ce60d036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b84a5d99bf40aea811f16204908b91, user_id=66b84938166f4ac9aac2ba131fa3f28a, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:21.606490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc4343-6b76-43ba-8351-7a25ce60d036 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:21.623593 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1072/2144] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:46:21 2022] PUT /identity/v3/projects/31b84a5d99bf40aea811f16204908b91/users/66b84938166f4ac9aac2ba131fa3f28a/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:46:21.636299 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084079fc-4873-444a-b566-11ac149c2d49 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:21.636587 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084079fc-4873-444a-b566-11ac149c2d49 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:21.636921 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084079fc-4873-444a-b566-11ac149c2d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:21.668886 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-084079fc-4873-444a-b566-11ac149c2d49 None None] MFA Rules not processed for user `66b84938166f4ac9aac2ba131fa3f28a`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:21.672368 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-084079fc-4873-444a-b566-11ac149c2d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:21.757095 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1073/2145] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:21 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:21.762745 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc4343-6b76-43ba-8351-7a25ce60d036 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:21.844128 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc4343-6b76-43ba-8351-7a25ce60d036 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:21.850912 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7d40a-8d86-474e-b1e6-be070f2decbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:21.852954 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7d40a-8d86-474e-b1e6-be070f2decbb admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:21.853240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7d40a-8d86-474e-b1e6-be070f2decbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:21.854355 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7d40a-8d86-474e-b1e6-be070f2decbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:21.855005 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7d40a-8d86-474e-b1e6-be070f2decbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:21.857128 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7d40a-8d86-474e-b1e6-be070f2decbb admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:21.914576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1073/2146] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:46:21 2022] POST /identity/v3/projects => generated 403 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:46:21.918999 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084079fc-4873-444a-b566-11ac149c2d49 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:21.933908 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084079fc-4873-444a-b566-11ac149c2d49 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:21.944100 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:22.006757 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c537af3-2394-4b2a-bf18-2bfd2847a8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:22.007378 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c537af3-2394-4b2a-bf18-2bfd2847a8ab admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:22.007665 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c537af3-2394-4b2a-bf18-2bfd2847a8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:22.008193 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c537af3-2394-4b2a-bf18-2bfd2847a8ab admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:22.008831 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c537af3-2394-4b2a-bf18-2bfd2847a8ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:22.010903 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c537af3-2394-4b2a-bf18-2bfd2847a8ab admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:22.042709 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1074/2147] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:46:21 2022] POST /identity/v3/users => generated 308 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:46:22.044172 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7d40a-8d86-474e-b1e6-be070f2decbb admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:22.058196 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7d40a-8d86-474e-b1e6-be070f2decbb admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:22.063242 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c7f2c-a201-40de-943c-0bcfa497c447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:22.063920 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c7f2c-a201-40de-943c-0bcfa497c447 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:22.064197 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c7f2c-a201-40de-943c-0bcfa497c447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:22.064468 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c7f2c-a201-40de-943c-0bcfa497c447 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:22.065107 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c7f2c-a201-40de-943c-0bcfa497c447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:22.067372 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c7f2c-a201-40de-943c-0bcfa497c447 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:22.082352 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1074/2148] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:46:22.086651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c537af3-2394-4b2a-bf18-2bfd2847a8ab admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:22.109614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c537af3-2394-4b2a-bf18-2bfd2847a8ab admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:22.116144 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a859ef4-28f2-4ed0-a569-8612b270c62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:22.116833 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a859ef4-28f2-4ed0-a569-8612b270c62e admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:22.117092 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a859ef4-28f2-4ed0-a569-8612b270c62e admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:22.117359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a859ef4-28f2-4ed0-a569-8612b270c62e admin admin] PATH_INFO: `/v3/projects/318126fbaba24b3abceecae1b616e816/users/8d345202fe1c45f8a4ee0d529056dcd4/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:22.137392 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a859ef4-28f2-4ed0-a569-8612b270c62e admin admin] RBAC: Authorizing `identity:create_grant(project_id=318126fbaba24b3abceecae1b616e816, user_id=8d345202fe1c45f8a4ee0d529056dcd4, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:22.140148 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a859ef4-28f2-4ed0-a569-8612b270c62e admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:22.162367 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c7f2c-a201-40de-943c-0bcfa497c447 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:22.173352 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1075/2149] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:46:22 2022] PUT /identity/v3/projects/318126fbaba24b3abceecae1b616e816/users/8d345202fe1c45f8a4ee0d529056dcd4/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:22.176157 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c7f2c-a201-40de-943c-0bcfa497c447 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:22.207401 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:22.310612 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6132ad1-9461-4a96-90b3-c57618033269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:22.311324 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6132ad1-9461-4a96-90b3-c57618033269 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:22.312271 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6132ad1-9461-4a96-90b3-c57618033269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:22.312271 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6132ad1-9461-4a96-90b3-c57618033269 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:22.312894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6132ad1-9461-4a96-90b3-c57618033269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:22.314891 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6132ad1-9461-4a96-90b3-c57618033269 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:22.333993 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a859ef4-28f2-4ed0-a569-8612b270c62e admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:22.341944 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1075/2150] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:46:22.357640 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a859ef4-28f2-4ed0-a569-8612b270c62e admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:22.378919 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1615c8c-fdb0-4856-a5a2-b859c5fbb059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:22.379698 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1615c8c-fdb0-4856-a5a2-b859c5fbb059 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:22.380698 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1615c8c-fdb0-4856-a5a2-b859c5fbb059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:22.380984 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1615c8c-fdb0-4856-a5a2-b859c5fbb059 admin admin] PATH_INFO: `/v3/projects/318126fbaba24b3abceecae1b616e816/users/8d345202fe1c45f8a4ee0d529056dcd4/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:22.383231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1615c8c-fdb0-4856-a5a2-b859c5fbb059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=318126fbaba24b3abceecae1b616e816, user_id=8d345202fe1c45f8a4ee0d529056dcd4, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:22.386633 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1615c8c-fdb0-4856-a5a2-b859c5fbb059 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:22.410288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1076/2151] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:46:22 2022] PUT /identity/v3/projects/318126fbaba24b3abceecae1b616e816/users/8d345202fe1c45f8a4ee0d529056dcd4/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:22.411522 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a63dc5-3c37-49a9-a927-91bdb51ed1a2 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:22.411810 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a63dc5-3c37-49a9-a927-91bdb51ed1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:22.412083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a63dc5-3c37-49a9-a927-91bdb51ed1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:22.468873 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-d3a63dc5-3c37-49a9-a927-91bdb51ed1a2 None None] MFA Rules not processed for user `8d345202fe1c45f8a4ee0d529056dcd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:22.470121 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d3a63dc5-3c37-49a9-a927-91bdb51ed1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:22.600408 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1076/2152] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:22 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:46:22.606404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1615c8c-fdb0-4856-a5a2-b859c5fbb059 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:22.608494 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a1615c8c-fdb0-4856-a5a2-b859c5fbb059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:22.705338 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1615c8c-fdb0-4856-a5a2-b859c5fbb059 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:22.708965 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b465f-da02-48bc-92ea-e76316510825 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:22.709580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b465f-da02-48bc-92ea-e76316510825 service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:22.709857 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b465f-da02-48bc-92ea-e76316510825 service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:22.710137 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b465f-da02-48bc-92ea-e76316510825 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:22.720488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b465f-da02-48bc-92ea-e76316510825 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:22.721964 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b465f-da02-48bc-92ea-e76316510825 service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:22.733416 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1077/2153] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:22 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:46:22.898084 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a63dc5-3c37-49a9-a927-91bdb51ed1a2 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:22.978888 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a63dc5-3c37-49a9-a927-91bdb51ed1a2 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:22.983936 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdfc1e-9579-4bbf-885b-0083b32a3469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:22.984562 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdfc1e-9579-4bbf-885b-0083b32a3469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:22.984841 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdfc1e-9579-4bbf-885b-0083b32a3469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:22.985109 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdfc1e-9579-4bbf-885b-0083b32a3469 admin admin] PATH_INFO: `/v3/users/66b84938166f4ac9aac2ba131fa3f28a` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:22.986273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdfc1e-9579-4bbf-885b-0083b32a3469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b84938166f4ac9aac2ba131fa3f28a)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:22.988169 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdfc1e-9579-4bbf-885b-0083b32a3469 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:23.045111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-4dcdfc1e-9579-4bbf-885b-0083b32a3469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b84938166f4ac9aac2ba131fa3f28a'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:23.051256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:23.057520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-4dcdfc1e-9579-4bbf-885b-0083b32a3469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b84938166f4ac9aac2ba131fa3f28a'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:23.058398 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-4dcdfc1e-9579-4bbf-885b-0083b32a3469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b84938166f4ac9aac2ba131fa3f28a'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:23.059067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-4dcdfc1e-9579-4bbf-885b-0083b32a3469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b84938166f4ac9aac2ba131fa3f28a'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:23.071023 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-4dcdfc1e-9579-4bbf-885b-0083b32a3469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b84938166f4ac9aac2ba131fa3f28a'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:23.098148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1077/2154] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:46:22 2022] DELETE /identity/v3/users/66b84938166f4ac9aac2ba131fa3f28a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:23.105078 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abdd9a-70af-42b2-b65a-6b17208c4f8b None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:23.105078 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abdd9a-70af-42b2-b65a-6b17208c4f8b None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:23.105078 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abdd9a-70af-42b2-b65a-6b17208c4f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:23.126627 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-c3abdd9a-70af-42b2-b65a-6b17208c4f8b None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:23.127841 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-c3abdd9a-70af-42b2-b65a-6b17208c4f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:23.207137 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1078/2155] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:23.220502 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdfc1e-9579-4bbf-885b-0083b32a3469 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:23.222357 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-4dcdfc1e-9579-4bbf-885b-0083b32a3469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:23.294872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdfc1e-9579-4bbf-885b-0083b32a3469 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:23.298586 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275879cf-72f3-429d-97b7-bb0c4e3613f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:23.299201 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275879cf-72f3-429d-97b7-bb0c4e3613f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:23.299481 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275879cf-72f3-429d-97b7-bb0c4e3613f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:23.299812 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275879cf-72f3-429d-97b7-bb0c4e3613f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:23.313746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275879cf-72f3-429d-97b7-bb0c4e3613f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:23.315231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275879cf-72f3-429d-97b7-bb0c4e3613f9 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:23.325910 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1078/2156] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:46:23.699015 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abdd9a-70af-42b2-b65a-6b17208c4f8b None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:23.700462 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-c3abdd9a-70af-42b2-b65a-6b17208c4f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:23.711476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:23.719949 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abdd9a-70af-42b2-b65a-6b17208c4f8b None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:23.727197 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba951a93-e4c5-4b53-9490-33a863f945fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:23.728898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba951a93-e4c5-4b53-9490-33a863f945fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:23.729348 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba951a93-e4c5-4b53-9490-33a863f945fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:23.729748 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba951a93-e4c5-4b53-9490-33a863f945fc admin admin] PATH_INFO: `/v3/projects/31b84a5d99bf40aea811f16204908b91` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:23.731105 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba951a93-e4c5-4b53-9490-33a863f945fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=31b84a5d99bf40aea811f16204908b91)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:23.733986 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba951a93-e4c5-4b53-9490-33a863f945fc admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:23.839612 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-ba951a93-e4c5-4b53-9490-33a863f945fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b84a5d99bf40aea811f16204908b91', 'request_id': 'req-ba951a93-e4c5-4b53-9490-33a863f945fc'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:23.851094 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-ba951a93-e4c5-4b53-9490-33a863f945fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b84a5d99bf40aea811f16204908b91', 'request_id': 'req-ba951a93-e4c5-4b53-9490-33a863f945fc'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:23.867644 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-ba951a93-e4c5-4b53-9490-33a863f945fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b84a5d99bf40aea811f16204908b91', 'request_id': 'req-ba951a93-e4c5-4b53-9490-33a863f945fc'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:23.891613 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-ba951a93-e4c5-4b53-9490-33a863f945fc admin admin] The token cache is being invalidate because project 31b84a5d99bf40aea811f16204908b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:46:23.892027 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-ba951a93-e4c5-4b53-9490-33a863f945fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:23.893255 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-ba951a93-e4c5-4b53-9490-33a863f945fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:23.897831 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1079/2157] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:46:23 2022] DELETE /identity/v3/projects/31b84a5d99bf40aea811f16204908b91 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:23.899023 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275879cf-72f3-429d-97b7-bb0c4e3613f9 service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:23.916824 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275879cf-72f3-429d-97b7-bb0c4e3613f9 service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:24.011610 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bfe41-222f-4f77-b33d-3f744db5d26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:24.012503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bfe41-222f-4f77-b33d-3f744db5d26f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:24.012871 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bfe41-222f-4f77-b33d-3f744db5d26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:24.013233 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bfe41-222f-4f77-b33d-3f744db5d26f admin admin] PATH_INFO: `/v3/users/8d345202fe1c45f8a4ee0d529056dcd4` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:24.014907 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bfe41-222f-4f77-b33d-3f744db5d26f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d345202fe1c45f8a4ee0d529056dcd4)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:24.017112 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bfe41-222f-4f77-b33d-3f744db5d26f admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:24.108936 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-2c0bfe41-222f-4f77-b33d-3f744db5d26f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d345202fe1c45f8a4ee0d529056dcd4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:24.118023 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-2c0bfe41-222f-4f77-b33d-3f744db5d26f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d345202fe1c45f8a4ee0d529056dcd4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:24.118913 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-2c0bfe41-222f-4f77-b33d-3f744db5d26f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d345202fe1c45f8a4ee0d529056dcd4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:24.119705 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-2c0bfe41-222f-4f77-b33d-3f744db5d26f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d345202fe1c45f8a4ee0d529056dcd4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:24.129578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-2c0bfe41-222f-4f77-b33d-3f744db5d26f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d345202fe1c45f8a4ee0d529056dcd4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:24.139622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:24.154076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1079/2158] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:46:23 2022] DELETE /identity/v3/users/8d345202fe1c45f8a4ee0d529056dcd4 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:24.462533 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba951a93-e4c5-4b53-9490-33a863f945fc admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:24.464146 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ba951a93-e4c5-4b53-9490-33a863f945fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:24.488780 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba951a93-e4c5-4b53-9490-33a863f945fc admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:24.554954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daebd27-484e-4712-8b35-b96c89e16cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:24.555517 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daebd27-484e-4712-8b35-b96c89e16cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:24.555792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daebd27-484e-4712-8b35-b96c89e16cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:24.556226 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daebd27-484e-4712-8b35-b96c89e16cf1 admin admin] PATH_INFO: `/v3/projects/318126fbaba24b3abceecae1b616e816` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:24.557593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daebd27-484e-4712-8b35-b96c89e16cf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=318126fbaba24b3abceecae1b616e816)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:24.559565 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daebd27-484e-4712-8b35-b96c89e16cf1 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:24.610528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8daebd27-484e-4712-8b35-b96c89e16cf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '318126fbaba24b3abceecae1b616e816', 'request_id': 'req-8daebd27-484e-4712-8b35-b96c89e16cf1'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:24.616524 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8daebd27-484e-4712-8b35-b96c89e16cf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '318126fbaba24b3abceecae1b616e816', 'request_id': 'req-8daebd27-484e-4712-8b35-b96c89e16cf1'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:24.624506 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8daebd27-484e-4712-8b35-b96c89e16cf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '318126fbaba24b3abceecae1b616e816', 'request_id': 'req-8daebd27-484e-4712-8b35-b96c89e16cf1'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:24.637328 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8daebd27-484e-4712-8b35-b96c89e16cf1 admin admin] The token cache is being invalidate because project 318126fbaba24b3abceecae1b616e816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:46:24.637720 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8daebd27-484e-4712-8b35-b96c89e16cf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:24.638297 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8daebd27-484e-4712-8b35-b96c89e16cf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:24.641222 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1080/2159] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:46:24 2022] DELETE /identity/v3/projects/318126fbaba24b3abceecae1b616e816 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:24.645872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42a3cc-d61c-4593-b212-d62ed9f111f5 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:24.646162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42a3cc-d61c-4593-b212-d62ed9f111f5 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:24.646441 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42a3cc-d61c-4593-b212-d62ed9f111f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:24.667809 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-8c42a3cc-d61c-4593-b212-d62ed9f111f5 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:24.669012 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-8c42a3cc-d61c-4593-b212-d62ed9f111f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:24.730824 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1080/2160] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:46:24.738561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cc3e8-adb2-4ff3-806f-6ff91b72ba1d None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:24.738997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cc3e8-adb2-4ff3-806f-6ff91b72ba1d None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:24.739158 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cc3e8-adb2-4ff3-806f-6ff91b72ba1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:24.762368 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-698cc3e8-adb2-4ff3-806f-6ff91b72ba1d None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:24.763845 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-698cc3e8-adb2-4ff3-806f-6ff91b72ba1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:24.772651 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1081/2161] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:24.777522 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42a3cc-d61c-4593-b212-d62ed9f111f5 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:24.787294 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42a3cc-d61c-4593-b212-d62ed9f111f5 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:24.792011 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c2ed4-3065-4011-b3e2-901ed8fd1983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:24.792628 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c2ed4-3065-4011-b3e2-901ed8fd1983 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:24.792904 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c2ed4-3065-4011-b3e2-901ed8fd1983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:24.793170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c2ed4-3065-4011-b3e2-901ed8fd1983 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:24.793811 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c2ed4-3065-4011-b3e2-901ed8fd1983 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:46:24.794143 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c2ed4-3065-4011-b3e2-901ed8fd1983 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:24.795735 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c2ed4-3065-4011-b3e2-901ed8fd1983 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:24.807814 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1081/2162] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:46:24.811949 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cc3e8-adb2-4ff3-806f-6ff91b72ba1d None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:24.821180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cc3e8-adb2-4ff3-806f-6ff91b72ba1d None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:24.826697 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e509cc5-4c30-4e7e-ac5a-49aec780b998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:24.827298 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e509cc5-4c30-4e7e-ac5a-49aec780b998 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:24.827580 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e509cc5-4c30-4e7e-ac5a-49aec780b998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:24.827854 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e509cc5-4c30-4e7e-ac5a-49aec780b998 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:24.828486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e509cc5-4c30-4e7e-ac5a-49aec780b998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:24.830449 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e509cc5-4c30-4e7e-ac5a-49aec780b998 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:24.835752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:24.859253 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1082/2163] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:46:24 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:46:24.863503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c2ed4-3065-4011-b3e2-901ed8fd1983 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:24.873648 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c2ed4-3065-4011-b3e2-901ed8fd1983 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:24.929353 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51df08-9f93-40be-a22a-090f1f7a2e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:24.930098 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51df08-9f93-40be-a22a-090f1f7a2e9e admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:24.930275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51df08-9f93-40be-a22a-090f1f7a2e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:24.930545 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51df08-9f93-40be-a22a-090f1f7a2e9e admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:24.931246 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51df08-9f93-40be-a22a-090f1f7a2e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:24.933161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51df08-9f93-40be-a22a-090f1f7a2e9e admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:24.954481 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1082/2164] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:46:24 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:46:24.958734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e509cc5-4c30-4e7e-ac5a-49aec780b998 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:24.969608 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e509cc5-4c30-4e7e-ac5a-49aec780b998 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:24.974222 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8e16a-e697-4924-ac10-3a44ff1e89f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:24.974813 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8e16a-e697-4924-ac10-3a44ff1e89f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:24.975091 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8e16a-e697-4924-ac10-3a44ff1e89f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:24.975363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8e16a-e697-4924-ac10-3a44ff1e89f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:24.975995 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8e16a-e697-4924-ac10-3a44ff1e89f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:24.977592 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8e16a-e697-4924-ac10-3a44ff1e89f3 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:24.987725 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1083/2165] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:46:24.991548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51df08-9f93-40be-a22a-090f1f7a2e9e admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:25.001830 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51df08-9f93-40be-a22a-090f1f7a2e9e admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:25.006429 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326db55-3cad-496a-8795-72bafdb2023c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:25.007159 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326db55-3cad-496a-8795-72bafdb2023c admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:25.007443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326db55-3cad-496a-8795-72bafdb2023c admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:25.007966 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326db55-3cad-496a-8795-72bafdb2023c admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:25.008601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326db55-3cad-496a-8795-72bafdb2023c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:25.010264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326db55-3cad-496a-8795-72bafdb2023c admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:25.021039 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1083/2166] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:46:25.025787 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8e16a-e697-4924-ac10-3a44ff1e89f3 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:25.035646 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8e16a-e697-4924-ac10-3a44ff1e89f3 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:25.040244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749eb3d6-b5ce-45e6-8f34-9cdfce409dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:25.041493 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eb3d6-b5ce-45e6-8f34-9cdfce409dda admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:25.041767 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eb3d6-b5ce-45e6-8f34-9cdfce409dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:25.042083 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eb3d6-b5ce-45e6-8f34-9cdfce409dda admin admin] PATH_INFO: `/v3/projects/247718b5b2fd462ba7f9f53f8c50cc53/users/dad885d1a7504f3aaf97436249d0360f/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:25.058188 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749eb3d6-b5ce-45e6-8f34-9cdfce409dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=247718b5b2fd462ba7f9f53f8c50cc53, user_id=dad885d1a7504f3aaf97436249d0360f, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:25.061151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749eb3d6-b5ce-45e6-8f34-9cdfce409dda admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:25.076400 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1084/2167] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:46:25 2022] PUT /identity/v3/projects/247718b5b2fd462ba7f9f53f8c50cc53/users/dad885d1a7504f3aaf97436249d0360f/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:25.087336 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ce572-cbb5-4121-8005-500445eeddba None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:25.089917 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ce572-cbb5-4121-8005-500445eeddba None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:25.089917 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ce572-cbb5-4121-8005-500445eeddba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:25.138721 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-829ce572-cbb5-4121-8005-500445eeddba None None] MFA Rules not processed for user `dad885d1a7504f3aaf97436249d0360f`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:25.140096 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-829ce572-cbb5-4121-8005-500445eeddba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:25.221693 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:25.243380 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1084/2168] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:25.248506 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749eb3d6-b5ce-45e6-8f34-9cdfce409dda admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:25.275211 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ce572-cbb5-4121-8005-500445eeddba None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:25.276879 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-829ce572-cbb5-4121-8005-500445eeddba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:25.322827 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749eb3d6-b5ce-45e6-8f34-9cdfce409dda admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:25.327748 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff733ad-d759-496d-94bd-6ab4b7fa1d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:25.328363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff733ad-d759-496d-94bd-6ab4b7fa1d25 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:25.328652 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff733ad-d759-496d-94bd-6ab4b7fa1d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:25.328918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff733ad-d759-496d-94bd-6ab4b7fa1d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:25.329567 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff733ad-d759-496d-94bd-6ab4b7fa1d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:25.331527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff733ad-d759-496d-94bd-6ab4b7fa1d25 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:25.350304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ce572-cbb5-4121-8005-500445eeddba None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:25.355489 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c445e79-dbd4-4e76-8842-5514bb31c902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:25.355972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c445e79-dbd4-4e76-8842-5514bb31c902 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:25.356250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c445e79-dbd4-4e76-8842-5514bb31c902 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:25.356513 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c445e79-dbd4-4e76-8842-5514bb31c902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:25.358345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-8c445e79-dbd4-4e76-8842-5514bb31c902 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:25.366033 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1085/2169] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:46:25 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:46:25.367053 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff733ad-d759-496d-94bd-6ab4b7fa1d25 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:25.372372 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c445e79-dbd4-4e76-8842-5514bb31c902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:25.374389 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c445e79-dbd4-4e76-8842-5514bb31c902 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:25.385362 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1085/2170] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:46:25.439624 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff733ad-d759-496d-94bd-6ab4b7fa1d25 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:25.444725 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac7299-6589-4f01-af26-724ee8005a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:25.445329 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac7299-6589-4f01-af26-724ee8005a5d admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:25.445606 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac7299-6589-4f01-af26-724ee8005a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:25.445897 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac7299-6589-4f01-af26-724ee8005a5d admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:25.446530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac7299-6589-4f01-af26-724ee8005a5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:25.448519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac7299-6589-4f01-af26-724ee8005a5d admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:25.472652 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1086/2171] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:46:25 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:46:25.479650 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c445e79-dbd4-4e76-8842-5514bb31c902 service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:25.495552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c445e79-dbd4-4e76-8842-5514bb31c902 service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:25.501576 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41c1da-0fb9-4acc-869d-86b5a54f3207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:25.502343 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41c1da-0fb9-4acc-869d-86b5a54f3207 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:25.502628 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41c1da-0fb9-4acc-869d-86b5a54f3207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:25.502897 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41c1da-0fb9-4acc-869d-86b5a54f3207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:25.503547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41c1da-0fb9-4acc-869d-86b5a54f3207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:25.506088 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41c1da-0fb9-4acc-869d-86b5a54f3207 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:25.520063 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1086/2172] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:46:25.525987 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac7299-6589-4f01-af26-724ee8005a5d admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:25.536068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac7299-6589-4f01-af26-724ee8005a5d admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:25.542183 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2758bd9-afd3-47b9-933e-83f15b906e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:25.542859 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2758bd9-afd3-47b9-933e-83f15b906e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:25.543143 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2758bd9-afd3-47b9-933e-83f15b906e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:25.543424 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2758bd9-afd3-47b9-933e-83f15b906e1c admin admin] PATH_INFO: `/v3/projects/5ab6b9db9bac4e0685896f4fed6289e1/users/c54d728d36e44633980336f41c002a4b/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:25.560791 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2758bd9-afd3-47b9-933e-83f15b906e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab6b9db9bac4e0685896f4fed6289e1, user_id=c54d728d36e44633980336f41c002a4b, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:25.563618 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2758bd9-afd3-47b9-933e-83f15b906e1c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:25.577139 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1087/2173] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:46:25 2022] PUT /identity/v3/projects/5ab6b9db9bac4e0685896f4fed6289e1/users/c54d728d36e44633980336f41c002a4b/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:25.581126 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41c1da-0fb9-4acc-869d-86b5a54f3207 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:25.591921 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41c1da-0fb9-4acc-869d-86b5a54f3207 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:25.658333 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d056e1-c7d9-47b9-882c-fc7ccb6816e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:25.659058 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d056e1-c7d9-47b9-882c-fc7ccb6816e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:25.659342 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d056e1-c7d9-47b9-882c-fc7ccb6816e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:25.659609 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d056e1-c7d9-47b9-882c-fc7ccb6816e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:25.660247 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d056e1-c7d9-47b9-882c-fc7ccb6816e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:25.661866 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d056e1-c7d9-47b9-882c-fc7ccb6816e6 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:25.672490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1087/2174] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:46:25.677192 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2758bd9-afd3-47b9-933e-83f15b906e1c admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:25.683758 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:25.690294 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2758bd9-afd3-47b9-933e-83f15b906e1c admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:25.696075 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ca64a-fc42-4521-b4d0-c826117481f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:25.696753 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ca64a-fc42-4521-b4d0-c826117481f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:25.697032 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ca64a-fc42-4521-b4d0-c826117481f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:25.697549 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ca64a-fc42-4521-b4d0-c826117481f6 admin admin] PATH_INFO: `/v3/projects/5ab6b9db9bac4e0685896f4fed6289e1/users/c54d728d36e44633980336f41c002a4b/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:25.699274 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ca64a-fc42-4521-b4d0-c826117481f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab6b9db9bac4e0685896f4fed6289e1, user_id=c54d728d36e44633980336f41c002a4b, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:25.702200 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ca64a-fc42-4521-b4d0-c826117481f6 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:25.714106 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1088/2175] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:46:25 2022] PUT /identity/v3/projects/5ab6b9db9bac4e0685896f4fed6289e1/users/c54d728d36e44633980336f41c002a4b/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:46:25.724559 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08755fe7-467d-4b37-b683-c9a496024a98 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:25.724842 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08755fe7-467d-4b37-b683-c9a496024a98 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:25.725219 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08755fe7-467d-4b37-b683-c9a496024a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:25.755229 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-08755fe7-467d-4b37-b683-c9a496024a98 None None] MFA Rules not processed for user `c54d728d36e44633980336f41c002a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:25.756486 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-08755fe7-467d-4b37-b683-c9a496024a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:25.829075 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:25.833328 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1088/2176] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:25.845089 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ca64a-fc42-4521-b4d0-c826117481f6 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:25.846845 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a45ca64a-fc42-4521-b4d0-c826117481f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:25.904203 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ca64a-fc42-4521-b4d0-c826117481f6 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:25.907663 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a086673-45fa-4b35-9014-925288d6dc39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:25.908250 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a086673-45fa-4b35-9014-925288d6dc39 service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:25.908523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a086673-45fa-4b35-9014-925288d6dc39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:25.908791 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a086673-45fa-4b35-9014-925288d6dc39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:25.918721 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a086673-45fa-4b35-9014-925288d6dc39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:25.920154 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a086673-45fa-4b35-9014-925288d6dc39 service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:25.929259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1089/2177] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:46:25.958577 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08755fe7-467d-4b37-b683-c9a496024a98 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:26.018898 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08755fe7-467d-4b37-b683-c9a496024a98 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:26.023399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54923ee1-826b-45c0-ac59-cdcf4a4fa3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:26.024007 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54923ee1-826b-45c0-ac59-cdcf4a4fa3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:26.024284 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54923ee1-826b-45c0-ac59-cdcf4a4fa3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:26.024553 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54923ee1-826b-45c0-ac59-cdcf4a4fa3ad admin admin] PATH_INFO: `/v3/users/dad885d1a7504f3aaf97436249d0360f` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:26.026287 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54923ee1-826b-45c0-ac59-cdcf4a4fa3ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=dad885d1a7504f3aaf97436249d0360f)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:26.028190 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54923ee1-826b-45c0-ac59-cdcf4a4fa3ad admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:26.073078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-54923ee1-826b-45c0-ac59-cdcf4a4fa3ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dad885d1a7504f3aaf97436249d0360f'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:26.079850 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-54923ee1-826b-45c0-ac59-cdcf4a4fa3ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dad885d1a7504f3aaf97436249d0360f'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:26.080456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-54923ee1-826b-45c0-ac59-cdcf4a4fa3ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dad885d1a7504f3aaf97436249d0360f'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:26.081072 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-54923ee1-826b-45c0-ac59-cdcf4a4fa3ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dad885d1a7504f3aaf97436249d0360f'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:26.089951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-54923ee1-826b-45c0-ac59-cdcf4a4fa3ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dad885d1a7504f3aaf97436249d0360f'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:26.108056 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1089/2178] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:46:25 2022] DELETE /identity/v3/users/dad885d1a7504f3aaf97436249d0360f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:26.112153 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8bf50-468f-40f2-9bdd-ffd675cc6edb None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:26.112552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8bf50-468f-40f2-9bdd-ffd675cc6edb None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:26.112966 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8bf50-468f-40f2-9bdd-ffd675cc6edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:26.143816 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-63d8bf50-468f-40f2-9bdd-ffd675cc6edb None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:26.145115 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-63d8bf50-468f-40f2-9bdd-ffd675cc6edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:26.210021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1090/2179] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:26.219510 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54923ee1-826b-45c0-ac59-cdcf4a4fa3ad admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:26.220986 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-54923ee1-826b-45c0-ac59-cdcf4a4fa3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:26.282928 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54923ee1-826b-45c0-ac59-cdcf4a4fa3ad admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:26.287354 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89f803-3dba-4a05-b9df-892b6185e010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:26.287994 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89f803-3dba-4a05-b9df-892b6185e010 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:26.288270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89f803-3dba-4a05-b9df-892b6185e010 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:26.288538 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89f803-3dba-4a05-b9df-892b6185e010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:26.299147 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89f803-3dba-4a05-b9df-892b6185e010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:26.300566 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89f803-3dba-4a05-b9df-892b6185e010 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:26.310778 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1090/2180] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:46:26.584939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8bf50-468f-40f2-9bdd-ffd675cc6edb None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:26.586562 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-63d8bf50-468f-40f2-9bdd-ffd675cc6edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:26.599807 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8bf50-468f-40f2-9bdd-ffd675cc6edb None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:26.605405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7a217-5be6-4ff0-ba21-46a02bfd1196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:26.606064 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7a217-5be6-4ff0-ba21-46a02bfd1196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:26.606342 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7a217-5be6-4ff0-ba21-46a02bfd1196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:26.606610 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7a217-5be6-4ff0-ba21-46a02bfd1196 admin admin] PATH_INFO: `/v3/projects/247718b5b2fd462ba7f9f53f8c50cc53` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:26.608480 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7a217-5be6-4ff0-ba21-46a02bfd1196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=247718b5b2fd462ba7f9f53f8c50cc53)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:26.610508 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7a217-5be6-4ff0-ba21-46a02bfd1196 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:26.656642 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c3d7a217-5be6-4ff0-ba21-46a02bfd1196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '247718b5b2fd462ba7f9f53f8c50cc53', 'request_id': 'req-c3d7a217-5be6-4ff0-ba21-46a02bfd1196'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:26.662358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c3d7a217-5be6-4ff0-ba21-46a02bfd1196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '247718b5b2fd462ba7f9f53f8c50cc53', 'request_id': 'req-c3d7a217-5be6-4ff0-ba21-46a02bfd1196'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:26.670523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c3d7a217-5be6-4ff0-ba21-46a02bfd1196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '247718b5b2fd462ba7f9f53f8c50cc53', 'request_id': 'req-c3d7a217-5be6-4ff0-ba21-46a02bfd1196'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:26.681764 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c3d7a217-5be6-4ff0-ba21-46a02bfd1196 admin admin] The token cache is being invalidate because project 247718b5b2fd462ba7f9f53f8c50cc53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:46:26.682075 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c3d7a217-5be6-4ff0-ba21-46a02bfd1196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:26.682697 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c3d7a217-5be6-4ff0-ba21-46a02bfd1196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:26.684303 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1091/2181] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:46:26 2022] DELETE /identity/v3/projects/247718b5b2fd462ba7f9f53f8c50cc53 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:26.688215 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89f803-3dba-4a05-b9df-892b6185e010 service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:26.697992 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89f803-3dba-4a05-b9df-892b6185e010 service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:26.716160 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:26.756060 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7738fc-324f-464e-88d4-d2316d56670e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:26.756689 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7738fc-324f-464e-88d4-d2316d56670e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:26.756973 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7738fc-324f-464e-88d4-d2316d56670e admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:26.757251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7738fc-324f-464e-88d4-d2316d56670e admin admin] PATH_INFO: `/v3/users/c54d728d36e44633980336f41c002a4b` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:26.758659 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7738fc-324f-464e-88d4-d2316d56670e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c54d728d36e44633980336f41c002a4b)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:26.760849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7738fc-324f-464e-88d4-d2316d56670e admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:26.808910 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8d7738fc-324f-464e-88d4-d2316d56670e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c54d728d36e44633980336f41c002a4b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:26.815695 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8d7738fc-324f-464e-88d4-d2316d56670e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c54d728d36e44633980336f41c002a4b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:26.816357 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8d7738fc-324f-464e-88d4-d2316d56670e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c54d728d36e44633980336f41c002a4b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:26.816964 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8d7738fc-324f-464e-88d4-d2316d56670e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c54d728d36e44633980336f41c002a4b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:26.824504 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8d7738fc-324f-464e-88d4-d2316d56670e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c54d728d36e44633980336f41c002a4b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:26.842545 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1091/2182] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:46:26 2022] DELETE /identity/v3/users/c54d728d36e44633980336f41c002a4b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:27.106675 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7a217-5be6-4ff0-ba21-46a02bfd1196 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:27.108167 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-c3d7a217-5be6-4ff0-ba21-46a02bfd1196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:27.122486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7a217-5be6-4ff0-ba21-46a02bfd1196 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:27.136747 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:27.182404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74feeea6-0daf-452d-ad30-b662c4b0bbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:27.183034 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74feeea6-0daf-452d-ad30-b662c4b0bbaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:27.183359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74feeea6-0daf-452d-ad30-b662c4b0bbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:27.183573 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74feeea6-0daf-452d-ad30-b662c4b0bbaf admin admin] PATH_INFO: `/v3/projects/5ab6b9db9bac4e0685896f4fed6289e1` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:27.184701 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74feeea6-0daf-452d-ad30-b662c4b0bbaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab6b9db9bac4e0685896f4fed6289e1)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:27.186722 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74feeea6-0daf-452d-ad30-b662c4b0bbaf admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:27.232067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-74feeea6-0daf-452d-ad30-b662c4b0bbaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab6b9db9bac4e0685896f4fed6289e1', 'request_id': 'req-74feeea6-0daf-452d-ad30-b662c4b0bbaf'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:27.237391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-74feeea6-0daf-452d-ad30-b662c4b0bbaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab6b9db9bac4e0685896f4fed6289e1', 'request_id': 'req-74feeea6-0daf-452d-ad30-b662c4b0bbaf'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:27.244845 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-74feeea6-0daf-452d-ad30-b662c4b0bbaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab6b9db9bac4e0685896f4fed6289e1', 'request_id': 'req-74feeea6-0daf-452d-ad30-b662c4b0bbaf'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:27.255940 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-74feeea6-0daf-452d-ad30-b662c4b0bbaf admin admin] The token cache is being invalidate because project 5ab6b9db9bac4e0685896f4fed6289e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:46:27.256229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-74feeea6-0daf-452d-ad30-b662c4b0bbaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:27.256858 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-74feeea6-0daf-452d-ad30-b662c4b0bbaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:27.258629 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1092/2183] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:46:27 2022] DELETE /identity/v3/projects/5ab6b9db9bac4e0685896f4fed6289e1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:27.264036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58a0c3-23c8-4d0e-b846-2af065c1bf3f None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:27.264506 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58a0c3-23c8-4d0e-b846-2af065c1bf3f None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:27.264623 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58a0c3-23c8-4d0e-b846-2af065c1bf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:27.283887 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-6b58a0c3-23c8-4d0e-b846-2af065c1bf3f None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:27.285144 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-6b58a0c3-23c8-4d0e-b846-2af065c1bf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:27.343738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1092/2184] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:27.351460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8ff11-a2f0-48e5-ba43-64a709a90599 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:27.351746 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8ff11-a2f0-48e5-ba43-64a709a90599 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:27.352019 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8ff11-a2f0-48e5-ba43-64a709a90599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:27.372385 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-ecc8ff11-a2f0-48e5-ba43-64a709a90599 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:27.373551 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ecc8ff11-a2f0-48e5-ba43-64a709a90599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:27.381187 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1093/2185] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:27.386183 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58a0c3-23c8-4d0e-b846-2af065c1bf3f None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:27.395952 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58a0c3-23c8-4d0e-b846-2af065c1bf3f None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:27.400539 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece84cc-9190-4c67-acde-7e3f2d561dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:27.401123 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece84cc-9190-4c67-acde-7e3f2d561dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:27.401397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece84cc-9190-4c67-acde-7e3f2d561dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:27.401665 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece84cc-9190-4c67-acde-7e3f2d561dc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:27.402339 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece84cc-9190-4c67-acde-7e3f2d561dc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:46:27.402636 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece84cc-9190-4c67-acde-7e3f2d561dc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:27.404208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece84cc-9190-4c67-acde-7e3f2d561dc7 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:27.415983 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1093/2186] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:46:27.420021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8ff11-a2f0-48e5-ba43-64a709a90599 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:27.429242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8ff11-a2f0-48e5-ba43-64a709a90599 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:27.434825 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee851ba-bfa5-4235-be0c-52a12ebd6201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:27.435368 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee851ba-bfa5-4235-be0c-52a12ebd6201 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:27.435674 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee851ba-bfa5-4235-be0c-52a12ebd6201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:27.435943 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee851ba-bfa5-4235-be0c-52a12ebd6201 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:27.436658 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee851ba-bfa5-4235-be0c-52a12ebd6201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:27.438610 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee851ba-bfa5-4235-be0c-52a12ebd6201 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:27.466278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1094/2187] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:46:27 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:46:27.470539 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece84cc-9190-4c67-acde-7e3f2d561dc7 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:27.480666 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece84cc-9190-4c67-acde-7e3f2d561dc7 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:27.507982 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:27.543202 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425b6f2-921e-4889-9d47-a178011b2322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:27.543805 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425b6f2-921e-4889-9d47-a178011b2322 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:27.544085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425b6f2-921e-4889-9d47-a178011b2322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:27.544357 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425b6f2-921e-4889-9d47-a178011b2322 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:27.544995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425b6f2-921e-4889-9d47-a178011b2322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:27.546936 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425b6f2-921e-4889-9d47-a178011b2322 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:27.573469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1094/2188] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:46:27 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:46:27.577180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee851ba-bfa5-4235-be0c-52a12ebd6201 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:27.587667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee851ba-bfa5-4235-be0c-52a12ebd6201 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:27.592567 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91f081-7d12-4188-81b6-87c268239b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:27.593179 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91f081-7d12-4188-81b6-87c268239b9e admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:27.593466 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91f081-7d12-4188-81b6-87c268239b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:27.593732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91f081-7d12-4188-81b6-87c268239b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:27.594432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91f081-7d12-4188-81b6-87c268239b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:27.596018 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91f081-7d12-4188-81b6-87c268239b9e admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:27.609655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1095/2189] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:46:27.611111 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425b6f2-921e-4889-9d47-a178011b2322 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:27.624301 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425b6f2-921e-4889-9d47-a178011b2322 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:27.629539 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277090b4-9646-41bd-a71a-de94011cb321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:27.630235 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277090b4-9646-41bd-a71a-de94011cb321 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:27.630520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277090b4-9646-41bd-a71a-de94011cb321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:27.630794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277090b4-9646-41bd-a71a-de94011cb321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:27.631434 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277090b4-9646-41bd-a71a-de94011cb321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:27.633308 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277090b4-9646-41bd-a71a-de94011cb321 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:27.645583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1095/2190] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:46:27.649727 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91f081-7d12-4188-81b6-87c268239b9e admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:27.659924 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91f081-7d12-4188-81b6-87c268239b9e admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:27.664443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e54413-3400-4865-88e3-3b53dc93d458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:27.665070 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e54413-3400-4865-88e3-3b53dc93d458 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:27.665887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e54413-3400-4865-88e3-3b53dc93d458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:27.666162 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e54413-3400-4865-88e3-3b53dc93d458 admin admin] PATH_INFO: `/v3/projects/c11a00af3f954792af1be4823adc8d91/users/ea32bd843f434e0bafdc1c79eb8de852/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:27.680259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e54413-3400-4865-88e3-3b53dc93d458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11a00af3f954792af1be4823adc8d91, user_id=ea32bd843f434e0bafdc1c79eb8de852, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:27.683602 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e54413-3400-4865-88e3-3b53dc93d458 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:27.696012 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1096/2191] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:46:27 2022] PUT /identity/v3/projects/c11a00af3f954792af1be4823adc8d91/users/ea32bd843f434e0bafdc1c79eb8de852/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:27.707157 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d00fb-39f5-40f4-bc62-4e78dd3a5cec None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:27.707447 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d00fb-39f5-40f4-bc62-4e78dd3a5cec None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:27.707724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d00fb-39f5-40f4-bc62-4e78dd3a5cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:27.735581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-f63d00fb-39f5-40f4-bc62-4e78dd3a5cec None None] MFA Rules not processed for user `ea32bd843f434e0bafdc1c79eb8de852`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:27.736784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-f63d00fb-39f5-40f4-bc62-4e78dd3a5cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:27.799884 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1096/2192] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:27.804303 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e54413-3400-4865-88e3-3b53dc93d458 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:27.848969 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:27.866592 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e54413-3400-4865-88e3-3b53dc93d458 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:27.871314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e605967-5100-4277-bc9c-ac714d00f875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:27.871906 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e605967-5100-4277-bc9c-ac714d00f875 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:27.872184 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e605967-5100-4277-bc9c-ac714d00f875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:27.872453 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e605967-5100-4277-bc9c-ac714d00f875 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:27.873079 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e605967-5100-4277-bc9c-ac714d00f875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:27.875010 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e605967-5100-4277-bc9c-ac714d00f875 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:27.901802 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1097/2193] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:46:27 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:46:27.905865 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d00fb-39f5-40f4-bc62-4e78dd3a5cec None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:27.916669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d00fb-39f5-40f4-bc62-4e78dd3a5cec None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:27.972986 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6143f3-137d-4929-ae8a-56bb6758bc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:27.973519 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6143f3-137d-4929-ae8a-56bb6758bc01 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:27.973800 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6143f3-137d-4929-ae8a-56bb6758bc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:27.974110 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6143f3-137d-4929-ae8a-56bb6758bc01 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:27.974750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6143f3-137d-4929-ae8a-56bb6758bc01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:27.976663 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6143f3-137d-4929-ae8a-56bb6758bc01 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:27.997906 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1097/2194] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:46:27 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:46:28.001942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e605967-5100-4277-bc9c-ac714d00f875 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:28.013086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e605967-5100-4277-bc9c-ac714d00f875 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:28.017704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d5b97-23dc-4ad0-b60c-a0ec225067b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:28.018348 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d5b97-23dc-4ad0-b60c-a0ec225067b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:28.018633 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d5b97-23dc-4ad0-b60c-a0ec225067b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:28.018903 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d5b97-23dc-4ad0-b60c-a0ec225067b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:28.019541 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d5b97-23dc-4ad0-b60c-a0ec225067b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:28.021508 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d5b97-23dc-4ad0-b60c-a0ec225067b1 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:28.032428 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1098/2195] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:46:28.036461 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6143f3-137d-4929-ae8a-56bb6758bc01 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:28.046266 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6143f3-137d-4929-ae8a-56bb6758bc01 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:28.050788 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01869b-8b95-474f-a621-5fc33e81706e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:28.051420 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01869b-8b95-474f-a621-5fc33e81706e admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:28.051693 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01869b-8b95-474f-a621-5fc33e81706e admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:28.051962 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01869b-8b95-474f-a621-5fc33e81706e admin admin] PATH_INFO: `/v3/projects/8ab34039ee6e4e8493f5d6a9d981f58d/users/3aef706cd4774d4eb64870cdf8e8f313/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:28.066849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01869b-8b95-474f-a621-5fc33e81706e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ab34039ee6e4e8493f5d6a9d981f58d, user_id=3aef706cd4774d4eb64870cdf8e8f313, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:28.069478 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01869b-8b95-474f-a621-5fc33e81706e admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:28.082002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1098/2196] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:46:28 2022] PUT /identity/v3/projects/8ab34039ee6e4e8493f5d6a9d981f58d/users/3aef706cd4774d4eb64870cdf8e8f313/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:28.085972 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d5b97-23dc-4ad0-b60c-a0ec225067b1 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:28.096482 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d5b97-23dc-4ad0-b60c-a0ec225067b1 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:28.152445 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08489d0d-7ef1-4bf9-8e30-71983e34968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:28.153088 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08489d0d-7ef1-4bf9-8e30-71983e34968d admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:28.153321 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08489d0d-7ef1-4bf9-8e30-71983e34968d admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:28.153594 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08489d0d-7ef1-4bf9-8e30-71983e34968d admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:28.154266 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08489d0d-7ef1-4bf9-8e30-71983e34968d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:28.155871 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08489d0d-7ef1-4bf9-8e30-71983e34968d admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:28.166196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1099/2197] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:46:28.170213 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01869b-8b95-474f-a621-5fc33e81706e admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:28.175578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:28.182830 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01869b-8b95-474f-a621-5fc33e81706e admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:28.188163 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48347824-0200-4849-bbcb-764788ed10f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:28.188911 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48347824-0200-4849-bbcb-764788ed10f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:28.189254 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48347824-0200-4849-bbcb-764788ed10f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:28.189593 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48347824-0200-4849-bbcb-764788ed10f4 admin admin] PATH_INFO: `/v3/projects/8ab34039ee6e4e8493f5d6a9d981f58d/users/3aef706cd4774d4eb64870cdf8e8f313/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:28.192784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48347824-0200-4849-bbcb-764788ed10f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ab34039ee6e4e8493f5d6a9d981f58d, user_id=3aef706cd4774d4eb64870cdf8e8f313, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:28.195535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48347824-0200-4849-bbcb-764788ed10f4 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:28.207101 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1099/2198] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:46:28 2022] PUT /identity/v3/projects/8ab34039ee6e4e8493f5d6a9d981f58d/users/3aef706cd4774d4eb64870cdf8e8f313/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:28.217191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83d213-4162-4722-9d6b-e615a14bdf04 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:28.217489 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83d213-4162-4722-9d6b-e615a14bdf04 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:28.217767 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83d213-4162-4722-9d6b-e615a14bdf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:28.246666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-1f83d213-4162-4722-9d6b-e615a14bdf04 None None] MFA Rules not processed for user `3aef706cd4774d4eb64870cdf8e8f313`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:28.247805 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-1f83d213-4162-4722-9d6b-e615a14bdf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:28.328635 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1100/2199] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:28.341428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48347824-0200-4849-bbcb-764788ed10f4 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:28.343597 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-48347824-0200-4849-bbcb-764788ed10f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:28.410864 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48347824-0200-4849-bbcb-764788ed10f4 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:28.414575 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4c5b6-1499-4a14-9f75-0ac44dfc82b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:28.415300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4c5b6-1499-4a14-9f75-0ac44dfc82b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:28.415743 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4c5b6-1499-4a14-9f75-0ac44dfc82b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:28.416079 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4c5b6-1499-4a14-9f75-0ac44dfc82b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:28.426291 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4c5b6-1499-4a14-9f75-0ac44dfc82b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:28.427731 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4c5b6-1499-4a14-9f75-0ac44dfc82b8 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:28.437489 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1100/2200] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:46:28.788976 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83d213-4162-4722-9d6b-e615a14bdf04 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:28.803664 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83d213-4162-4722-9d6b-e615a14bdf04 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:28.809161 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4d2f8-1f02-4068-b097-5def7726ee1c tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aef706cd4774d4eb64870cdf8e8f313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ab34039ee6e4e8493f5d6a9d981f58d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:28.809860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4d2f8-1f02-4068-b097-5def7726ee1c tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:28.810740 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4d2f8-1f02-4068-b097-5def7726ee1c tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:28.810740 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4d2f8-1f02-4068-b097-5def7726ee1c tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:28.811221 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4d2f8-1f02-4068-b097-5def7726ee1c tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:46:28.811609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4d2f8-1f02-4068-b097-5def7726ee1c tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:28.813319 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4d2f8-1f02-4068-b097-5def7726ee1c tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:28.836786 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1101/2201] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:46:28.841407 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4c5b6-1499-4a14-9f75-0ac44dfc82b8 service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:28.850894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4c5b6-1499-4a14-9f75-0ac44dfc82b8 service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:28.856247 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7f7e0-2e70-475d-944d-cd3d9cc2e77b tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aef706cd4774d4eb64870cdf8e8f313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ab34039ee6e4e8493f5d6a9d981f58d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:28.856855 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7f7e0-2e70-475d-944d-cd3d9cc2e77b tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:28.857144 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7f7e0-2e70-475d-944d-cd3d9cc2e77b tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:28.857545 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7f7e0-2e70-475d-944d-cd3d9cc2e77b tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:28.858223 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7f7e0-2e70-475d-944d-cd3d9cc2e77b tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:28.860377 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7f7e0-2e70-475d-944d-cd3d9cc2e77b tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:28.887699 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1101/2202] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:46:28 2022] POST /identity/v3/projects => generated 353 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:46:28.891815 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4d2f8-1f02-4068-b097-5def7726ee1c tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:28.903897 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4d2f8-1f02-4068-b097-5def7726ee1c tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:28.927534 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:28.971903 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff6f05-b75b-4c65-8b36-ab845d0ae5df tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aef706cd4774d4eb64870cdf8e8f313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ab34039ee6e4e8493f5d6a9d981f58d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:28.972972 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff6f05-b75b-4c65-8b36-ab845d0ae5df tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:28.973290 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff6f05-b75b-4c65-8b36-ab845d0ae5df tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:28.973578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff6f05-b75b-4c65-8b36-ab845d0ae5df tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:28.976893 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff6f05-b75b-4c65-8b36-ab845d0ae5df tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:46:28.977050 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff6f05-b75b-4c65-8b36-ab845d0ae5df tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:28.979735 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff6f05-b75b-4c65-8b36-ab845d0ae5df tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:29.004304 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1102/2203] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:46:29.047303 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7f7e0-2e70-475d-944d-cd3d9cc2e77b tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:29.059519 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7f7e0-2e70-475d-944d-cd3d9cc2e77b tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:29.066571 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d3791-d19d-4ecb-9cee-8694c46d9606 tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aef706cd4774d4eb64870cdf8e8f313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ab34039ee6e4e8493f5d6a9d981f58d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:29.067212 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d3791-d19d-4ecb-9cee-8694c46d9606 tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:29.067500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d3791-d19d-4ecb-9cee-8694c46d9606 tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:29.067849 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d3791-d19d-4ecb-9cee-8694c46d9606 tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] PATH_INFO: `/v3/projects/c2b965d3d8104219a2f1669c91dc2507` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:29.069183 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d3791-d19d-4ecb-9cee-8694c46d9606 tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c2b965d3d8104219a2f1669c91dc2507)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:29.071394 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d3791-d19d-4ecb-9cee-8694c46d9606 tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:29.133322 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-3f1d3791-d19d-4ecb-9cee-8694c46d9606 tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2b965d3d8104219a2f1669c91dc2507', 'request_id': 'req-3f1d3791-d19d-4ecb-9cee-8694c46d9606'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:29.144580 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-3f1d3791-d19d-4ecb-9cee-8694c46d9606 tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2b965d3d8104219a2f1669c91dc2507', 'request_id': 'req-3f1d3791-d19d-4ecb-9cee-8694c46d9606'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:29.155269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-3f1d3791-d19d-4ecb-9cee-8694c46d9606 tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2b965d3d8104219a2f1669c91dc2507', 'request_id': 'req-3f1d3791-d19d-4ecb-9cee-8694c46d9606'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:29.178088 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-3f1d3791-d19d-4ecb-9cee-8694c46d9606 tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] The token cache is being invalidate because project c2b965d3d8104219a2f1669c91dc2507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:46:29.178359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-3f1d3791-d19d-4ecb-9cee-8694c46d9606 tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:29.180185 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-3f1d3791-d19d-4ecb-9cee-8694c46d9606 tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:29.182769 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1102/2204] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:46:29 2022] DELETE /identity/v3/projects/c2b965d3d8104219a2f1669c91dc2507 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:29.426706 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff6f05-b75b-4c65-8b36-ab845d0ae5df tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:29.428551 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-eeff6f05-b75b-4c65-8b36-ab845d0ae5df tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:29.494643 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff6f05-b75b-4c65-8b36-ab845d0ae5df tempest-VolumeQuotaClassesTest-1976552226 tempest-VolumeQuotaClassesTest-1976552226-project-admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:29.551370 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d56c4e-975b-4a27-a393-ea523b733ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:29.551925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d56c4e-975b-4a27-a393-ea523b733ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:29.552207 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d56c4e-975b-4a27-a393-ea523b733ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:29.552482 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d56c4e-975b-4a27-a393-ea523b733ef3 admin admin] PATH_INFO: `/v3/users/ea32bd843f434e0bafdc1c79eb8de852` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:29.553617 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d56c4e-975b-4a27-a393-ea523b733ef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea32bd843f434e0bafdc1c79eb8de852)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:29.555599 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d56c4e-975b-4a27-a393-ea523b733ef3 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:29.606404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-57d56c4e-975b-4a27-a393-ea523b733ef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea32bd843f434e0bafdc1c79eb8de852'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:29.615756 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-57d56c4e-975b-4a27-a393-ea523b733ef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea32bd843f434e0bafdc1c79eb8de852'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:29.626295 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:29.632985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-57d56c4e-975b-4a27-a393-ea523b733ef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea32bd843f434e0bafdc1c79eb8de852'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:29.633735 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-57d56c4e-975b-4a27-a393-ea523b733ef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea32bd843f434e0bafdc1c79eb8de852'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:29.642818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-57d56c4e-975b-4a27-a393-ea523b733ef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea32bd843f434e0bafdc1c79eb8de852'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:29.648981 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1103/2205] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:46:29 2022] DELETE /identity/v3/users/ea32bd843f434e0bafdc1c79eb8de852 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:29.653557 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceed5f2-683f-4ca2-b12c-3531ad6d5a89 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:29.654114 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceed5f2-683f-4ca2-b12c-3531ad6d5a89 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:29.654364 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceed5f2-683f-4ca2-b12c-3531ad6d5a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:29.673893 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-aceed5f2-683f-4ca2-b12c-3531ad6d5a89 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:29.674953 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-aceed5f2-683f-4ca2-b12c-3531ad6d5a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:29.723180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:29.738491 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1103/2206] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:29.748515 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d56c4e-975b-4a27-a393-ea523b733ef3 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:29.749978 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-57d56c4e-975b-4a27-a393-ea523b733ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:29.816839 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d56c4e-975b-4a27-a393-ea523b733ef3 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:29.821241 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef8ab3-38bc-4961-8d5e-aacc278a44e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:29.822639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef8ab3-38bc-4961-8d5e-aacc278a44e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:29.823106 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef8ab3-38bc-4961-8d5e-aacc278a44e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:29.823547 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef8ab3-38bc-4961-8d5e-aacc278a44e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:29.838764 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef8ab3-38bc-4961-8d5e-aacc278a44e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:29.840265 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef8ab3-38bc-4961-8d5e-aacc278a44e5 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:29.855536 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1104/2207] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:46:29.954839 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceed5f2-683f-4ca2-b12c-3531ad6d5a89 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:29.956745 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-aceed5f2-683f-4ca2-b12c-3531ad6d5a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:30.028572 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceed5f2-683f-4ca2-b12c-3531ad6d5a89 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:30.032430 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ee724-4b38-443f-9a51-5864a08014e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:30.033036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ee724-4b38-443f-9a51-5864a08014e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:30.033314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ee724-4b38-443f-9a51-5864a08014e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:30.033583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ee724-4b38-443f-9a51-5864a08014e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:30.035442 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-4a3ee724-4b38-443f-9a51-5864a08014e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:30.073940 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef8ab3-38bc-4961-8d5e-aacc278a44e5 service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:30.076088 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e7ef8ab3-38bc-4961-8d5e-aacc278a44e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:30.119588 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ee724-4b38-443f-9a51-5864a08014e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:30.121462 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ee724-4b38-443f-9a51-5864a08014e5 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:30.133104 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1104/2208] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:46:30.186314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef8ab3-38bc-4961-8d5e-aacc278a44e5 service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:30.191312 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7273c3-0dca-4142-8647-685a76598324 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e94a60e43914cf38a5f2f88b182083f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:30.192046 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7273c3-0dca-4142-8647-685a76598324 service placement] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:30.192334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7273c3-0dca-4142-8647-685a76598324 service placement] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:30.192613 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7273c3-0dca-4142-8647-685a76598324 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:30.194357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-2d7273c3-0dca-4142-8647-685a76598324 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:30.207966 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7273c3-0dca-4142-8647-685a76598324 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:30.209566 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7273c3-0dca-4142-8647-685a76598324 service placement] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:30.220739 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1105/2209] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:46:30.284805 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ee724-4b38-443f-9a51-5864a08014e5 service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:30.286361 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-4a3ee724-4b38-443f-9a51-5864a08014e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:30.302392 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ee724-4b38-443f-9a51-5864a08014e5 service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:30.310035 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed83f9f-138a-4d53-831b-76f0cc25e507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:30.313917 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed83f9f-138a-4d53-831b-76f0cc25e507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:30.314183 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed83f9f-138a-4d53-831b-76f0cc25e507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:30.314586 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed83f9f-138a-4d53-831b-76f0cc25e507 admin admin] PATH_INFO: `/v3/projects/c11a00af3f954792af1be4823adc8d91` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:30.318428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed83f9f-138a-4d53-831b-76f0cc25e507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c11a00af3f954792af1be4823adc8d91)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:30.320622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed83f9f-138a-4d53-831b-76f0cc25e507 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:30.381500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7ed83f9f-138a-4d53-831b-76f0cc25e507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c11a00af3f954792af1be4823adc8d91', 'request_id': 'req-7ed83f9f-138a-4d53-831b-76f0cc25e507'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:30.393732 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7ed83f9f-138a-4d53-831b-76f0cc25e507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c11a00af3f954792af1be4823adc8d91', 'request_id': 'req-7ed83f9f-138a-4d53-831b-76f0cc25e507'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:30.400991 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7ed83f9f-138a-4d53-831b-76f0cc25e507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c11a00af3f954792af1be4823adc8d91', 'request_id': 'req-7ed83f9f-138a-4d53-831b-76f0cc25e507'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:30.414781 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7ed83f9f-138a-4d53-831b-76f0cc25e507 admin admin] The token cache is being invalidate because project c11a00af3f954792af1be4823adc8d91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:46:30.415091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7ed83f9f-138a-4d53-831b-76f0cc25e507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:30.416338 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7ed83f9f-138a-4d53-831b-76f0cc25e507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:30.417899 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1105/2210] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:46:30 2022] DELETE /identity/v3/projects/c11a00af3f954792af1be4823adc8d91 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:30.421939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7273c3-0dca-4142-8647-685a76598324 service placement] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:30.432780 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7273c3-0dca-4142-8647-685a76598324 service placement] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:30.509307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ea520-11fd-478c-989e-90501eaad65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:30.509979 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ea520-11fd-478c-989e-90501eaad65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:30.510259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ea520-11fd-478c-989e-90501eaad65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:30.510531 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ea520-11fd-478c-989e-90501eaad65a admin admin] PATH_INFO: `/v3/users/3aef706cd4774d4eb64870cdf8e8f313` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:30.511673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ea520-11fd-478c-989e-90501eaad65a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aef706cd4774d4eb64870cdf8e8f313)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:30.513620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ea520-11fd-478c-989e-90501eaad65a admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:30.537876 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:30.568823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b54ea520-11fd-478c-989e-90501eaad65a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aef706cd4774d4eb64870cdf8e8f313'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:30.577248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b54ea520-11fd-478c-989e-90501eaad65a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aef706cd4774d4eb64870cdf8e8f313'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:30.592433 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b54ea520-11fd-478c-989e-90501eaad65a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aef706cd4774d4eb64870cdf8e8f313'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:30.593542 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b54ea520-11fd-478c-989e-90501eaad65a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aef706cd4774d4eb64870cdf8e8f313'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:30.604350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b54ea520-11fd-478c-989e-90501eaad65a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aef706cd4774d4eb64870cdf8e8f313'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:30.613408 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1106/2211] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:46:30 2022] DELETE /identity/v3/users/3aef706cd4774d4eb64870cdf8e8f313 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:46:30.921156 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed83f9f-138a-4d53-831b-76f0cc25e507 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:30.922885 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-7ed83f9f-138a-4d53-831b-76f0cc25e507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:30.938096 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed83f9f-138a-4d53-831b-76f0cc25e507 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:30.971174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:31.006774 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12ecf0-c777-4885-813f-d1b73f755000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:31.007757 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12ecf0-c777-4885-813f-d1b73f755000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:31.008092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12ecf0-c777-4885-813f-d1b73f755000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:31.008388 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12ecf0-c777-4885-813f-d1b73f755000 admin admin] PATH_INFO: `/v3/projects/8ab34039ee6e4e8493f5d6a9d981f58d` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:31.009536 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12ecf0-c777-4885-813f-d1b73f755000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ab34039ee6e4e8493f5d6a9d981f58d)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:31.011465 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12ecf0-c777-4885-813f-d1b73f755000 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:31.057792 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-3f12ecf0-c777-4885-813f-d1b73f755000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ab34039ee6e4e8493f5d6a9d981f58d', 'request_id': 'req-3f12ecf0-c777-4885-813f-d1b73f755000'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:31.067196 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-3f12ecf0-c777-4885-813f-d1b73f755000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ab34039ee6e4e8493f5d6a9d981f58d', 'request_id': 'req-3f12ecf0-c777-4885-813f-d1b73f755000'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:31.073495 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-3f12ecf0-c777-4885-813f-d1b73f755000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ab34039ee6e4e8493f5d6a9d981f58d', 'request_id': 'req-3f12ecf0-c777-4885-813f-d1b73f755000'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:31.085656 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-3f12ecf0-c777-4885-813f-d1b73f755000 admin admin] The token cache is being invalidate because project 8ab34039ee6e4e8493f5d6a9d981f58d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:46:31.085901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-3f12ecf0-c777-4885-813f-d1b73f755000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:31.086575 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-3f12ecf0-c777-4885-813f-d1b73f755000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:31.088778 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1106/2212] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:46:30 2022] DELETE /identity/v3/projects/8ab34039ee6e4e8493f5d6a9d981f58d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:31.094973 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153420f7-eb10-4ebb-95f9-27376e2d1086 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:31.095256 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153420f7-eb10-4ebb-95f9-27376e2d1086 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:31.095585 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153420f7-eb10-4ebb-95f9-27376e2d1086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:31.117412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-153420f7-eb10-4ebb-95f9-27376e2d1086 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:31.118921 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-153420f7-eb10-4ebb-95f9-27376e2d1086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:31.201557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1107/2213] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:31.209391 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a7be1-ba3f-44c6-94c7-1f295120d8bb None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:31.209674 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a7be1-ba3f-44c6-94c7-1f295120d8bb None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:31.209975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a7be1-ba3f-44c6-94c7-1f295120d8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:31.233947 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-f71a7be1-ba3f-44c6-94c7-1f295120d8bb None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:31.235107 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-f71a7be1-ba3f-44c6-94c7-1f295120d8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:31.243331 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1107/2214] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:31.247807 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153420f7-eb10-4ebb-95f9-27376e2d1086 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:31.257835 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153420f7-eb10-4ebb-95f9-27376e2d1086 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:31.262478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c45a60-b12a-4920-9cc7-a92c37771a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:31.263083 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c45a60-b12a-4920-9cc7-a92c37771a64 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:31.263358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c45a60-b12a-4920-9cc7-a92c37771a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:31.266180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c45a60-b12a-4920-9cc7-a92c37771a64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:31.266866 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c45a60-b12a-4920-9cc7-a92c37771a64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:46:31.267180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c45a60-b12a-4920-9cc7-a92c37771a64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:31.268803 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c45a60-b12a-4920-9cc7-a92c37771a64 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:31.281755 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1108/2215] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:46:31.286250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a7be1-ba3f-44c6-94c7-1f295120d8bb None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:31.296481 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a7be1-ba3f-44c6-94c7-1f295120d8bb None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:31.301078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decf657-f0f9-48e9-9b33-fc4507555a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:31.301669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decf657-f0f9-48e9-9b33-fc4507555a6a admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:31.302007 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decf657-f0f9-48e9-9b33-fc4507555a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:31.302282 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decf657-f0f9-48e9-9b33-fc4507555a6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:31.302916 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decf657-f0f9-48e9-9b33-fc4507555a6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:31.304809 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decf657-f0f9-48e9-9b33-fc4507555a6a admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:31.331577 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1108/2216] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:46:31 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:46:31.335762 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c45a60-b12a-4920-9cc7-a92c37771a64 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:31.346184 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c45a60-b12a-4920-9cc7-a92c37771a64 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:31.402133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225003e-133d-496e-b27b-80d91a672c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:31.402733 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225003e-133d-496e-b27b-80d91a672c4c admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:31.403032 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225003e-133d-496e-b27b-80d91a672c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:31.403300 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225003e-133d-496e-b27b-80d91a672c4c admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:31.403929 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225003e-133d-496e-b27b-80d91a672c4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:31.405865 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225003e-133d-496e-b27b-80d91a672c4c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:31.426205 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1109/2217] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:46:31 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:46:31.430342 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decf657-f0f9-48e9-9b33-fc4507555a6a admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:31.442088 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decf657-f0f9-48e9-9b33-fc4507555a6a admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:31.447284 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd4b4e-04fc-43e1-9378-36653ae3c1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:31.447886 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd4b4e-04fc-43e1-9378-36653ae3c1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:31.448159 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd4b4e-04fc-43e1-9378-36653ae3c1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:31.448425 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd4b4e-04fc-43e1-9378-36653ae3c1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:31.449103 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd4b4e-04fc-43e1-9378-36653ae3c1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:31.450744 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd4b4e-04fc-43e1-9378-36653ae3c1b2 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:31.461963 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1109/2218] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:46:31.466766 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225003e-133d-496e-b27b-80d91a672c4c admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:31.476915 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225003e-133d-496e-b27b-80d91a672c4c admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:31.483379 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540f383-d999-4225-9978-9007fc4626e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:31.483930 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540f383-d999-4225-9978-9007fc4626e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:31.484196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540f383-d999-4225-9978-9007fc4626e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:31.484469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540f383-d999-4225-9978-9007fc4626e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:31.485115 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540f383-d999-4225-9978-9007fc4626e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:31.486756 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540f383-d999-4225-9978-9007fc4626e4 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:31.498935 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1110/2219] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:46:31.503051 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd4b4e-04fc-43e1-9378-36653ae3c1b2 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:31.514553 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd4b4e-04fc-43e1-9378-36653ae3c1b2 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:31.519323 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f26c79-310c-4fe9-a5d5-f0146034f34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:31.520007 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f26c79-310c-4fe9-a5d5-f0146034f34e admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:31.520295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f26c79-310c-4fe9-a5d5-f0146034f34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:31.520569 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f26c79-310c-4fe9-a5d5-f0146034f34e admin admin] PATH_INFO: `/v3/projects/f9a576320ee0493fa8cdc0d404c817c7/users/21d09133e5c64992aeef044a440c98fa/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:31.536530 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f26c79-310c-4fe9-a5d5-f0146034f34e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a576320ee0493fa8cdc0d404c817c7, user_id=21d09133e5c64992aeef044a440c98fa, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:31.539289 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f26c79-310c-4fe9-a5d5-f0146034f34e admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:31.553673 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1110/2220] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:46:31 2022] PUT /identity/v3/projects/f9a576320ee0493fa8cdc0d404c817c7/users/21d09133e5c64992aeef044a440c98fa/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:31.564641 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedc1bc-311c-4080-878f-abb82ac2b2bb None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:31.564929 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedc1bc-311c-4080-878f-abb82ac2b2bb None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:31.565198 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedc1bc-311c-4080-878f-abb82ac2b2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:31.572911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:31.597778 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-cfedc1bc-311c-4080-878f-abb82ac2b2bb None None] MFA Rules not processed for user `21d09133e5c64992aeef044a440c98fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:31.598950 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-cfedc1bc-311c-4080-878f-abb82ac2b2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:31.664236 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1111/2221] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:31.676147 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f26c79-310c-4fe9-a5d5-f0146034f34e admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:31.677891 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-75f26c79-310c-4fe9-a5d5-f0146034f34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:31.756562 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f26c79-310c-4fe9-a5d5-f0146034f34e admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:31.761293 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6870cd-07a1-4972-bad4-b36e49a4dcf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:31.761951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6870cd-07a1-4972-bad4-b36e49a4dcf3 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:31.762201 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6870cd-07a1-4972-bad4-b36e49a4dcf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:31.762470 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6870cd-07a1-4972-bad4-b36e49a4dcf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:31.771274 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6870cd-07a1-4972-bad4-b36e49a4dcf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:31.772713 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6870cd-07a1-4972-bad4-b36e49a4dcf3 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:31.778780 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:31.787295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1111/2222] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:46:32.296641 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e27fef-95d3-4144-bf5e-92d617520462 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:32.296993 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e27fef-95d3-4144-bf5e-92d617520462 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:32.297330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e27fef-95d3-4144-bf5e-92d617520462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:32.317782 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-59e27fef-95d3-4144-bf5e-92d617520462 None None] MFA Rules not processed for user `a1bdbce1b3d047cfa5ddf72f902ecd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:32.319076 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-59e27fef-95d3-4144-bf5e-92d617520462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:32.385648 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1112/2223] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Oct 20 14:46:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:32.407919 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6870cd-07a1-4972-bad4-b36e49a4dcf3 service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:32.410242 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-5e6870cd-07a1-4972-bad4-b36e49a4dcf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:32.490005 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6870cd-07a1-4972-bad4-b36e49a4dcf3 service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:32.496214 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c971a1-3588-4c2c-92e9-53626fad5ee8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60d62d14cd4042ab1bff5509e30f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:32.496837 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c971a1-3588-4c2c-92e9-53626fad5ee8 service swift] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:32.497120 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c971a1-3588-4c2c-92e9-53626fad5ee8 service swift] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:32.497398 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c971a1-3588-4c2c-92e9-53626fad5ee8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:32.506127 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c971a1-3588-4c2c-92e9-53626fad5ee8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:32.507951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c971a1-3588-4c2c-92e9-53626fad5ee8 service swift] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:32.516482 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1112/2224] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Oct 20 14:46:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 14:46:42.375688 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=56 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:42.513477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=32 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:43.517519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e27fef-95d3-4144-bf5e-92d617520462 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:43.578154 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e27fef-95d3-4144-bf5e-92d617520462 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:43.582592 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5352d-17ff-418b-931c-afa466da8a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:43.583217 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5352d-17ff-418b-931c-afa466da8a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:43.583493 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5352d-17ff-418b-931c-afa466da8a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:43.583763 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5352d-17ff-418b-931c-afa466da8a2e admin admin] PATH_INFO: `/v3/users/21d09133e5c64992aeef044a440c98fa` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:43.584875 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5352d-17ff-418b-931c-afa466da8a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=21d09133e5c64992aeef044a440c98fa)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:43.586837 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5352d-17ff-418b-931c-afa466da8a2e admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:43.631251 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-25c5352d-17ff-418b-931c-afa466da8a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21d09133e5c64992aeef044a440c98fa'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:43.638740 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-25c5352d-17ff-418b-931c-afa466da8a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21d09133e5c64992aeef044a440c98fa'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:43.651258 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-25c5352d-17ff-418b-931c-afa466da8a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21d09133e5c64992aeef044a440c98fa'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:43.651915 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-25c5352d-17ff-418b-931c-afa466da8a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21d09133e5c64992aeef044a440c98fa'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:43.659439 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-25c5352d-17ff-418b-931c-afa466da8a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21d09133e5c64992aeef044a440c98fa'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:43.665303 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1113/2225] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:46:43 2022] DELETE /identity/v3/users/21d09133e5c64992aeef044a440c98fa => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:43.670130 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262828dc-d569-4820-8c7f-5e43df36b68a None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:43.670632 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262828dc-d569-4820-8c7f-5e43df36b68a None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:43.670748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262828dc-d569-4820-8c7f-5e43df36b68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:43.689960 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-262828dc-d569-4820-8c7f-5e43df36b68a None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:43.691102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-262828dc-d569-4820-8c7f-5e43df36b68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:43.751960 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1113/2226] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:43.765206 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5352d-17ff-418b-931c-afa466da8a2e admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:43.767831 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-25c5352d-17ff-418b-931c-afa466da8a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:43.833051 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5352d-17ff-418b-931c-afa466da8a2e admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:43.838609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6315a-51a4-4677-b26c-a9b5bc5f1dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:43.839225 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6315a-51a4-4677-b26c-a9b5bc5f1dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:43.839504 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6315a-51a4-4677-b26c-a9b5bc5f1dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:43.839770 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6315a-51a4-4677-b26c-a9b5bc5f1dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:43.852985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6315a-51a4-4677-b26c-a9b5bc5f1dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:43.854601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6315a-51a4-4677-b26c-a9b5bc5f1dc5 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:43.865101 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1114/2227] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:46:44.268595 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262828dc-d569-4820-8c7f-5e43df36b68a None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:44.270558 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-262828dc-d569-4820-8c7f-5e43df36b68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:44.287674 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262828dc-d569-4820-8c7f-5e43df36b68a None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:44.292895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6606d-9ab5-4f45-a1ce-99e9a5ae2bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:44.293526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6606d-9ab5-4f45-a1ce-99e9a5ae2bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:44.293829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6606d-9ab5-4f45-a1ce-99e9a5ae2bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:44.294127 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6606d-9ab5-4f45-a1ce-99e9a5ae2bd9 admin admin] PATH_INFO: `/v3/projects/f9a576320ee0493fa8cdc0d404c817c7` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:44.295277 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6606d-9ab5-4f45-a1ce-99e9a5ae2bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a576320ee0493fa8cdc0d404c817c7)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:44.297208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6606d-9ab5-4f45-a1ce-99e9a5ae2bd9 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:44.355924 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-cfd6606d-9ab5-4f45-a1ce-99e9a5ae2bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a576320ee0493fa8cdc0d404c817c7', 'request_id': 'req-cfd6606d-9ab5-4f45-a1ce-99e9a5ae2bd9'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:44.369434 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-cfd6606d-9ab5-4f45-a1ce-99e9a5ae2bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a576320ee0493fa8cdc0d404c817c7', 'request_id': 'req-cfd6606d-9ab5-4f45-a1ce-99e9a5ae2bd9'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:44.383791 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-cfd6606d-9ab5-4f45-a1ce-99e9a5ae2bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a576320ee0493fa8cdc0d404c817c7', 'request_id': 'req-cfd6606d-9ab5-4f45-a1ce-99e9a5ae2bd9'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:44.398125 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-cfd6606d-9ab5-4f45-a1ce-99e9a5ae2bd9 admin admin] The token cache is being invalidate because project f9a576320ee0493fa8cdc0d404c817c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:46:44.398419 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-cfd6606d-9ab5-4f45-a1ce-99e9a5ae2bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:44.399263 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-cfd6606d-9ab5-4f45-a1ce-99e9a5ae2bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:44.401332 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1114/2228] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:46:44 2022] DELETE /identity/v3/projects/f9a576320ee0493fa8cdc0d404c817c7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:44.405943 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03b32e-e5bf-41b8-95d9-40c8ceb2f1ef None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:44.406238 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03b32e-e5bf-41b8-95d9-40c8ceb2f1ef None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:44.406516 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03b32e-e5bf-41b8-95d9-40c8ceb2f1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:44.426897 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-4a03b32e-e5bf-41b8-95d9-40c8ceb2f1ef None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:44.428139 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-4a03b32e-e5bf-41b8-95d9-40c8ceb2f1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:44.449210 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:44.500409 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1115/2229] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:44.508342 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666465ea-fefa-4b75-b4d6-d1bccee4de40 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:44.508708 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666465ea-fefa-4b75-b4d6-d1bccee4de40 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:44.508993 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666465ea-fefa-4b75-b4d6-d1bccee4de40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:44.531206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-666465ea-fefa-4b75-b4d6-d1bccee4de40 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:44.532415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-666465ea-fefa-4b75-b4d6-d1bccee4de40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:44.540551 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1115/2230] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:44.545387 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03b32e-e5bf-41b8-95d9-40c8ceb2f1ef None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:44.555333 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03b32e-e5bf-41b8-95d9-40c8ceb2f1ef None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:44.560178 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df871e0d-32dd-42e7-9d90-5b68f9da2d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:44.560894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df871e0d-32dd-42e7-9d90-5b68f9da2d45 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:44.561296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df871e0d-32dd-42e7-9d90-5b68f9da2d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:44.561667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df871e0d-32dd-42e7-9d90-5b68f9da2d45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:44.562450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df871e0d-32dd-42e7-9d90-5b68f9da2d45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:46:44.562857 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df871e0d-32dd-42e7-9d90-5b68f9da2d45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:44.564603 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df871e0d-32dd-42e7-9d90-5b68f9da2d45 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:44.576729 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1116/2231] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:46:44.581309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666465ea-fefa-4b75-b4d6-d1bccee4de40 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:44.591237 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666465ea-fefa-4b75-b4d6-d1bccee4de40 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:44.596529 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ce50f-76c2-4d6e-a3e8-719387dfb9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:44.597135 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ce50f-76c2-4d6e-a3e8-719387dfb9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:44.597415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ce50f-76c2-4d6e-a3e8-719387dfb9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:44.597687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ce50f-76c2-4d6e-a3e8-719387dfb9e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:44.598367 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ce50f-76c2-4d6e-a3e8-719387dfb9e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:44.600275 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ce50f-76c2-4d6e-a3e8-719387dfb9e9 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:44.634405 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1116/2232] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:46:44 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:46:44.635762 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df871e0d-32dd-42e7-9d90-5b68f9da2d45 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:44.647346 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df871e0d-32dd-42e7-9d90-5b68f9da2d45 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:44.668833 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ce50f-76c2-4d6e-a3e8-719387dfb9e9 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:44.670768 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-602ce50f-76c2-4d6e-a3e8-719387dfb9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:44.735670 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fac920-8676-4dff-bdc0-b9d00e3b5a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:44.737053 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fac920-8676-4dff-bdc0-b9d00e3b5a0a admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:44.737490 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fac920-8676-4dff-bdc0-b9d00e3b5a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:44.738352 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fac920-8676-4dff-bdc0-b9d00e3b5a0a admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:44.739358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fac920-8676-4dff-bdc0-b9d00e3b5a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:44.742014 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fac920-8676-4dff-bdc0-b9d00e3b5a0a admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:44.776076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:44.801999 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1117/2233] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:46:44 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:46:44.806272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fac920-8676-4dff-bdc0-b9d00e3b5a0a admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:44.825149 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ce50f-76c2-4d6e-a3e8-719387dfb9e9 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:44.828068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fac920-8676-4dff-bdc0-b9d00e3b5a0a admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:44.837411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130de061-d055-4ee4-999e-a62b9780fd1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:44.840253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130de061-d055-4ee4-999e-a62b9780fd1c service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:44.840548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130de061-d055-4ee4-999e-a62b9780fd1c service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:44.841480 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fe4f2-a953-447a-a9bf-3b41cdf26d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:44.842441 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fe4f2-a953-447a-a9bf-3b41cdf26d8f admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:44.842868 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130de061-d055-4ee4-999e-a62b9780fd1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:44.843596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fe4f2-a953-447a-a9bf-3b41cdf26d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:44.843910 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fe4f2-a953-447a-a9bf-3b41cdf26d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:44.844571 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877fe4f2-a953-447a-a9bf-3b41cdf26d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:44.847519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877fe4f2-a953-447a-a9bf-3b41cdf26d8f admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:44.849922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-130de061-d055-4ee4-999e-a62b9780fd1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:44.870702 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1118/2234] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:46:44.877203 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fe4f2-a953-447a-a9bf-3b41cdf26d8f admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:44.878961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130de061-d055-4ee4-999e-a62b9780fd1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:44.888671 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130de061-d055-4ee4-999e-a62b9780fd1c service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:44.894705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fe4f2-a953-447a-a9bf-3b41cdf26d8f admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:44.903409 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1117/2235] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:46:44.905741 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53552a-4e70-498c-9b31-dd7ecbaf5add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:44.906392 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53552a-4e70-498c-9b31-dd7ecbaf5add admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:44.906673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53552a-4e70-498c-9b31-dd7ecbaf5add admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:44.906944 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53552a-4e70-498c-9b31-dd7ecbaf5add admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:44.907582 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53552a-4e70-498c-9b31-dd7ecbaf5add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:44.909355 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53552a-4e70-498c-9b31-dd7ecbaf5add admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:44.921508 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1119/2236] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:46:44.925739 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130de061-d055-4ee4-999e-a62b9780fd1c service nova] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:44.950227 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130de061-d055-4ee4-999e-a62b9780fd1c service nova] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:44.957485 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e72e9-1818-47a7-8f1b-887f81fa3c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:44.958468 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e72e9-1818-47a7-8f1b-887f81fa3c14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:44.958987 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e72e9-1818-47a7-8f1b-887f81fa3c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:44.959488 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e72e9-1818-47a7-8f1b-887f81fa3c14 admin admin] PATH_INFO: `/v3/projects/5c4d97715cbd47d9baeade0756acc277/users/9e48fbf6ca0746eaa44bdc1c0b92021d/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:44.978980 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e72e9-1818-47a7-8f1b-887f81fa3c14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c4d97715cbd47d9baeade0756acc277, user_id=9e48fbf6ca0746eaa44bdc1c0b92021d, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:44.981817 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e72e9-1818-47a7-8f1b-887f81fa3c14 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:44.995130 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1118/2237] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:46:44 2022] PUT /identity/v3/projects/5c4d97715cbd47d9baeade0756acc277/users/9e48fbf6ca0746eaa44bdc1c0b92021d/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:45.006318 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe141cc-c839-4a4d-b011-9791d7efa236 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:45.006600 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe141cc-c839-4a4d-b011-9791d7efa236 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:45.007125 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe141cc-c839-4a4d-b011-9791d7efa236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:45.035857 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-ebe141cc-c839-4a4d-b011-9791d7efa236 None None] MFA Rules not processed for user `9e48fbf6ca0746eaa44bdc1c0b92021d`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:45.036983 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ebe141cc-c839-4a4d-b011-9791d7efa236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:45.113932 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1120/2238] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:45.126448 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e72e9-1818-47a7-8f1b-887f81fa3c14 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:45.129266 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-885e72e9-1818-47a7-8f1b-887f81fa3c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:45.206318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e72e9-1818-47a7-8f1b-887f81fa3c14 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:45.209952 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50eb827-d829-4e7f-9106-7037bf51b977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:45.210557 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50eb827-d829-4e7f-9106-7037bf51b977 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:45.210831 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50eb827-d829-4e7f-9106-7037bf51b977 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:45.211100 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50eb827-d829-4e7f-9106-7037bf51b977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:45.221542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50eb827-d829-4e7f-9106-7037bf51b977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:45.223023 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50eb827-d829-4e7f-9106-7037bf51b977 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:45.234114 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1119/2239] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:46:46.420947 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe141cc-c839-4a4d-b011-9791d7efa236 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:46.423121 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ebe141cc-c839-4a4d-b011-9791d7efa236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:46.435381 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:46.543080 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe141cc-c839-4a4d-b011-9791d7efa236 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:46.549212 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19ec9b-5eef-4f9c-953b-6d2d4883217e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:46.549976 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19ec9b-5eef-4f9c-953b-6d2d4883217e service nova] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:46.550260 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19ec9b-5eef-4f9c-953b-6d2d4883217e service nova] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:46.550528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19ec9b-5eef-4f9c-953b-6d2d4883217e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:46.552314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ad19ec9b-5eef-4f9c-953b-6d2d4883217e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:46.565823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19ec9b-5eef-4f9c-953b-6d2d4883217e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:46.567485 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19ec9b-5eef-4f9c-953b-6d2d4883217e service nova] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:46.578970 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1121/2240] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:46:47.967685 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176bb27-92c7-44b8-a553-22aeb9cf095e None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:47.968125 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176bb27-92c7-44b8-a553-22aeb9cf095e None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:47.968257 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176bb27-92c7-44b8-a553-22aeb9cf095e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:47.987769 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-1176bb27-92c7-44b8-a553-22aeb9cf095e None None] MFA Rules not processed for user `a1bdbce1b3d047cfa5ddf72f902ecd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:47.988955 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-1176bb27-92c7-44b8-a553-22aeb9cf095e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:48.043601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1120/2241] 10.222.0.17 () {58 vars in 967 bytes} [Thu Oct 20 14:46:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:46:48.055836 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19ec9b-5eef-4f9c-953b-6d2d4883217e service nova] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:48.057835 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ad19ec9b-5eef-4f9c-953b-6d2d4883217e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:48.126226 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19ec9b-5eef-4f9c-953b-6d2d4883217e service nova] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:48.131170 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340dd096-8a4d-46b0-8bf0-74fa68a85e09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60d62d14cd4042ab1bff5509e30f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:48.132055 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dd096-8a4d-46b0-8bf0-74fa68a85e09 service swift] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:48.132340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dd096-8a4d-46b0-8bf0-74fa68a85e09 service swift] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:48.132610 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dd096-8a4d-46b0-8bf0-74fa68a85e09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:48.141318 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340dd096-8a4d-46b0-8bf0-74fa68a85e09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:48.142824 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340dd096-8a4d-46b0-8bf0-74fa68a85e09 service swift] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:48.151514 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1122/2242] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Oct 20 14:46:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 14:46:50.864088 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176bb27-92c7-44b8-a553-22aeb9cf095e None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:50.865676 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-1176bb27-92c7-44b8-a553-22aeb9cf095e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:50.932003 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176bb27-92c7-44b8-a553-22aeb9cf095e None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:50.935853 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0a15d-f23a-4e6f-9f13-135f2c1a68d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:50.936506 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0a15d-f23a-4e6f-9f13-135f2c1a68d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:50.936788 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0a15d-f23a-4e6f-9f13-135f2c1a68d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:50.937062 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0a15d-f23a-4e6f-9f13-135f2c1a68d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:50.938855 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d7d0a15d-f23a-4e6f-9f13-135f2c1a68d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:50.960258 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:51.011064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0a15d-f23a-4e6f-9f13-135f2c1a68d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:51.012510 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0a15d-f23a-4e6f-9f13-135f2c1a68d6 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:51.022631 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1121/2243] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:46:54.249649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340dd096-8a4d-46b0-8bf0-74fa68a85e09 service swift] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:54.251240 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-340dd096-8a4d-46b0-8bf0-74fa68a85e09 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:54.268516 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340dd096-8a4d-46b0-8bf0-74fa68a85e09 service swift] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:54.273306 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b47bbe-db3f-4998-9e91-8f2e17f504a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:54.274002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b47bbe-db3f-4998-9e91-8f2e17f504a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:54.274287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b47bbe-db3f-4998-9e91-8f2e17f504a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:54.275252 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b47bbe-db3f-4998-9e91-8f2e17f504a2 admin admin] PATH_INFO: `/v3/users/b5b9894a359c48dcbf10f55565191e39` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:54.276515 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b47bbe-db3f-4998-9e91-8f2e17f504a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5b9894a359c48dcbf10f55565191e39)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:54.278748 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b47bbe-db3f-4998-9e91-8f2e17f504a2 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:54.330517 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-27b47bbe-db3f-4998-9e91-8f2e17f504a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5b9894a359c48dcbf10f55565191e39'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:54.337614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-27b47bbe-db3f-4998-9e91-8f2e17f504a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5b9894a359c48dcbf10f55565191e39'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:54.349311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-27b47bbe-db3f-4998-9e91-8f2e17f504a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5b9894a359c48dcbf10f55565191e39'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:54.350031 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-27b47bbe-db3f-4998-9e91-8f2e17f504a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5b9894a359c48dcbf10f55565191e39'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:54.352817 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:54.358721 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-27b47bbe-db3f-4998-9e91-8f2e17f504a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5b9894a359c48dcbf10f55565191e39'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:54.366268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1123/2244] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:46:54 2022] DELETE /identity/v3/users/b5b9894a359c48dcbf10f55565191e39 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:54.548562 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0a15d-f23a-4e6f-9f13-135f2c1a68d6 service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:54.559985 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0a15d-f23a-4e6f-9f13-135f2c1a68d6 service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:54.640843 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0f0be-9016-48bf-bb2b-2aad8e36b1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:54.641528 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0f0be-9016-48bf-bb2b-2aad8e36b1fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:54.641807 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0f0be-9016-48bf-bb2b-2aad8e36b1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:54.642113 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0f0be-9016-48bf-bb2b-2aad8e36b1fc admin admin] PATH_INFO: `/v3/projects/5a5d0f3a9160485ca819b6be6b782129` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:54.643270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0f0be-9016-48bf-bb2b-2aad8e36b1fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a5d0f3a9160485ca819b6be6b782129)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:54.645281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0f0be-9016-48bf-bb2b-2aad8e36b1fc admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:54.693468 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-09f0f0be-9016-48bf-bb2b-2aad8e36b1fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a5d0f3a9160485ca819b6be6b782129', 'request_id': 'req-09f0f0be-9016-48bf-bb2b-2aad8e36b1fc'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:54.701872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-09f0f0be-9016-48bf-bb2b-2aad8e36b1fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a5d0f3a9160485ca819b6be6b782129', 'request_id': 'req-09f0f0be-9016-48bf-bb2b-2aad8e36b1fc'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:54.707639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-09f0f0be-9016-48bf-bb2b-2aad8e36b1fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a5d0f3a9160485ca819b6be6b782129', 'request_id': 'req-09f0f0be-9016-48bf-bb2b-2aad8e36b1fc'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:54.719991 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-09f0f0be-9016-48bf-bb2b-2aad8e36b1fc admin admin] The token cache is being invalidate because project 5a5d0f3a9160485ca819b6be6b782129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:46:54.720196 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-09f0f0be-9016-48bf-bb2b-2aad8e36b1fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:54.721061 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-09f0f0be-9016-48bf-bb2b-2aad8e36b1fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:54.722684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1122/2245] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:46:54 2022] DELETE /identity/v3/projects/5a5d0f3a9160485ca819b6be6b782129 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:54.727990 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750565e2-7468-41fc-ae8a-f85125e52c6a None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:54.728363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750565e2-7468-41fc-ae8a-f85125e52c6a None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:54.728641 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750565e2-7468-41fc-ae8a-f85125e52c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:54.747873 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-750565e2-7468-41fc-ae8a-f85125e52c6a None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:54.749105 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-750565e2-7468-41fc-ae8a-f85125e52c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:54.808101 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1124/2246] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:54.815715 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112185e-4563-44dd-ad22-060a006b6ed0 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:54.816005 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112185e-4563-44dd-ad22-060a006b6ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:54.816311 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112185e-4563-44dd-ad22-060a006b6ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:54.836457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-e112185e-4563-44dd-ad22-060a006b6ed0 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:54.838305 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e112185e-4563-44dd-ad22-060a006b6ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:54.846498 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1123/2247] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:54.850729 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750565e2-7468-41fc-ae8a-f85125e52c6a None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:54.861172 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750565e2-7468-41fc-ae8a-f85125e52c6a None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:54.866206 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584d8d3-9bdd-4508-a77a-0c2a4c5e3149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:54.866729 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584d8d3-9bdd-4508-a77a-0c2a4c5e3149 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:54.867006 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584d8d3-9bdd-4508-a77a-0c2a4c5e3149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:54.867287 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584d8d3-9bdd-4508-a77a-0c2a4c5e3149 admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:54.867909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584d8d3-9bdd-4508-a77a-0c2a4c5e3149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:46:54.868357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584d8d3-9bdd-4508-a77a-0c2a4c5e3149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:54.870068 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584d8d3-9bdd-4508-a77a-0c2a4c5e3149 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:54.882455 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1125/2248] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:46:54.886879 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112185e-4563-44dd-ad22-060a006b6ed0 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:54.896495 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112185e-4563-44dd-ad22-060a006b6ed0 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:54.901743 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9556f2-193b-4146-906c-3f7f1dfdcdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:54.902371 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9556f2-193b-4146-906c-3f7f1dfdcdac admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:54.902717 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9556f2-193b-4146-906c-3f7f1dfdcdac admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:54.902992 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9556f2-193b-4146-906c-3f7f1dfdcdac admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:54.904769 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9556f2-193b-4146-906c-3f7f1dfdcdac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:54.906718 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9556f2-193b-4146-906c-3f7f1dfdcdac admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:54.938421 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1124/2249] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:46:54 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:46:54.939569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584d8d3-9bdd-4508-a77a-0c2a4c5e3149 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:54.951584 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584d8d3-9bdd-4508-a77a-0c2a4c5e3149 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:55.010132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41237c61-4d6e-4fd2-9ecf-4b0157356058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:55.010742 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41237c61-4d6e-4fd2-9ecf-4b0157356058 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:55.011021 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41237c61-4d6e-4fd2-9ecf-4b0157356058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:55.011293 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41237c61-4d6e-4fd2-9ecf-4b0157356058 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:55.011934 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41237c61-4d6e-4fd2-9ecf-4b0157356058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:55.013866 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41237c61-4d6e-4fd2-9ecf-4b0157356058 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:55.035040 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1126/2250] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:46:54 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:46:55.039463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9556f2-193b-4146-906c-3f7f1dfdcdac admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:55.049727 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9556f2-193b-4146-906c-3f7f1dfdcdac admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:55.054683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbfec6-1141-40ca-b3a9-209836bef213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:55.055315 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbfec6-1141-40ca-b3a9-209836bef213 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:55.055594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbfec6-1141-40ca-b3a9-209836bef213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:55.055866 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbfec6-1141-40ca-b3a9-209836bef213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:55.056539 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbfec6-1141-40ca-b3a9-209836bef213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:55.058196 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbfec6-1141-40ca-b3a9-209836bef213 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:55.068211 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1125/2251] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:46:55.072493 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41237c61-4d6e-4fd2-9ecf-4b0157356058 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:55.082350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41237c61-4d6e-4fd2-9ecf-4b0157356058 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:55.086997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e665e4-766c-4ca7-82bb-ffad485d9547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:55.087591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e665e4-766c-4ca7-82bb-ffad485d9547 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:55.087867 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e665e4-766c-4ca7-82bb-ffad485d9547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:55.088133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e665e4-766c-4ca7-82bb-ffad485d9547 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:55.088760 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e665e4-766c-4ca7-82bb-ffad485d9547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:55.090516 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e665e4-766c-4ca7-82bb-ffad485d9547 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:55.101047 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1127/2252] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:46:55.105714 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbfec6-1141-40ca-b3a9-209836bef213 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:55.112147 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:55.115888 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbfec6-1141-40ca-b3a9-209836bef213 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:55.121761 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24108e02-30ac-40f3-b60e-2c3fa0b2de95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:55.122593 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24108e02-30ac-40f3-b60e-2c3fa0b2de95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:55.123033 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24108e02-30ac-40f3-b60e-2c3fa0b2de95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:55.123360 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24108e02-30ac-40f3-b60e-2c3fa0b2de95 admin admin] PATH_INFO: `/v3/projects/cc62c491cd614c13af3d9fa30a32aa9d/users/b38de7c21009499291ba1db0fd295a7b/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:55.140219 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24108e02-30ac-40f3-b60e-2c3fa0b2de95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc62c491cd614c13af3d9fa30a32aa9d, user_id=b38de7c21009499291ba1db0fd295a7b, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:55.142920 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24108e02-30ac-40f3-b60e-2c3fa0b2de95 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:55.156211 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1126/2253] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:46:55 2022] PUT /identity/v3/projects/cc62c491cd614c13af3d9fa30a32aa9d/users/b38de7c21009499291ba1db0fd295a7b/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:55.161193 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee34de-3628-469a-80e5-86570dbb6ca4 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:55.161468 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee34de-3628-469a-80e5-86570dbb6ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:55.161740 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee34de-3628-469a-80e5-86570dbb6ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:55.180939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-5cee34de-3628-469a-80e5-86570dbb6ca4 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:55.181994 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-5cee34de-3628-469a-80e5-86570dbb6ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:55.233157 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:55.244704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1128/2254] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:55.252321 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24108e02-30ac-40f3-b60e-2c3fa0b2de95 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:55.254037 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-24108e02-30ac-40f3-b60e-2c3fa0b2de95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:55.310817 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24108e02-30ac-40f3-b60e-2c3fa0b2de95 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:55.314403 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e86b60-9e42-4f60-9c6b-bcfebf088840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:55.314997 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e86b60-9e42-4f60-9c6b-bcfebf088840 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:55.315271 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e86b60-9e42-4f60-9c6b-bcfebf088840 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:55.315539 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e86b60-9e42-4f60-9c6b-bcfebf088840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:55.324122 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e86b60-9e42-4f60-9c6b-bcfebf088840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:55.325526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e86b60-9e42-4f60-9c6b-bcfebf088840 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:55.334848 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1127/2255] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:46:55.659016 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee34de-3628-469a-80e5-86570dbb6ca4 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:55.660735 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-5cee34de-3628-469a-80e5-86570dbb6ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:55.674191 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee34de-3628-469a-80e5-86570dbb6ca4 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:55.679145 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f91ea1-ec96-421a-957f-396dec749f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:55.679780 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f91ea1-ec96-421a-957f-396dec749f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:55.680055 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f91ea1-ec96-421a-957f-396dec749f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:55.680328 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f91ea1-ec96-421a-957f-396dec749f81 admin admin] PATH_INFO: `/v3/users/9e48fbf6ca0746eaa44bdc1c0b92021d` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:55.681542 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f91ea1-ec96-421a-957f-396dec749f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e48fbf6ca0746eaa44bdc1c0b92021d)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:55.683543 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f91ea1-ec96-421a-957f-396dec749f81 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:55.735578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-a3f91ea1-ec96-421a-957f-396dec749f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e48fbf6ca0746eaa44bdc1c0b92021d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:55.742500 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-a3f91ea1-ec96-421a-957f-396dec749f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e48fbf6ca0746eaa44bdc1c0b92021d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:55.755432 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-a3f91ea1-ec96-421a-957f-396dec749f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e48fbf6ca0746eaa44bdc1c0b92021d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:55.756176 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-a3f91ea1-ec96-421a-957f-396dec749f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e48fbf6ca0746eaa44bdc1c0b92021d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:55.764830 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-a3f91ea1-ec96-421a-957f-396dec749f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e48fbf6ca0746eaa44bdc1c0b92021d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:55.770937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1129/2256] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:46:55 2022] DELETE /identity/v3/users/9e48fbf6ca0746eaa44bdc1c0b92021d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:55.776140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c37e7-7de1-4f3d-aeb4-67fe18fbac73 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:55.776650 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c37e7-7de1-4f3d-aeb4-67fe18fbac73 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:55.776754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c37e7-7de1-4f3d-aeb4-67fe18fbac73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:55.795689 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-178c37e7-7de1-4f3d-aeb4-67fe18fbac73 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:55.796911 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-178c37e7-7de1-4f3d-aeb4-67fe18fbac73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:55.858527 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1128/2257] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:46:55.868711 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f91ea1-ec96-421a-957f-396dec749f81 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:55.870237 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a3f91ea1-ec96-421a-957f-396dec749f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:55.931685 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f91ea1-ec96-421a-957f-396dec749f81 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:55.935633 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc18f1-6ef3-4b36-bd44-4e407f599322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:55.936248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc18f1-6ef3-4b36-bd44-4e407f599322 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:55.936527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc18f1-6ef3-4b36-bd44-4e407f599322 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:55.936879 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc18f1-6ef3-4b36-bd44-4e407f599322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:55.951030 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc18f1-6ef3-4b36-bd44-4e407f599322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:55.953073 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc18f1-6ef3-4b36-bd44-4e407f599322 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:55.968565 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1130/2258] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:46:56.457279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c37e7-7de1-4f3d-aeb4-67fe18fbac73 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:56.459030 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-178c37e7-7de1-4f3d-aeb4-67fe18fbac73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:56.476133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c37e7-7de1-4f3d-aeb4-67fe18fbac73 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:56.483011 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2d22e-0a3f-43a7-98e3-e33766f5b44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:56.483812 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2d22e-0a3f-43a7-98e3-e33766f5b44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:56.484095 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2d22e-0a3f-43a7-98e3-e33766f5b44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:56.484388 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2d22e-0a3f-43a7-98e3-e33766f5b44d admin admin] PATH_INFO: `/v3/projects/5c4d97715cbd47d9baeade0756acc277` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:56.485750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2d22e-0a3f-43a7-98e3-e33766f5b44d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c4d97715cbd47d9baeade0756acc277)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:56.487588 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2d22e-0a3f-43a7-98e3-e33766f5b44d admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:56.548844 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1bb2d22e-0a3f-43a7-98e3-e33766f5b44d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c4d97715cbd47d9baeade0756acc277', 'request_id': 'req-1bb2d22e-0a3f-43a7-98e3-e33766f5b44d'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:56.558877 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1bb2d22e-0a3f-43a7-98e3-e33766f5b44d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c4d97715cbd47d9baeade0756acc277', 'request_id': 'req-1bb2d22e-0a3f-43a7-98e3-e33766f5b44d'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:56.566664 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1bb2d22e-0a3f-43a7-98e3-e33766f5b44d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c4d97715cbd47d9baeade0756acc277', 'request_id': 'req-1bb2d22e-0a3f-43a7-98e3-e33766f5b44d'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:56.579085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1bb2d22e-0a3f-43a7-98e3-e33766f5b44d admin admin] The token cache is being invalidate because project 5c4d97715cbd47d9baeade0756acc277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:46:56.579509 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1bb2d22e-0a3f-43a7-98e3-e33766f5b44d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:56.580188 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1bb2d22e-0a3f-43a7-98e3-e33766f5b44d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:46:56.585302 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1129/2259] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:46:56 2022] DELETE /identity/v3/projects/5c4d97715cbd47d9baeade0756acc277 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:56.586971 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb9637-25fa-40d7-abb2-ec1a10f4fc8a None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:56.587266 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb9637-25fa-40d7-abb2-ec1a10f4fc8a None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:56.587707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb9637-25fa-40d7-abb2-ec1a10f4fc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:56.609478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-d0fb9637-25fa-40d7-abb2-ec1a10f4fc8a None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:56.610722 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-d0fb9637-25fa-40d7-abb2-ec1a10f4fc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:56.684274 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1131/2260] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:46:56.692098 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3382beb-b4df-42b6-9ecc-51861b18bfd0 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:56.692608 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3382beb-b4df-42b6-9ecc-51861b18bfd0 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:56.693028 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3382beb-b4df-42b6-9ecc-51861b18bfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:56.714583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:56.719227 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-b3382beb-b4df-42b6-9ecc-51861b18bfd0 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:56.720304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-b3382beb-b4df-42b6-9ecc-51861b18bfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:56.731349 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1130/2261] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:46:56.735596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb9637-25fa-40d7-abb2-ec1a10f4fc8a None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:56.745434 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb9637-25fa-40d7-abb2-ec1a10f4fc8a None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:56.750548 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187444d-93f4-4338-9aab-51d672603ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:56.751174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187444d-93f4-4338-9aab-51d672603ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:56.751456 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187444d-93f4-4338-9aab-51d672603ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:56.751723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187444d-93f4-4338-9aab-51d672603ab6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:56.752467 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187444d-93f4-4338-9aab-51d672603ab6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:46:56.752794 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187444d-93f4-4338-9aab-51d672603ab6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:56.754479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187444d-93f4-4338-9aab-51d672603ab6 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:56.769369 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1132/2262] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:46:56.773758 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3382beb-b4df-42b6-9ecc-51861b18bfd0 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:56.783686 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3382beb-b4df-42b6-9ecc-51861b18bfd0 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:56.788814 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083ba46-34c6-4a59-a58a-78cc361dd114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:56.794195 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083ba46-34c6-4a59-a58a-78cc361dd114 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:56.794735 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083ba46-34c6-4a59-a58a-78cc361dd114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:56.795180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083ba46-34c6-4a59-a58a-78cc361dd114 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:56.795880 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083ba46-34c6-4a59-a58a-78cc361dd114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:56.798084 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083ba46-34c6-4a59-a58a-78cc361dd114 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:56.829325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1131/2263] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:46:56 2022] POST /identity/v3/projects => generated 399 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:46:56.833540 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187444d-93f4-4338-9aab-51d672603ab6 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:56.840701 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:56.848471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187444d-93f4-4338-9aab-51d672603ab6 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:56.955549 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2026d3d-6bb4-4116-bb62-2f481986e8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:56.956242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2026d3d-6bb4-4116-bb62-2f481986e8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:56.956626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2026d3d-6bb4-4116-bb62-2f481986e8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:56.957082 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2026d3d-6bb4-4116-bb62-2f481986e8b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:56.958158 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2026d3d-6bb4-4116-bb62-2f481986e8b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:56.960355 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2026d3d-6bb4-4116-bb62-2f481986e8b7 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:57.001503 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1133/2264] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:46:56 2022] POST /identity/v3/users => generated 300 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:46:57.002844 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083ba46-34c6-4a59-a58a-78cc361dd114 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:57.015747 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083ba46-34c6-4a59-a58a-78cc361dd114 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:57.022525 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6bae8-5249-4ffe-b6e1-fe2ac7e2591d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:57.022765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6bae8-5249-4ffe-b6e1-fe2ac7e2591d admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:57.023325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6bae8-5249-4ffe-b6e1-fe2ac7e2591d admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:57.023601 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6bae8-5249-4ffe-b6e1-fe2ac7e2591d admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:57.024852 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6bae8-5249-4ffe-b6e1-fe2ac7e2591d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:57.026792 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6bae8-5249-4ffe-b6e1-fe2ac7e2591d admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:57.042441 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1132/2265] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:46:57.046635 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2026d3d-6bb4-4116-bb62-2f481986e8b7 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:57.066313 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2026d3d-6bb4-4116-bb62-2f481986e8b7 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:57.076168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec4582-3ce5-4c16-bc31-9b70762a97c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:57.076856 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec4582-3ce5-4c16-bc31-9b70762a97c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:57.077202 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec4582-3ce5-4c16-bc31-9b70762a97c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:57.077561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec4582-3ce5-4c16-bc31-9b70762a97c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:57.078306 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec4582-3ce5-4c16-bc31-9b70762a97c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:57.080030 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec4582-3ce5-4c16-bc31-9b70762a97c4 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:57.093687 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1134/2266] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:46:57.097698 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6bae8-5249-4ffe-b6e1-fe2ac7e2591d admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:57.109468 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6bae8-5249-4ffe-b6e1-fe2ac7e2591d admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:57.115333 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d272cc5-b555-4141-8bf8-785b5cc0d62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:57.116232 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d272cc5-b555-4141-8bf8-785b5cc0d62a admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:57.116510 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d272cc5-b555-4141-8bf8-785b5cc0d62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:57.116778 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d272cc5-b555-4141-8bf8-785b5cc0d62a admin admin] PATH_INFO: `/v3/projects/2b124641161c46e3adf302a5f0d446ad/users/afa0e958fae741d6a2f591187c51b58d/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:57.138740 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d272cc5-b555-4141-8bf8-785b5cc0d62a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b124641161c46e3adf302a5f0d446ad, user_id=afa0e958fae741d6a2f591187c51b58d, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:57.141435 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d272cc5-b555-4141-8bf8-785b5cc0d62a admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:57.161076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1133/2267] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:46:57 2022] PUT /identity/v3/projects/2b124641161c46e3adf302a5f0d446ad/users/afa0e958fae741d6a2f591187c51b58d/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:46:57.173675 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3808121-ab0d-4694-98ea-962cac561e91 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:57.174183 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3808121-ab0d-4694-98ea-962cac561e91 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:57.179383 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3808121-ab0d-4694-98ea-962cac561e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:57.209492 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-e3808121-ab0d-4694-98ea-962cac561e91 None None] MFA Rules not processed for user `afa0e958fae741d6a2f591187c51b58d`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:57.210818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e3808121-ab0d-4694-98ea-962cac561e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:57.287255 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1135/2268] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:57 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:46:57.298627 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d272cc5-b555-4141-8bf8-785b5cc0d62a admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:57.300279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-7d272cc5-b555-4141-8bf8-785b5cc0d62a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:57.358952 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d272cc5-b555-4141-8bf8-785b5cc0d62a admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:57.362630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9f801-3229-4f05-a1ab-028838388819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:57.363237 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9f801-3229-4f05-a1ab-028838388819 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:57.363520 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9f801-3229-4f05-a1ab-028838388819 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:57.363794 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9f801-3229-4f05-a1ab-028838388819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:57.372181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9f801-3229-4f05-a1ab-028838388819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:57.373627 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9f801-3229-4f05-a1ab-028838388819 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:57.383280 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1134/2269] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:57 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:46:59.678486 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d166c-0297-4e3a-a6fe-9f314727db18 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:59.678933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d166c-0297-4e3a-a6fe-9f314727db18 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:59.679038 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d166c-0297-4e3a-a6fe-9f314727db18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:59.709442 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-986d166c-0297-4e3a-a6fe-9f314727db18 None None] MFA Rules not processed for user `b38de7c21009499291ba1db0fd295a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:46:59.711170 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-986d166c-0297-4e3a-a6fe-9f314727db18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:59.777404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:59.782093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1136/2270] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:46:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:46:59.797806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9f801-3229-4f05-a1ab-028838388819 service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:46:59.799358 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-7bd9f801-3229-4f05-a1ab-028838388819 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:46:59.876692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9f801-3229-4f05-a1ab-028838388819 service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:46:59.882775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc97164-7dc4-40d9-82e7-a391cd183713 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:46:59.883448 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc97164-7dc4-40d9-82e7-a391cd183713 service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:46:59.883753 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc97164-7dc4-40d9-82e7-a391cd183713 service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:46:59.884024 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc97164-7dc4-40d9-82e7-a391cd183713 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:46:59.892742 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc97164-7dc4-40d9-82e7-a391cd183713 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:46:59.894420 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc97164-7dc4-40d9-82e7-a391cd183713 service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:46:59.904624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1135/2271] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:46:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:47:01.200605 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fd152-11cf-4bf5-9715-0c49e14e2732 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:01.201063 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fd152-11cf-4bf5-9715-0c49e14e2732 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:01.201144 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fd152-11cf-4bf5-9715-0c49e14e2732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:01.221322 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-392fd152-11cf-4bf5-9715-0c49e14e2732 None None] MFA Rules not processed for user `b38de7c21009499291ba1db0fd295a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:01.222572 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-392fd152-11cf-4bf5-9715-0c49e14e2732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:01.230478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1137/2272] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:01.553823 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc97164-7dc4-40d9-82e7-a391cd183713 service nova] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:01.556675 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-bcc97164-7dc4-40d9-82e7-a391cd183713 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:01.601896 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:01.643243 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc97164-7dc4-40d9-82e7-a391cd183713 service nova] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:01.646955 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32c569-032c-4f24-87dd-39af376d6715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:01.647575 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32c569-032c-4f24-87dd-39af376d6715 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:01.647869 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32c569-032c-4f24-87dd-39af376d6715 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:01.648141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32c569-032c-4f24-87dd-39af376d6715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:01.651183 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-1a32c569-032c-4f24-87dd-39af376d6715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:01.661410 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32c569-032c-4f24-87dd-39af376d6715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:01.662873 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32c569-032c-4f24-87dd-39af376d6715 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:01.672158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1136/2273] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:47:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:47:02.670809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fd152-11cf-4bf5-9715-0c49e14e2732 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:02.747885 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fd152-11cf-4bf5-9715-0c49e14e2732 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:02.752778 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82189e-dfd4-424a-bb3a-9a0e6b0de6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:02.753419 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82189e-dfd4-424a-bb3a-9a0e6b0de6a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:02.753703 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82189e-dfd4-424a-bb3a-9a0e6b0de6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:02.754014 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82189e-dfd4-424a-bb3a-9a0e6b0de6a3 admin admin] PATH_INFO: `/v3/users/afa0e958fae741d6a2f591187c51b58d` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:02.755161 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82189e-dfd4-424a-bb3a-9a0e6b0de6a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afa0e958fae741d6a2f591187c51b58d)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:02.757359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82189e-dfd4-424a-bb3a-9a0e6b0de6a3 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:02.808690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-0f82189e-dfd4-424a-bb3a-9a0e6b0de6a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afa0e958fae741d6a2f591187c51b58d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:02.816311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-0f82189e-dfd4-424a-bb3a-9a0e6b0de6a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afa0e958fae741d6a2f591187c51b58d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:02.829547 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-0f82189e-dfd4-424a-bb3a-9a0e6b0de6a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afa0e958fae741d6a2f591187c51b58d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:02.830314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-0f82189e-dfd4-424a-bb3a-9a0e6b0de6a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afa0e958fae741d6a2f591187c51b58d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:02.838159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-0f82189e-dfd4-424a-bb3a-9a0e6b0de6a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afa0e958fae741d6a2f591187c51b58d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:02.844278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1138/2274] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:47:02 2022] DELETE /identity/v3/users/afa0e958fae741d6a2f591187c51b58d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:02.848962 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f42e6c-4134-4c33-aa8b-cf11f6302c81 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:02.849430 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f42e6c-4134-4c33-aa8b-cf11f6302c81 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:02.849585 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f42e6c-4134-4c33-aa8b-cf11f6302c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:02.872345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-23f42e6c-4134-4c33-aa8b-cf11f6302c81 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:02.873575 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-23f42e6c-4134-4c33-aa8b-cf11f6302c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:02.950637 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1137/2275] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:47:02.961582 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82189e-dfd4-424a-bb3a-9a0e6b0de6a3 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:02.963408 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-0f82189e-dfd4-424a-bb3a-9a0e6b0de6a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:03.027848 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82189e-dfd4-424a-bb3a-9a0e6b0de6a3 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:03.032065 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589e94e-9b9e-41e7-8fae-218900725ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:03.032765 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589e94e-9b9e-41e7-8fae-218900725ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:03.033114 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589e94e-9b9e-41e7-8fae-218900725ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:03.033457 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589e94e-9b9e-41e7-8fae-218900725ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:03.043631 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589e94e-9b9e-41e7-8fae-218900725ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:03.045177 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589e94e-9b9e-41e7-8fae-218900725ab1 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:03.057728 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1139/2276] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:47:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:47:03.502329 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f42e6c-4134-4c33-aa8b-cf11f6302c81 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:03.504287 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-23f42e6c-4134-4c33-aa8b-cf11f6302c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:03.516989 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f42e6c-4134-4c33-aa8b-cf11f6302c81 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:03.527492 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4ec9f-bae8-4707-83d5-7d47f80598ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:03.528314 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4ec9f-bae8-4707-83d5-7d47f80598ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:03.528669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4ec9f-bae8-4707-83d5-7d47f80598ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:03.529016 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4ec9f-bae8-4707-83d5-7d47f80598ec admin admin] PATH_INFO: `/v3/projects/2b124641161c46e3adf302a5f0d446ad` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:03.530282 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4ec9f-bae8-4707-83d5-7d47f80598ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b124641161c46e3adf302a5f0d446ad)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:03.532286 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4ec9f-bae8-4707-83d5-7d47f80598ec admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:03.591424 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-89e4ec9f-bae8-4707-83d5-7d47f80598ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b124641161c46e3adf302a5f0d446ad', 'request_id': 'req-89e4ec9f-bae8-4707-83d5-7d47f80598ec'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:03.599488 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-89e4ec9f-bae8-4707-83d5-7d47f80598ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b124641161c46e3adf302a5f0d446ad', 'request_id': 'req-89e4ec9f-bae8-4707-83d5-7d47f80598ec'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:03.606010 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-89e4ec9f-bae8-4707-83d5-7d47f80598ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b124641161c46e3adf302a5f0d446ad', 'request_id': 'req-89e4ec9f-bae8-4707-83d5-7d47f80598ec'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:03.617559 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-89e4ec9f-bae8-4707-83d5-7d47f80598ec admin admin] The token cache is being invalidate because project 2b124641161c46e3adf302a5f0d446ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:47:03.618127 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-89e4ec9f-bae8-4707-83d5-7d47f80598ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:03.618802 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-89e4ec9f-bae8-4707-83d5-7d47f80598ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:03.620303 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1138/2277] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:47:03 2022] DELETE /identity/v3/projects/2b124641161c46e3adf302a5f0d446ad => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:03.625123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a55878-db94-4238-843e-608d3963018f None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:03.625415 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a55878-db94-4238-843e-608d3963018f None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:03.625693 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a55878-db94-4238-843e-608d3963018f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:03.647245 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-52a55878-db94-4238-843e-608d3963018f None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:03.648477 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-52a55878-db94-4238-843e-608d3963018f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:03.660954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:03.722599 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1140/2278] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:03.730092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8684d3-c660-41f6-a737-2a18ea1b9e1f None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:03.730378 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8684d3-c660-41f6-a737-2a18ea1b9e1f None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:03.730653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8684d3-c660-41f6-a737-2a18ea1b9e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:03.758740 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-3d8684d3-c660-41f6-a737-2a18ea1b9e1f None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:03.760435 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-3d8684d3-c660-41f6-a737-2a18ea1b9e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:03.774598 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1139/2279] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:03.778944 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a55878-db94-4238-843e-608d3963018f None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:03.790838 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a55878-db94-4238-843e-608d3963018f None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:03.796960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf59f81-aa9c-4226-ad78-d45664acc529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:03.797581 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf59f81-aa9c-4226-ad78-d45664acc529 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:03.797872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf59f81-aa9c-4226-ad78-d45664acc529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:03.798163 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf59f81-aa9c-4226-ad78-d45664acc529 admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:03.798812 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf59f81-aa9c-4226-ad78-d45664acc529 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:47:03.799105 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf59f81-aa9c-4226-ad78-d45664acc529 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:03.800911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf59f81-aa9c-4226-ad78-d45664acc529 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:03.813227 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1141/2280] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:47:03.817681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8684d3-c660-41f6-a737-2a18ea1b9e1f None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:03.827561 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8684d3-c660-41f6-a737-2a18ea1b9e1f None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:03.832573 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e788e11-3847-4ad8-8edb-0f7ef93e13af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:03.833185 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e788e11-3847-4ad8-8edb-0f7ef93e13af admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:03.833466 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e788e11-3847-4ad8-8edb-0f7ef93e13af admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:03.833740 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e788e11-3847-4ad8-8edb-0f7ef93e13af admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:03.834414 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e788e11-3847-4ad8-8edb-0f7ef93e13af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:03.837886 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e788e11-3847-4ad8-8edb-0f7ef93e13af admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:03.868632 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1140/2281] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:47:03 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:47:03.872385 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf59f81-aa9c-4226-ad78-d45664acc529 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:03.884755 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf59f81-aa9c-4226-ad78-d45664acc529 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:03.946701 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c58d05-4f8b-4b40-9189-f78bc54c020f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:03.947647 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c58d05-4f8b-4b40-9189-f78bc54c020f admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:03.948139 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c58d05-4f8b-4b40-9189-f78bc54c020f admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:03.948603 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c58d05-4f8b-4b40-9189-f78bc54c020f admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:03.949563 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c58d05-4f8b-4b40-9189-f78bc54c020f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:03.951925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c58d05-4f8b-4b40-9189-f78bc54c020f admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:03.977655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1142/2282] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:47:03 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:47:03.981832 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e788e11-3847-4ad8-8edb-0f7ef93e13af admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:03.995325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e788e11-3847-4ad8-8edb-0f7ef93e13af admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:04.000325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc5cc2-bd5d-44c4-aac2-cea91336c3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:04.001142 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc5cc2-bd5d-44c4-aac2-cea91336c3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:04.001644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc5cc2-bd5d-44c4-aac2-cea91336c3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:04.002137 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc5cc2-bd5d-44c4-aac2-cea91336c3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:04.003110 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc5cc2-bd5d-44c4-aac2-cea91336c3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:04.005533 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc5cc2-bd5d-44c4-aac2-cea91336c3e2 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:04.022858 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1141/2283] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:47:04.027194 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c58d05-4f8b-4b40-9189-f78bc54c020f admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:04.041424 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c58d05-4f8b-4b40-9189-f78bc54c020f admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:04.052395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21400d41-b492-4dad-9b22-23e5a3829efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:04.057281 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21400d41-b492-4dad-9b22-23e5a3829efb admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:04.057730 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21400d41-b492-4dad-9b22-23e5a3829efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:04.058060 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21400d41-b492-4dad-9b22-23e5a3829efb admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:04.061264 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21400d41-b492-4dad-9b22-23e5a3829efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:04.062697 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21400d41-b492-4dad-9b22-23e5a3829efb admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:04.081802 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1143/2284] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:47:04.083127 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc5cc2-bd5d-44c4-aac2-cea91336c3e2 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:04.097373 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc5cc2-bd5d-44c4-aac2-cea91336c3e2 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:04.102817 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ff15e-6ac9-4f67-8437-2263685475dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:04.103606 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ff15e-6ac9-4f67-8437-2263685475dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:04.103957 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ff15e-6ac9-4f67-8437-2263685475dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:04.104243 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ff15e-6ac9-4f67-8437-2263685475dc admin admin] PATH_INFO: `/v3/projects/257f2372d4a24fc89d530b5bf7228c40/users/5a1c58ca04a5465b812708d0f4c5742b/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:04.123076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ff15e-6ac9-4f67-8437-2263685475dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=257f2372d4a24fc89d530b5bf7228c40, user_id=5a1c58ca04a5465b812708d0f4c5742b, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:04.125956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ff15e-6ac9-4f67-8437-2263685475dc admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:04.128804 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:04.146063 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1142/2285] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:47:04 2022] PUT /identity/v3/projects/257f2372d4a24fc89d530b5bf7228c40/users/5a1c58ca04a5465b812708d0f4c5742b/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:47:04.150502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1ac4c-4bb6-4c5d-833e-cb781b9c6e31 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:04.150787 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1ac4c-4bb6-4c5d-833e-cb781b9c6e31 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:04.151060 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1ac4c-4bb6-4c5d-833e-cb781b9c6e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:04.177341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-5bd1ac4c-4bb6-4c5d-833e-cb781b9c6e31 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:04.179002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-5bd1ac4c-4bb6-4c5d-833e-cb781b9c6e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:04.267009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1144/2286] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:04.280973 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ff15e-6ac9-4f67-8437-2263685475dc admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:04.285110 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-743ff15e-6ac9-4f67-8437-2263685475dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:04.354364 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ff15e-6ac9-4f67-8437-2263685475dc admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:04.364474 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0388a-9cdb-4179-a900-d475413ded02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:04.365189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0388a-9cdb-4179-a900-d475413ded02 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:04.365380 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0388a-9cdb-4179-a900-d475413ded02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:04.365662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0388a-9cdb-4179-a900-d475413ded02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:04.382407 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0388a-9cdb-4179-a900-d475413ded02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:04.384348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0388a-9cdb-4179-a900-d475413ded02 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:04.396096 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1143/2287] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:47:09.231226 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2155f7-b604-4c27-a084-ecf5c5edfdb7 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:09.231791 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2155f7-b604-4c27-a084-ecf5c5edfdb7 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:09.231791 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2155f7-b604-4c27-a084-ecf5c5edfdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:09.276027 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-ab2155f7-b604-4c27-a084-ecf5c5edfdb7 None None] MFA Rules not processed for user `5a1c58ca04a5465b812708d0f4c5742b`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:09.277409 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ab2155f7-b604-4c27-a084-ecf5c5edfdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:09.288082 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:09.396195 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1145/2288] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:09.400838 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0388a-9cdb-4179-a900-d475413ded02 service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:09.410908 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0388a-9cdb-4179-a900-d475413ded02 service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:09.416863 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a77dc-9e11-4596-b911-93f9b5d44578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:09.417578 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a77dc-9e11-4596-b911-93f9b5d44578 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:09.417958 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a77dc-9e11-4596-b911-93f9b5d44578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:09.418485 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a77dc-9e11-4596-b911-93f9b5d44578 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:09.419345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a77dc-9e11-4596-b911-93f9b5d44578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:09.421288 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a77dc-9e11-4596-b911-93f9b5d44578 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:09.455167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1144/2289] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:47:09 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:47:09.459340 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2155f7-b604-4c27-a084-ecf5c5edfdb7 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:09.473518 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2155f7-b604-4c27-a084-ecf5c5edfdb7 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:09.540933 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d41367-178b-4f89-8c0e-6ee0c332944e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:09.541567 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d41367-178b-4f89-8c0e-6ee0c332944e admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:09.541865 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d41367-178b-4f89-8c0e-6ee0c332944e admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:09.542151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d41367-178b-4f89-8c0e-6ee0c332944e admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:09.542791 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d41367-178b-4f89-8c0e-6ee0c332944e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:09.544753 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d41367-178b-4f89-8c0e-6ee0c332944e admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:09.572398 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1146/2290] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:47:09 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:47:09.574031 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a77dc-9e11-4596-b911-93f9b5d44578 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:09.584668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a77dc-9e11-4596-b911-93f9b5d44578 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:09.590020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d2e23-2294-4e74-9a71-d010faec3e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:09.590622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d2e23-2294-4e74-9a71-d010faec3e20 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:09.590901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d2e23-2294-4e74-9a71-d010faec3e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:09.591188 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d2e23-2294-4e74-9a71-d010faec3e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:09.591828 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d2e23-2294-4e74-9a71-d010faec3e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:09.593491 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d2e23-2294-4e74-9a71-d010faec3e20 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:09.605135 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1145/2291] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:47:09.609406 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d41367-178b-4f89-8c0e-6ee0c332944e admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:09.619791 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d41367-178b-4f89-8c0e-6ee0c332944e admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:09.624454 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da14f1-7c7c-46b0-9e53-e1652c48f58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:09.625133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da14f1-7c7c-46b0-9e53-e1652c48f58c admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:09.625411 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da14f1-7c7c-46b0-9e53-e1652c48f58c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:09.625683 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da14f1-7c7c-46b0-9e53-e1652c48f58c admin admin] PATH_INFO: `/v3/projects/f2f5b5b24fa3415285378c31cad2bf0d/users/99274556222a423aaa694ad2f01fd96c/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:09.641085 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da14f1-7c7c-46b0-9e53-e1652c48f58c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f5b5b24fa3415285378c31cad2bf0d, user_id=99274556222a423aaa694ad2f01fd96c, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:09.643809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da14f1-7c7c-46b0-9e53-e1652c48f58c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:09.659339 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1147/2292] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:47:09 2022] PUT /identity/v3/projects/f2f5b5b24fa3415285378c31cad2bf0d/users/99274556222a423aaa694ad2f01fd96c/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:09.663244 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d2e23-2294-4e74-9a71-d010faec3e20 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:09.674904 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d2e23-2294-4e74-9a71-d010faec3e20 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:09.733785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64a93a-c0e0-4b94-974c-26bf7a49c137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:09.734426 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64a93a-c0e0-4b94-974c-26bf7a49c137 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:09.734712 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64a93a-c0e0-4b94-974c-26bf7a49c137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:09.734985 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64a93a-c0e0-4b94-974c-26bf7a49c137 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:09.735653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64a93a-c0e0-4b94-974c-26bf7a49c137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:09.737246 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64a93a-c0e0-4b94-974c-26bf7a49c137 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:09.746846 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1146/2293] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:47:09.751057 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da14f1-7c7c-46b0-9e53-e1652c48f58c admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:09.761793 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da14f1-7c7c-46b0-9e53-e1652c48f58c admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:09.766426 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5ea48-4502-47b0-926a-8897e6889dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:09.767065 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5ea48-4502-47b0-926a-8897e6889dea admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:09.767341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5ea48-4502-47b0-926a-8897e6889dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:09.767610 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5ea48-4502-47b0-926a-8897e6889dea admin admin] PATH_INFO: `/v3/projects/f2f5b5b24fa3415285378c31cad2bf0d/users/99274556222a423aaa694ad2f01fd96c/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:09.769467 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5ea48-4502-47b0-926a-8897e6889dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f5b5b24fa3415285378c31cad2bf0d, user_id=99274556222a423aaa694ad2f01fd96c, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:09.772120 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5ea48-4502-47b0-926a-8897e6889dea admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:09.783077 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1148/2294] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:47:09 2022] PUT /identity/v3/projects/f2f5b5b24fa3415285378c31cad2bf0d/users/99274556222a423aaa694ad2f01fd96c/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:12.845547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64a93a-c0e0-4b94-974c-26bf7a49c137 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:12.848321 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-6b64a93a-c0e0-4b94-974c-26bf7a49c137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:12.987104 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:13.026078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64a93a-c0e0-4b94-974c-26bf7a49c137 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:13.114654 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082932d-a860-4340-a172-70d10fd9e3fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:13.116191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082932d-a860-4340-a172-70d10fd9e3fd service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:13.116191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082932d-a860-4340-a172-70d10fd9e3fd service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:13.116570 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082932d-a860-4340-a172-70d10fd9e3fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:13.119167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-7082932d-a860-4340-a172-70d10fd9e3fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:13.146075 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082932d-a860-4340-a172-70d10fd9e3fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:13.147727 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082932d-a860-4340-a172-70d10fd9e3fd service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:13.185931 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1147/2295] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:47:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:47:15.671131 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e4e6-35b4-4a9b-8b0b-a4402571bc83 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:15.671668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e4e6-35b4-4a9b-8b0b-a4402571bc83 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:15.671668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e4e6-35b4-4a9b-8b0b-a4402571bc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:15.709730 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-6df3e4e6-35b4-4a9b-8b0b-a4402571bc83 None None] MFA Rules not processed for user `99274556222a423aaa694ad2f01fd96c`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:15.711541 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-6df3e4e6-35b4-4a9b-8b0b-a4402571bc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:15.766725 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:15.786837 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1149/2296] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:15.802104 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082932d-a860-4340-a172-70d10fd9e3fd service nova] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:15.803471 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-7082932d-a860-4340-a172-70d10fd9e3fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:15.818058 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082932d-a860-4340-a172-70d10fd9e3fd service nova] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:15.824082 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8220e7-050d-47f1-937f-7c83353c3be7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:15.824681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8220e7-050d-47f1-937f-7c83353c3be7 service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:15.824958 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8220e7-050d-47f1-937f-7c83353c3be7 service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:15.825229 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8220e7-050d-47f1-937f-7c83353c3be7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:15.916541 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8220e7-050d-47f1-937f-7c83353c3be7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:15.918205 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8220e7-050d-47f1-937f-7c83353c3be7 service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:15.927859 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1148/2297] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:47:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:47:17.231289 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa796a37-ed49-4868-a666-8212921bba18 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:17.231829 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa796a37-ed49-4868-a666-8212921bba18 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:17.231829 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa796a37-ed49-4868-a666-8212921bba18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:17.253222 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-fa796a37-ed49-4868-a666-8212921bba18 None None] MFA Rules not processed for user `5a1c58ca04a5465b812708d0f4c5742b`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:17.254509 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-fa796a37-ed49-4868-a666-8212921bba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:17.262590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1150/2298] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:25.923510 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=63 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:27.248033 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=8 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:28.208499 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8220e7-050d-47f1-937f-7c83353c3be7 service nova] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:28.209921 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-9d8220e7-050d-47f1-937f-7c83353c3be7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:28.266370 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8220e7-050d-47f1-937f-7c83353c3be7 service nova] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:28.270138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfddf94-654f-46ad-801f-79ca620a55c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:28.270766 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfddf94-654f-46ad-801f-79ca620a55c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:28.271044 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfddf94-654f-46ad-801f-79ca620a55c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:28.271425 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfddf94-654f-46ad-801f-79ca620a55c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:28.273098 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-0dfddf94-654f-46ad-801f-79ca620a55c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:28.341024 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfddf94-654f-46ad-801f-79ca620a55c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:28.342950 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfddf94-654f-46ad-801f-79ca620a55c9 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:28.354834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1149/2299] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:47:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:47:31.421009 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa796a37-ed49-4868-a666-8212921bba18 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:31.422443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-fa796a37-ed49-4868-a666-8212921bba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:31.472445 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfddf94-654f-46ad-801f-79ca620a55c9 service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:31.474930 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-0dfddf94-654f-46ad-801f-79ca620a55c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:31.499816 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfddf94-654f-46ad-801f-79ca620a55c9 service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:31.504007 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa796a37-ed49-4868-a666-8212921bba18 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:31.505163 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa192f1-f195-4ae2-b6de-3fd20afa9b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:31.505792 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa192f1-f195-4ae2-b6de-3fd20afa9b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:31.506437 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa192f1-f195-4ae2-b6de-3fd20afa9b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:31.507110 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa192f1-f195-4ae2-b6de-3fd20afa9b4a admin admin] PATH_INFO: `/v3/users/f6eeeea7a6e84461aa1945595c7bf398` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:31.508254 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa192f1-f195-4ae2-b6de-3fd20afa9b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6eeeea7a6e84461aa1945595c7bf398)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:31.510868 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa192f1-f195-4ae2-b6de-3fd20afa9b4a admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:31.511433 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68333aef-6850-4b7c-a25f-5747eaa94b11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e94a60e43914cf38a5f2f88b182083f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:31.512300 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68333aef-6850-4b7c-a25f-5747eaa94b11 service placement] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:31.512727 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68333aef-6850-4b7c-a25f-5747eaa94b11 service placement] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:31.512908 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68333aef-6850-4b7c-a25f-5747eaa94b11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:31.515444 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-68333aef-6850-4b7c-a25f-5747eaa94b11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:31.538631 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68333aef-6850-4b7c-a25f-5747eaa94b11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:31.540388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68333aef-6850-4b7c-a25f-5747eaa94b11 service placement] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:31.553491 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1151/2300] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:47:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:47:31.562804 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-6aa192f1-f195-4ae2-b6de-3fd20afa9b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6eeeea7a6e84461aa1945595c7bf398'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:31.577560 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-6aa192f1-f195-4ae2-b6de-3fd20afa9b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6eeeea7a6e84461aa1945595c7bf398'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:31.578306 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-6aa192f1-f195-4ae2-b6de-3fd20afa9b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6eeeea7a6e84461aa1945595c7bf398'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:31.579064 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-6aa192f1-f195-4ae2-b6de-3fd20afa9b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6eeeea7a6e84461aa1945595c7bf398'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:31.587047 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-6aa192f1-f195-4ae2-b6de-3fd20afa9b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6eeeea7a6e84461aa1945595c7bf398'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:31.606156 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1150/2301] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:47:31 2022] DELETE /identity/v3/users/f6eeeea7a6e84461aa1945595c7bf398 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:31.781654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68333aef-6850-4b7c-a25f-5747eaa94b11 service placement] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:31.792710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68333aef-6850-4b7c-a25f-5747eaa94b11 service placement] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:31.855275 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412902df-e51b-4872-9a44-7e60ee1af00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:31.855918 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412902df-e51b-4872-9a44-7e60ee1af00e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:31.856199 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412902df-e51b-4872-9a44-7e60ee1af00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:31.856475 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412902df-e51b-4872-9a44-7e60ee1af00e admin admin] PATH_INFO: `/v3/projects/624f7324ae0c44b1b53fe790eb2f9ccd` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:31.857604 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412902df-e51b-4872-9a44-7e60ee1af00e admin admin] RBAC: Authorizing `identity:delete_project(project_id=624f7324ae0c44b1b53fe790eb2f9ccd)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:31.859560 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412902df-e51b-4872-9a44-7e60ee1af00e admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:31.910945 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-412902df-e51b-4872-9a44-7e60ee1af00e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '624f7324ae0c44b1b53fe790eb2f9ccd', 'request_id': 'req-412902df-e51b-4872-9a44-7e60ee1af00e'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:31.917205 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-412902df-e51b-4872-9a44-7e60ee1af00e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '624f7324ae0c44b1b53fe790eb2f9ccd', 'request_id': 'req-412902df-e51b-4872-9a44-7e60ee1af00e'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:31.926427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-412902df-e51b-4872-9a44-7e60ee1af00e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '624f7324ae0c44b1b53fe790eb2f9ccd', 'request_id': 'req-412902df-e51b-4872-9a44-7e60ee1af00e'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:31.938654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-412902df-e51b-4872-9a44-7e60ee1af00e admin admin] The token cache is being invalidate because project 624f7324ae0c44b1b53fe790eb2f9ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:47:31.938962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-412902df-e51b-4872-9a44-7e60ee1af00e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:31.939874 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-412902df-e51b-4872-9a44-7e60ee1af00e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:31.941678 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1152/2302] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:47:31 2022] DELETE /identity/v3/projects/624f7324ae0c44b1b53fe790eb2f9ccd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:31.946567 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcdff3-ffd3-4838-91dc-e1708d1bb9ed None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:31.946860 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcdff3-ffd3-4838-91dc-e1708d1bb9ed None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:31.947158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcdff3-ffd3-4838-91dc-e1708d1bb9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:31.969112 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-25bcdff3-ffd3-4838-91dc-e1708d1bb9ed None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:31.970363 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-25bcdff3-ffd3-4838-91dc-e1708d1bb9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:31.988339 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:32.034814 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1151/2303] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:32.044103 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d23884-d3d3-4d36-8c69-6c9d8a1010a5 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:32.044393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d23884-d3d3-4d36-8c69-6c9d8a1010a5 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:32.044681 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d23884-d3d3-4d36-8c69-6c9d8a1010a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:32.065059 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-97d23884-d3d3-4d36-8c69-6c9d8a1010a5 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:32.066330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-97d23884-d3d3-4d36-8c69-6c9d8a1010a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:32.074370 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1153/2304] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:32.078994 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcdff3-ffd3-4838-91dc-e1708d1bb9ed None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:32.089008 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcdff3-ffd3-4838-91dc-e1708d1bb9ed None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:32.093752 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9ebee-6e8c-49c0-b7b4-c6ce72f7b9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:32.094390 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9ebee-6e8c-49c0-b7b4-c6ce72f7b9cd admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:32.094678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9ebee-6e8c-49c0-b7b4-c6ce72f7b9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:32.094952 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9ebee-6e8c-49c0-b7b4-c6ce72f7b9cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:32.095628 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9ebee-6e8c-49c0-b7b4-c6ce72f7b9cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:47:32.095948 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9ebee-6e8c-49c0-b7b4-c6ce72f7b9cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:32.097529 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9ebee-6e8c-49c0-b7b4-c6ce72f7b9cd admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:32.110530 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1152/2305] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:47:32.115001 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d23884-d3d3-4d36-8c69-6c9d8a1010a5 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:32.124914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d23884-d3d3-4d36-8c69-6c9d8a1010a5 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:32.129540 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4db25-8729-4563-b566-637ed43db8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:32.130431 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4db25-8729-4563-b566-637ed43db8fe admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:32.130714 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4db25-8729-4563-b566-637ed43db8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:32.130992 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4db25-8729-4563-b566-637ed43db8fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:32.131791 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4db25-8729-4563-b566-637ed43db8fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:32.133512 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4db25-8729-4563-b566-637ed43db8fe admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:32.145171 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:32.171621 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1154/2306] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:47:32 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:47:32.175926 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9ebee-6e8c-49c0-b7b4-c6ce72f7b9cd admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:32.186814 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9ebee-6e8c-49c0-b7b4-c6ce72f7b9cd admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:32.246237 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4751dd6-eec2-4ce9-bfbf-47ca981f4561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:32.246844 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4751dd6-eec2-4ce9-bfbf-47ca981f4561 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:32.247118 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4751dd6-eec2-4ce9-bfbf-47ca981f4561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:32.247383 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4751dd6-eec2-4ce9-bfbf-47ca981f4561 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:32.248021 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4751dd6-eec2-4ce9-bfbf-47ca981f4561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:32.249962 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4751dd6-eec2-4ce9-bfbf-47ca981f4561 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:32.272510 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1153/2307] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:47:32 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:47:32.277491 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4db25-8729-4563-b566-637ed43db8fe admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:32.287707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4db25-8729-4563-b566-637ed43db8fe admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:32.307828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34239d24-377a-4442-b187-10886af5e5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:32.308561 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34239d24-377a-4442-b187-10886af5e5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:32.308778 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34239d24-377a-4442-b187-10886af5e5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:32.309056 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34239d24-377a-4442-b187-10886af5e5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:32.310018 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34239d24-377a-4442-b187-10886af5e5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:32.311337 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34239d24-377a-4442-b187-10886af5e5a9 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:32.325364 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1155/2308] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:47:32.328838 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4751dd6-eec2-4ce9-bfbf-47ca981f4561 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:32.341834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4751dd6-eec2-4ce9-bfbf-47ca981f4561 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:32.348779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020296c8-9b71-465b-b210-060d0ea2ba13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:32.349385 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020296c8-9b71-465b-b210-060d0ea2ba13 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:32.349660 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020296c8-9b71-465b-b210-060d0ea2ba13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:32.349950 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020296c8-9b71-465b-b210-060d0ea2ba13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:32.350594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020296c8-9b71-465b-b210-060d0ea2ba13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:32.352213 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020296c8-9b71-465b-b210-060d0ea2ba13 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:32.364026 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1154/2309] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:47:32.368190 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34239d24-377a-4442-b187-10886af5e5a9 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:32.379877 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34239d24-377a-4442-b187-10886af5e5a9 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:32.384662 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534657a4-7545-42b5-8c84-84fbe267f5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:32.385961 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534657a4-7545-42b5-8c84-84fbe267f5d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:32.386344 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534657a4-7545-42b5-8c84-84fbe267f5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:32.386751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534657a4-7545-42b5-8c84-84fbe267f5d7 admin admin] PATH_INFO: `/v3/projects/01b114f17861448e8c3f9055e3b3b43b/users/84987b95b9f041b3b9c2b911be07087c/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:32.403557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534657a4-7545-42b5-8c84-84fbe267f5d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b114f17861448e8c3f9055e3b3b43b, user_id=84987b95b9f041b3b9c2b911be07087c, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:32.406404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534657a4-7545-42b5-8c84-84fbe267f5d7 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:32.420836 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1156/2310] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:47:32 2022] PUT /identity/v3/projects/01b114f17861448e8c3f9055e3b3b43b/users/84987b95b9f041b3b9c2b911be07087c/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:32.430851 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c9179-bbc0-44bf-a855-077ddffa0142 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:32.431137 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c9179-bbc0-44bf-a855-077ddffa0142 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:32.431404 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c9179-bbc0-44bf-a855-077ddffa0142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:32.459662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-a39c9179-bbc0-44bf-a855-077ddffa0142 None None] MFA Rules not processed for user `84987b95b9f041b3b9c2b911be07087c`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:32.460848 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a39c9179-bbc0-44bf-a855-077ddffa0142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:32.530836 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1155/2311] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:32.542621 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534657a4-7545-42b5-8c84-84fbe267f5d7 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:32.544296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-534657a4-7545-42b5-8c84-84fbe267f5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:32.604495 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534657a4-7545-42b5-8c84-84fbe267f5d7 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:32.608177 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb9d82-de42-4a71-88e8-93ad28615211 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:32.608796 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb9d82-de42-4a71-88e8-93ad28615211 service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:32.609076 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb9d82-de42-4a71-88e8-93ad28615211 service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:32.609356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb9d82-de42-4a71-88e8-93ad28615211 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:32.618130 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb9d82-de42-4a71-88e8-93ad28615211 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:32.619790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb9d82-de42-4a71-88e8-93ad28615211 service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:32.629076 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1157/2312] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:47:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:47:40.774850 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c9179-bbc0-44bf-a855-077ddffa0142 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:40.776419 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a39c9179-bbc0-44bf-a855-077ddffa0142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:40.796196 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:40.833127 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c9179-bbc0-44bf-a855-077ddffa0142 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:40.836675 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cfde2-c33a-4387-afe6-6a02d1cbe4d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:40.837269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cfde2-c33a-4387-afe6-6a02d1cbe4d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:40.837553 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cfde2-c33a-4387-afe6-6a02d1cbe4d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:40.838363 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cfde2-c33a-4387-afe6-6a02d1cbe4d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:40.840232 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d17cfde2-c33a-4387-afe6-6a02d1cbe4d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:40.901569 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cfde2-c33a-4387-afe6-6a02d1cbe4d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:40.903023 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cfde2-c33a-4387-afe6-6a02d1cbe4d1 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:40.912381 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1156/2313] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:47:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:47:41.108443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb9d82-de42-4a71-88e8-93ad28615211 service cinder] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:41.182579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb9d82-de42-4a71-88e8-93ad28615211 service cinder] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:41.187261 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c28fe-4a4d-4b9f-8f3f-bcb571d7a0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:41.187905 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c28fe-4a4d-4b9f-8f3f-bcb571d7a0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:41.188176 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c28fe-4a4d-4b9f-8f3f-bcb571d7a0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:41.188514 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c28fe-4a4d-4b9f-8f3f-bcb571d7a0ee admin admin] PATH_INFO: `/v3/users/84987b95b9f041b3b9c2b911be07087c` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:41.189641 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c28fe-4a4d-4b9f-8f3f-bcb571d7a0ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=84987b95b9f041b3b9c2b911be07087c)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:41.191595 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c28fe-4a4d-4b9f-8f3f-bcb571d7a0ee admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:41.239171 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-990c28fe-4a4d-4b9f-8f3f-bcb571d7a0ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84987b95b9f041b3b9c2b911be07087c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:41.246758 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-990c28fe-4a4d-4b9f-8f3f-bcb571d7a0ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84987b95b9f041b3b9c2b911be07087c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:41.251145 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:41.260470 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-990c28fe-4a4d-4b9f-8f3f-bcb571d7a0ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84987b95b9f041b3b9c2b911be07087c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:41.261916 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-990c28fe-4a4d-4b9f-8f3f-bcb571d7a0ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84987b95b9f041b3b9c2b911be07087c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:41.269398 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-990c28fe-4a4d-4b9f-8f3f-bcb571d7a0ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84987b95b9f041b3b9c2b911be07087c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:41.275447 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1158/2314] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:47:41 2022] DELETE /identity/v3/users/84987b95b9f041b3b9c2b911be07087c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:41.280446 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b95688-ab12-4ce6-8a4f-36f6ff7484f2 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:41.280719 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b95688-ab12-4ce6-8a4f-36f6ff7484f2 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:41.280989 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b95688-ab12-4ce6-8a4f-36f6ff7484f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:41.300914 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-e4b95688-ab12-4ce6-8a4f-36f6ff7484f2 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:41.302206 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e4b95688-ab12-4ce6-8a4f-36f6ff7484f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:41.362741 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1157/2315] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:41.372974 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c28fe-4a4d-4b9f-8f3f-bcb571d7a0ee admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:41.374519 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-990c28fe-4a4d-4b9f-8f3f-bcb571d7a0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:41.434670 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c28fe-4a4d-4b9f-8f3f-bcb571d7a0ee admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:41.438271 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9dda3-1690-400e-8b8f-b736ecb25b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:41.438875 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9dda3-1690-400e-8b8f-b736ecb25b58 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:41.439150 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9dda3-1690-400e-8b8f-b736ecb25b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:41.439418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9dda3-1690-400e-8b8f-b736ecb25b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:41.450434 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9dda3-1690-400e-8b8f-b736ecb25b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:41.451895 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9dda3-1690-400e-8b8f-b736ecb25b58 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:41.461676 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1159/2316] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:47:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:47:41.876233 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b95688-ab12-4ce6-8a4f-36f6ff7484f2 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:41.877675 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e4b95688-ab12-4ce6-8a4f-36f6ff7484f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:41.889474 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b95688-ab12-4ce6-8a4f-36f6ff7484f2 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:41.894139 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167e4bb-d1f4-4e0e-90fb-875539adf40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:41.894758 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167e4bb-d1f4-4e0e-90fb-875539adf40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:41.895032 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167e4bb-d1f4-4e0e-90fb-875539adf40c admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:41.895300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167e4bb-d1f4-4e0e-90fb-875539adf40c admin admin] PATH_INFO: `/v3/projects/01b114f17861448e8c3f9055e3b3b43b` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:41.896467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167e4bb-d1f4-4e0e-90fb-875539adf40c admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b114f17861448e8c3f9055e3b3b43b)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:41.898592 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167e4bb-d1f4-4e0e-90fb-875539adf40c admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:41.960219 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-f167e4bb-d1f4-4e0e-90fb-875539adf40c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b114f17861448e8c3f9055e3b3b43b', 'request_id': 'req-f167e4bb-d1f4-4e0e-90fb-875539adf40c'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:41.970243 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-f167e4bb-d1f4-4e0e-90fb-875539adf40c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b114f17861448e8c3f9055e3b3b43b', 'request_id': 'req-f167e4bb-d1f4-4e0e-90fb-875539adf40c'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:41.974934 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:41.976243 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-f167e4bb-d1f4-4e0e-90fb-875539adf40c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b114f17861448e8c3f9055e3b3b43b', 'request_id': 'req-f167e4bb-d1f4-4e0e-90fb-875539adf40c'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:41.991109 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-f167e4bb-d1f4-4e0e-90fb-875539adf40c admin admin] The token cache is being invalidate because project 01b114f17861448e8c3f9055e3b3b43b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:47:41.991396 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-f167e4bb-d1f4-4e0e-90fb-875539adf40c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:41.992055 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-f167e4bb-d1f4-4e0e-90fb-875539adf40c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:41.993589 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1158/2317] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:47:41 2022] DELETE /identity/v3/projects/01b114f17861448e8c3f9055e3b3b43b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:41.998992 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0aedb-8c97-414f-a3e2-c190b39bc214 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:41.999344 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0aedb-8c97-414f-a3e2-c190b39bc214 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:41.999724 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0aedb-8c97-414f-a3e2-c190b39bc214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:42.025224 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-e8d0aedb-8c97-414f-a3e2-c190b39bc214 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:42.026683 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e8d0aedb-8c97-414f-a3e2-c190b39bc214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:42.089209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1160/2318] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:42.098300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6835972-77e7-41d4-b8e8-613fdeb7c70d None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:42.098674 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6835972-77e7-41d4-b8e8-613fdeb7c70d None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:42.099043 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6835972-77e7-41d4-b8e8-613fdeb7c70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:42.129741 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-c6835972-77e7-41d4-b8e8-613fdeb7c70d None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:42.130987 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-c6835972-77e7-41d4-b8e8-613fdeb7c70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:42.139067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1159/2319] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:42.143414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0aedb-8c97-414f-a3e2-c190b39bc214 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:42.153682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0aedb-8c97-414f-a3e2-c190b39bc214 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:42.158266 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60bc4c-88e5-4a39-8176-89b8c7cd00b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:42.158860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60bc4c-88e5-4a39-8176-89b8c7cd00b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:42.159136 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60bc4c-88e5-4a39-8176-89b8c7cd00b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:42.159405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60bc4c-88e5-4a39-8176-89b8c7cd00b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:42.160039 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60bc4c-88e5-4a39-8176-89b8c7cd00b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:47:42.160335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60bc4c-88e5-4a39-8176-89b8c7cd00b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:42.161951 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60bc4c-88e5-4a39-8176-89b8c7cd00b2 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:42.173950 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1161/2320] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:47:42.178428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6835972-77e7-41d4-b8e8-613fdeb7c70d None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:42.188159 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6835972-77e7-41d4-b8e8-613fdeb7c70d None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:42.192807 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de840699-b35c-4d15-a346-9e84bbabd708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:42.193449 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de840699-b35c-4d15-a346-9e84bbabd708 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:42.193717 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de840699-b35c-4d15-a346-9e84bbabd708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:42.194137 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de840699-b35c-4d15-a346-9e84bbabd708 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:42.194789 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de840699-b35c-4d15-a346-9e84bbabd708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:42.196681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de840699-b35c-4d15-a346-9e84bbabd708 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:42.224457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1160/2321] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:47:42 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:47:42.228795 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60bc4c-88e5-4a39-8176-89b8c7cd00b2 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:42.238838 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60bc4c-88e5-4a39-8176-89b8c7cd00b2 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:42.296431 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ece7b-3365-480d-ab6d-fa7a068b48c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:42.297094 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ece7b-3365-480d-ab6d-fa7a068b48c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:42.297495 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ece7b-3365-480d-ab6d-fa7a068b48c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:42.297769 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ece7b-3365-480d-ab6d-fa7a068b48c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:42.298463 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ece7b-3365-480d-ab6d-fa7a068b48c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:42.300390 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ece7b-3365-480d-ab6d-fa7a068b48c3 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:42.317240 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:42.326165 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1162/2322] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:47:42 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:47:42.327888 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de840699-b35c-4d15-a346-9e84bbabd708 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:42.339525 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de840699-b35c-4d15-a346-9e84bbabd708 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:42.344872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbf085-415f-425d-9bf8-88ac5ea742d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:42.345547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbf085-415f-425d-9bf8-88ac5ea742d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:42.345952 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbf085-415f-425d-9bf8-88ac5ea742d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:42.346305 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbf085-415f-425d-9bf8-88ac5ea742d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:42.347007 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbf085-415f-425d-9bf8-88ac5ea742d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:42.348716 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbf085-415f-425d-9bf8-88ac5ea742d4 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:42.362084 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1161/2323] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:47:42.363304 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ece7b-3365-480d-ab6d-fa7a068b48c3 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:42.373790 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ece7b-3365-480d-ab6d-fa7a068b48c3 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:42.378359 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10350fc0-f54d-48b9-a113-e8ac6a600857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:42.378950 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10350fc0-f54d-48b9-a113-e8ac6a600857 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:42.379491 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10350fc0-f54d-48b9-a113-e8ac6a600857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:42.379758 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10350fc0-f54d-48b9-a113-e8ac6a600857 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:42.380747 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10350fc0-f54d-48b9-a113-e8ac6a600857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:42.382005 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10350fc0-f54d-48b9-a113-e8ac6a600857 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:42.394284 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1163/2324] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:47:42.397009 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbf085-415f-425d-9bf8-88ac5ea742d4 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:42.407542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbf085-415f-425d-9bf8-88ac5ea742d4 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:42.412220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf026b-7148-4e39-9c81-fb3083949342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:42.412949 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf026b-7148-4e39-9c81-fb3083949342 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:42.413220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf026b-7148-4e39-9c81-fb3083949342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:42.413489 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf026b-7148-4e39-9c81-fb3083949342 admin admin] PATH_INFO: `/v3/projects/a205f3f143024e609c673ac2b2bb90f5/users/1062377d3ee54a6b95bd1fd697026972/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:42.428694 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf026b-7148-4e39-9c81-fb3083949342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a205f3f143024e609c673ac2b2bb90f5, user_id=1062377d3ee54a6b95bd1fd697026972, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:42.432026 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf026b-7148-4e39-9c81-fb3083949342 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:42.445354 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1162/2325] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:47:42 2022] PUT /identity/v3/projects/a205f3f143024e609c673ac2b2bb90f5/users/1062377d3ee54a6b95bd1fd697026972/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:42.455958 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cb862-3d70-4331-840f-e7dee0764cb9 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:42.456249 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cb862-3d70-4331-840f-e7dee0764cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:42.456542 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cb862-3d70-4331-840f-e7dee0764cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:42.484821 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-428cb862-3d70-4331-840f-e7dee0764cb9 None None] MFA Rules not processed for user `1062377d3ee54a6b95bd1fd697026972`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:42.486217 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-428cb862-3d70-4331-840f-e7dee0764cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:42.557375 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1164/2326] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:42.562102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf026b-7148-4e39-9c81-fb3083949342 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:42.632137 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf026b-7148-4e39-9c81-fb3083949342 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:42.638848 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bc097-aea6-4932-a104-675f3da7f7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:42.639689 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bc097-aea6-4932-a104-675f3da7f7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:42.640067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bc097-aea6-4932-a104-675f3da7f7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:42.640440 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bc097-aea6-4932-a104-675f3da7f7b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:42.641193 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bc097-aea6-4932-a104-675f3da7f7b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:42.643419 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bc097-aea6-4932-a104-675f3da7f7b2 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:42.681990 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1163/2327] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:47:42 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:47:42.683324 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cb862-3d70-4331-840f-e7dee0764cb9 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:42.701240 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cb862-3d70-4331-840f-e7dee0764cb9 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:42.766653 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9ace5-9fcb-4a0f-8bc2-013de3e92ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:42.767462 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9ace5-9fcb-4a0f-8bc2-013de3e92ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:42.767806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9ace5-9fcb-4a0f-8bc2-013de3e92ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:42.768141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9ace5-9fcb-4a0f-8bc2-013de3e92ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:42.768880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9ace5-9fcb-4a0f-8bc2-013de3e92ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:42.771710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9ace5-9fcb-4a0f-8bc2-013de3e92ae2 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:42.801884 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1165/2328] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:47:42 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:47:42.805251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bc097-aea6-4932-a104-675f3da7f7b2 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:42.816713 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bc097-aea6-4932-a104-675f3da7f7b2 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:42.825509 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b853f-091b-4633-a2a0-f33c4f82105f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:42.826205 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b853f-091b-4633-a2a0-f33c4f82105f admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:42.826491 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b853f-091b-4633-a2a0-f33c4f82105f admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:42.826758 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b853f-091b-4633-a2a0-f33c4f82105f admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:42.827400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b853f-091b-4633-a2a0-f33c4f82105f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:42.828991 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b853f-091b-4633-a2a0-f33c4f82105f admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:42.841666 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1164/2329] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:47:42.845661 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9ace5-9fcb-4a0f-8bc2-013de3e92ae2 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:42.856834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9ace5-9fcb-4a0f-8bc2-013de3e92ae2 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:42.863005 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fadd0c-5268-4439-9971-c71e4c2cf616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:42.863622 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fadd0c-5268-4439-9971-c71e4c2cf616 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:42.863903 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fadd0c-5268-4439-9971-c71e4c2cf616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:42.864177 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fadd0c-5268-4439-9971-c71e4c2cf616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:42.864814 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fadd0c-5268-4439-9971-c71e4c2cf616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:42.867255 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fadd0c-5268-4439-9971-c71e4c2cf616 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:42.880681 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1166/2330] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:47:42.882370 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b853f-091b-4633-a2a0-f33c4f82105f admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:42.892477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b853f-091b-4633-a2a0-f33c4f82105f admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:42.897592 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bcd76-a98b-4a75-ab0f-085ee5f9ecf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:42.898478 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bcd76-a98b-4a75-ab0f-085ee5f9ecf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:42.898638 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bcd76-a98b-4a75-ab0f-085ee5f9ecf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:42.898885 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bcd76-a98b-4a75-ab0f-085ee5f9ecf7 admin admin] PATH_INFO: `/v3/projects/94193dbb9c734b74af2eb7c2df39c280/users/8181aa29f1884d9a94d607e16117a9ed/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:42.916320 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bcd76-a98b-4a75-ab0f-085ee5f9ecf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94193dbb9c734b74af2eb7c2df39c280, user_id=8181aa29f1884d9a94d607e16117a9ed, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:42.918537 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bcd76-a98b-4a75-ab0f-085ee5f9ecf7 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:42.945516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1165/2331] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:47:42 2022] PUT /identity/v3/projects/94193dbb9c734b74af2eb7c2df39c280/users/8181aa29f1884d9a94d607e16117a9ed/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:42.956674 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ff2f2-27f4-43dc-87e1-0fa7ce74eddf None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:42.957244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ff2f2-27f4-43dc-87e1-0fa7ce74eddf None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:42.957774 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ff2f2-27f4-43dc-87e1-0fa7ce74eddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:42.994568 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-889ff2f2-27f4-43dc-87e1-0fa7ce74eddf None None] MFA Rules not processed for user `8181aa29f1884d9a94d607e16117a9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:42.995989 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-889ff2f2-27f4-43dc-87e1-0fa7ce74eddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:43.050093 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:43.078138 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1167/2332] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:43.083306 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bcd76-a98b-4a75-ab0f-085ee5f9ecf7 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:43.133097 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:43.157643 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bcd76-a98b-4a75-ab0f-085ee5f9ecf7 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:43.162508 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6c861-200b-4490-a0e1-0ef127038f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:43.163119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6c861-200b-4490-a0e1-0ef127038f16 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:43.163526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6c861-200b-4490-a0e1-0ef127038f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:43.163807 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6c861-200b-4490-a0e1-0ef127038f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:43.164447 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6c861-200b-4490-a0e1-0ef127038f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:43.167203 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6c861-200b-4490-a0e1-0ef127038f16 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:43.208951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1166/2333] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:47:43 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:47:43.213668 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ff2f2-27f4-43dc-87e1-0fa7ce74eddf None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:43.225503 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ff2f2-27f4-43dc-87e1-0fa7ce74eddf None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:43.294751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2152f-7672-4db3-b355-2cb3c0b9ef52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:43.295448 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2152f-7672-4db3-b355-2cb3c0b9ef52 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:43.295724 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2152f-7672-4db3-b355-2cb3c0b9ef52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:43.296077 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2152f-7672-4db3-b355-2cb3c0b9ef52 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:43.296822 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2152f-7672-4db3-b355-2cb3c0b9ef52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:43.298886 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2152f-7672-4db3-b355-2cb3c0b9ef52 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:43.323052 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1168/2334] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:47:43 2022] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:47:43.327543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6c861-200b-4490-a0e1-0ef127038f16 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:43.341901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6c861-200b-4490-a0e1-0ef127038f16 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:43.354260 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a163a-0bba-4a4c-b37c-186ff629be7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:43.355108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a163a-0bba-4a4c-b37c-186ff629be7b admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:43.355389 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a163a-0bba-4a4c-b37c-186ff629be7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:43.355805 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a163a-0bba-4a4c-b37c-186ff629be7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:43.356754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a163a-0bba-4a4c-b37c-186ff629be7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:43.358862 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a163a-0bba-4a4c-b37c-186ff629be7b admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:43.371219 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1167/2335] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:47:43.375993 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2152f-7672-4db3-b355-2cb3c0b9ef52 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:43.388504 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2152f-7672-4db3-b355-2cb3c0b9ef52 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:43.395238 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907e752-b5cc-4556-afab-fe3ca0cdf514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:43.396594 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907e752-b5cc-4556-afab-fe3ca0cdf514 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:43.397446 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907e752-b5cc-4556-afab-fe3ca0cdf514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:43.397734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907e752-b5cc-4556-afab-fe3ca0cdf514 admin admin] PATH_INFO: `/v3/projects/01f7460fd8274f16a47dd5db0425dc5f/users/659b6c7c02804092ac6fc2adeecb10a4/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:43.417550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907e752-b5cc-4556-afab-fe3ca0cdf514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f7460fd8274f16a47dd5db0425dc5f, user_id=659b6c7c02804092ac6fc2adeecb10a4, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:43.422720 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907e752-b5cc-4556-afab-fe3ca0cdf514 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:43.441998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1169/2336] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:47:43 2022] PUT /identity/v3/projects/01f7460fd8274f16a47dd5db0425dc5f/users/659b6c7c02804092ac6fc2adeecb10a4/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:47:43.447830 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a163a-0bba-4a4c-b37c-186ff629be7b admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:43.460873 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a163a-0bba-4a4c-b37c-186ff629be7b admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:43.530598 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121eb5f3-d961-4e3b-9fa3-8d27b0720a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:43.531228 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eb5f3-d961-4e3b-9fa3-8d27b0720a09 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:43.531518 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eb5f3-d961-4e3b-9fa3-8d27b0720a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:43.531789 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eb5f3-d961-4e3b-9fa3-8d27b0720a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:43.532439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121eb5f3-d961-4e3b-9fa3-8d27b0720a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:43.534070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121eb5f3-d961-4e3b-9fa3-8d27b0720a09 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:43.549903 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1168/2337] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:47:43.551921 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907e752-b5cc-4556-afab-fe3ca0cdf514 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:43.564760 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907e752-b5cc-4556-afab-fe3ca0cdf514 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:43.574261 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ee24d-1338-475c-aaf9-3eed6288d1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:43.575064 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ee24d-1338-475c-aaf9-3eed6288d1af admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:43.575346 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ee24d-1338-475c-aaf9-3eed6288d1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:43.575619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ee24d-1338-475c-aaf9-3eed6288d1af admin admin] PATH_INFO: `/v3/projects/01f7460fd8274f16a47dd5db0425dc5f/users/659b6c7c02804092ac6fc2adeecb10a4/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:43.577604 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ee24d-1338-475c-aaf9-3eed6288d1af admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f7460fd8274f16a47dd5db0425dc5f, user_id=659b6c7c02804092ac6fc2adeecb10a4, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:43.581307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ee24d-1338-475c-aaf9-3eed6288d1af admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:43.593962 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1170/2338] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:47:43 2022] PUT /identity/v3/projects/01f7460fd8274f16a47dd5db0425dc5f/users/659b6c7c02804092ac6fc2adeecb10a4/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:43.609253 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68328f17-17a5-49cf-8ef2-eb53f804a272 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:43.609711 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68328f17-17a5-49cf-8ef2-eb53f804a272 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:43.610192 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68328f17-17a5-49cf-8ef2-eb53f804a272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:43.649397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-68328f17-17a5-49cf-8ef2-eb53f804a272 None None] MFA Rules not processed for user `659b6c7c02804092ac6fc2adeecb10a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:43.651169 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-68328f17-17a5-49cf-8ef2-eb53f804a272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:43.742790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1169/2339] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:43.757127 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ee24d-1338-475c-aaf9-3eed6288d1af admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:43.758896 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-d84ee24d-1338-475c-aaf9-3eed6288d1af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:43.827481 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ee24d-1338-475c-aaf9-3eed6288d1af admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:43.831247 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbddfff-6c3a-4a30-a036-0cce273a7bb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:43.831982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbddfff-6c3a-4a30-a036-0cce273a7bb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:43.832451 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbddfff-6c3a-4a30-a036-0cce273a7bb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:43.832879 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbddfff-6c3a-4a30-a036-0cce273a7bb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:43.843986 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbddfff-6c3a-4a30-a036-0cce273a7bb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:43.845598 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbddfff-6c3a-4a30-a036-0cce273a7bb7 service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:43.857232 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1171/2340] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:47:43 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:47:44.367785 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68328f17-17a5-49cf-8ef2-eb53f804a272 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:44.369189 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-68328f17-17a5-49cf-8ef2-eb53f804a272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:44.381100 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68328f17-17a5-49cf-8ef2-eb53f804a272 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:44.384623 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01629c-acae-46c8-981d-96c7655fafb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:44.385339 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01629c-acae-46c8-981d-96c7655fafb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:44.385617 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01629c-acae-46c8-981d-96c7655fafb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:44.385917 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01629c-acae-46c8-981d-96c7655fafb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:44.417591 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:44.443838 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01629c-acae-46c8-981d-96c7655fafb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:44.445193 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01629c-acae-46c8-981d-96c7655fafb6 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:44.454074 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1170/2341] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:47:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:47:48.465067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbddfff-6c3a-4a30-a036-0cce273a7bb7 service cinder] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:48.473406 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbddfff-6c3a-4a30-a036-0cce273a7bb7 service cinder] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:48.476954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38025b21-e780-4088-a84e-3bbf9019715b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:48.477540 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38025b21-e780-4088-a84e-3bbf9019715b service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:48.477814 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38025b21-e780-4088-a84e-3bbf9019715b service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:48.478128 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38025b21-e780-4088-a84e-3bbf9019715b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:48.517505 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:48.536742 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38025b21-e780-4088-a84e-3bbf9019715b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:48.538218 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38025b21-e780-4088-a84e-3bbf9019715b service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:48.547449 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1172/2342] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:47:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:47:50.623809 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01629c-acae-46c8-981d-96c7655fafb6 service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:50.688347 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01629c-acae-46c8-981d-96c7655fafb6 service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:50.692791 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738e797-16fb-4280-8368-046282eaccd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:50.693414 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738e797-16fb-4280-8368-046282eaccd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:50.693692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738e797-16fb-4280-8368-046282eaccd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:50.693995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738e797-16fb-4280-8368-046282eaccd4 admin admin] PATH_INFO: `/v3/users/1062377d3ee54a6b95bd1fd697026972` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:50.695118 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738e797-16fb-4280-8368-046282eaccd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1062377d3ee54a6b95bd1fd697026972)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:50.697566 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738e797-16fb-4280-8368-046282eaccd4 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:50.754571 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-4738e797-16fb-4280-8368-046282eaccd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1062377d3ee54a6b95bd1fd697026972'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:50.763086 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-4738e797-16fb-4280-8368-046282eaccd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1062377d3ee54a6b95bd1fd697026972'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:50.763791 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-4738e797-16fb-4280-8368-046282eaccd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1062377d3ee54a6b95bd1fd697026972'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:50.764392 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-4738e797-16fb-4280-8368-046282eaccd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1062377d3ee54a6b95bd1fd697026972'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:50.772991 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-4738e797-16fb-4280-8368-046282eaccd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1062377d3ee54a6b95bd1fd697026972'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:50.793793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1171/2343] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:47:50 2022] DELETE /identity/v3/users/1062377d3ee54a6b95bd1fd697026972 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:50.798285 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3466ab2-6ad7-4788-a738-b3a025c8d167 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:50.798809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3466ab2-6ad7-4788-a738-b3a025c8d167 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:50.798809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3466ab2-6ad7-4788-a738-b3a025c8d167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:50.817708 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-e3466ab2-6ad7-4788-a738-b3a025c8d167 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:50.818922 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e3466ab2-6ad7-4788-a738-b3a025c8d167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:50.885109 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1173/2344] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:50.895689 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738e797-16fb-4280-8368-046282eaccd4 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:50.897101 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-4738e797-16fb-4280-8368-046282eaccd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:50.986351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738e797-16fb-4280-8368-046282eaccd4 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:50.989987 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf474dc2-9cba-4c0a-a8ad-47b961fa1ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:50.990588 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf474dc2-9cba-4c0a-a8ad-47b961fa1ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:50.990863 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf474dc2-9cba-4c0a-a8ad-47b961fa1ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:50.991129 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf474dc2-9cba-4c0a-a8ad-47b961fa1ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:50.997669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:51.001748 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf474dc2-9cba-4c0a-a8ad-47b961fa1ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:51.003392 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf474dc2-9cba-4c0a-a8ad-47b961fa1ab9 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:51.015582 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1172/2345] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:47:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:47:51.295089 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3466ab2-6ad7-4788-a738-b3a025c8d167 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:51.296506 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e3466ab2-6ad7-4788-a738-b3a025c8d167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:51.311667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3466ab2-6ad7-4788-a738-b3a025c8d167 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:51.317259 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88e392-8859-483b-a1b6-81f7b2b00780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:51.318290 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88e392-8859-483b-a1b6-81f7b2b00780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:51.318571 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88e392-8859-483b-a1b6-81f7b2b00780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:51.318846 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88e392-8859-483b-a1b6-81f7b2b00780 admin admin] PATH_INFO: `/v3/projects/a205f3f143024e609c673ac2b2bb90f5` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:51.320292 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88e392-8859-483b-a1b6-81f7b2b00780 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a205f3f143024e609c673ac2b2bb90f5)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:51.323006 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88e392-8859-483b-a1b6-81f7b2b00780 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:51.369996 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-5a88e392-8859-483b-a1b6-81f7b2b00780 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a205f3f143024e609c673ac2b2bb90f5', 'request_id': 'req-5a88e392-8859-483b-a1b6-81f7b2b00780'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:51.375408 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-5a88e392-8859-483b-a1b6-81f7b2b00780 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a205f3f143024e609c673ac2b2bb90f5', 'request_id': 'req-5a88e392-8859-483b-a1b6-81f7b2b00780'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:51.382610 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-5a88e392-8859-483b-a1b6-81f7b2b00780 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a205f3f143024e609c673ac2b2bb90f5', 'request_id': 'req-5a88e392-8859-483b-a1b6-81f7b2b00780'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:51.393513 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-5a88e392-8859-483b-a1b6-81f7b2b00780 admin admin] The token cache is being invalidate because project a205f3f143024e609c673ac2b2bb90f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:47:51.393800 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-5a88e392-8859-483b-a1b6-81f7b2b00780 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:51.394452 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-5a88e392-8859-483b-a1b6-81f7b2b00780 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:51.395908 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1174/2346] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:47:51 2022] DELETE /identity/v3/projects/a205f3f143024e609c673ac2b2bb90f5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:51.400123 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf474dc2-9cba-4c0a-a8ad-47b961fa1ab9 service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:51.409493 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf474dc2-9cba-4c0a-a8ad-47b961fa1ab9 service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:51.465497 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9697aa-02e0-4d3d-849c-0e9ff82b7922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:51.466070 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9697aa-02e0-4d3d-849c-0e9ff82b7922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:51.466351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9697aa-02e0-4d3d-849c-0e9ff82b7922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:51.466626 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9697aa-02e0-4d3d-849c-0e9ff82b7922 admin admin] PATH_INFO: `/v3/users/8181aa29f1884d9a94d607e16117a9ed` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:51.467721 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9697aa-02e0-4d3d-849c-0e9ff82b7922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8181aa29f1884d9a94d607e16117a9ed)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:51.469664 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9697aa-02e0-4d3d-849c-0e9ff82b7922 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:51.513896 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-fc9697aa-02e0-4d3d-849c-0e9ff82b7922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8181aa29f1884d9a94d607e16117a9ed'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:51.520769 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-fc9697aa-02e0-4d3d-849c-0e9ff82b7922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8181aa29f1884d9a94d607e16117a9ed'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:51.521440 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-fc9697aa-02e0-4d3d-849c-0e9ff82b7922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8181aa29f1884d9a94d607e16117a9ed'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:51.522076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-fc9697aa-02e0-4d3d-849c-0e9ff82b7922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8181aa29f1884d9a94d607e16117a9ed'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:51.532093 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-fc9697aa-02e0-4d3d-849c-0e9ff82b7922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8181aa29f1884d9a94d607e16117a9ed'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:51.553968 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1173/2347] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:47:51 2022] DELETE /identity/v3/users/8181aa29f1884d9a94d607e16117a9ed => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:51.825176 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88e392-8859-483b-a1b6-81f7b2b00780 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:51.826709 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-5a88e392-8859-483b-a1b6-81f7b2b00780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:51.845963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88e392-8859-483b-a1b6-81f7b2b00780 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:51.908252 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8d66e-b08c-47e3-acbf-08793b79b475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:51.908891 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8d66e-b08c-47e3-acbf-08793b79b475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:51.909172 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8d66e-b08c-47e3-acbf-08793b79b475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:51.909449 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8d66e-b08c-47e3-acbf-08793b79b475 admin admin] PATH_INFO: `/v3/projects/94193dbb9c734b74af2eb7c2df39c280` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:51.910595 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8d66e-b08c-47e3-acbf-08793b79b475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94193dbb9c734b74af2eb7c2df39c280)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:51.913346 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8d66e-b08c-47e3-acbf-08793b79b475 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:51.914810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:51.967627 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-3de8d66e-b08c-47e3-acbf-08793b79b475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94193dbb9c734b74af2eb7c2df39c280', 'request_id': 'req-3de8d66e-b08c-47e3-acbf-08793b79b475'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:51.973343 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-3de8d66e-b08c-47e3-acbf-08793b79b475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94193dbb9c734b74af2eb7c2df39c280', 'request_id': 'req-3de8d66e-b08c-47e3-acbf-08793b79b475'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:51.982454 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-3de8d66e-b08c-47e3-acbf-08793b79b475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94193dbb9c734b74af2eb7c2df39c280', 'request_id': 'req-3de8d66e-b08c-47e3-acbf-08793b79b475'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:51.994615 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-3de8d66e-b08c-47e3-acbf-08793b79b475 admin admin] The token cache is being invalidate because project 94193dbb9c734b74af2eb7c2df39c280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:47:51.994909 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-3de8d66e-b08c-47e3-acbf-08793b79b475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:51.995572 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-3de8d66e-b08c-47e3-acbf-08793b79b475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:51.997885 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1175/2348] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:47:51 2022] DELETE /identity/v3/projects/94193dbb9c734b74af2eb7c2df39c280 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:52.001457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9697aa-02e0-4d3d-849c-0e9ff82b7922 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:52.004053 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-fc9697aa-02e0-4d3d-849c-0e9ff82b7922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:52.018791 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9697aa-02e0-4d3d-849c-0e9ff82b7922 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:52.081641 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af73ca-3a11-4301-96f5-adf2443b5728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:52.082343 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af73ca-3a11-4301-96f5-adf2443b5728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:52.082629 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af73ca-3a11-4301-96f5-adf2443b5728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:52.082906 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af73ca-3a11-4301-96f5-adf2443b5728 admin admin] PATH_INFO: `/v3/users/659b6c7c02804092ac6fc2adeecb10a4` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:52.084230 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af73ca-3a11-4301-96f5-adf2443b5728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=659b6c7c02804092ac6fc2adeecb10a4)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:52.086230 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af73ca-3a11-4301-96f5-adf2443b5728 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:52.101526 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:52.144677 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-05af73ca-3a11-4301-96f5-adf2443b5728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '659b6c7c02804092ac6fc2adeecb10a4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:52.151551 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-05af73ca-3a11-4301-96f5-adf2443b5728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '659b6c7c02804092ac6fc2adeecb10a4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:52.152221 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-05af73ca-3a11-4301-96f5-adf2443b5728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '659b6c7c02804092ac6fc2adeecb10a4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:52.152863 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-05af73ca-3a11-4301-96f5-adf2443b5728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '659b6c7c02804092ac6fc2adeecb10a4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:52.161295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-05af73ca-3a11-4301-96f5-adf2443b5728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '659b6c7c02804092ac6fc2adeecb10a4'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:52.187509 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1174/2349] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:47:52 2022] DELETE /identity/v3/users/659b6c7c02804092ac6fc2adeecb10a4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:52.543417 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8d66e-b08c-47e3-acbf-08793b79b475 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:52.545527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-3de8d66e-b08c-47e3-acbf-08793b79b475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:52.561966 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8d66e-b08c-47e3-acbf-08793b79b475 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:52.631140 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c8faa-0683-4c54-a742-b02173426a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:52.631777 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c8faa-0683-4c54-a742-b02173426a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:52.632057 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c8faa-0683-4c54-a742-b02173426a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:52.632331 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c8faa-0683-4c54-a742-b02173426a62 admin admin] PATH_INFO: `/v3/projects/01f7460fd8274f16a47dd5db0425dc5f` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:52.633461 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c8faa-0683-4c54-a742-b02173426a62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f7460fd8274f16a47dd5db0425dc5f)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:52.636517 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c8faa-0683-4c54-a742-b02173426a62 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:52.695751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c02c8faa-0683-4c54-a742-b02173426a62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f7460fd8274f16a47dd5db0425dc5f', 'request_id': 'req-c02c8faa-0683-4c54-a742-b02173426a62'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:52.701822 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c02c8faa-0683-4c54-a742-b02173426a62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f7460fd8274f16a47dd5db0425dc5f', 'request_id': 'req-c02c8faa-0683-4c54-a742-b02173426a62'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:52.710833 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c02c8faa-0683-4c54-a742-b02173426a62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f7460fd8274f16a47dd5db0425dc5f', 'request_id': 'req-c02c8faa-0683-4c54-a742-b02173426a62'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:52.726048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c02c8faa-0683-4c54-a742-b02173426a62 admin admin] The token cache is being invalidate because project 01f7460fd8274f16a47dd5db0425dc5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:47:52.726339 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c02c8faa-0683-4c54-a742-b02173426a62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:52.726985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c02c8faa-0683-4c54-a742-b02173426a62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:52.729536 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1176/2350] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:47:52 2022] DELETE /identity/v3/projects/01f7460fd8274f16a47dd5db0425dc5f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:52.735426 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0a842-d3b9-4110-8fa4-86f10058fa8b None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:52.735723 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0a842-d3b9-4110-8fa4-86f10058fa8b None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:52.735995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0a842-d3b9-4110-8fa4-86f10058fa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:52.756767 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-76f0a842-d3b9-4110-8fa4-86f10058fa8b None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:52.758007 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-76f0a842-d3b9-4110-8fa4-86f10058fa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:52.817562 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1175/2351] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:52.826011 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d3535-aff8-4053-af2f-9b37d67f5380 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:52.826524 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d3535-aff8-4053-af2f-9b37d67f5380 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:52.826685 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d3535-aff8-4053-af2f-9b37d67f5380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:52.847362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-605d3535-aff8-4053-af2f-9b37d67f5380 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:52.848663 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-605d3535-aff8-4053-af2f-9b37d67f5380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:52.857764 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1177/2352] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:52.861927 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0a842-d3b9-4110-8fa4-86f10058fa8b None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:52.873301 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0a842-d3b9-4110-8fa4-86f10058fa8b None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:52.877883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4021f93-a52b-4595-a674-d2d1c1b85d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:52.878482 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4021f93-a52b-4595-a674-d2d1c1b85d08 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:52.879012 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4021f93-a52b-4595-a674-d2d1c1b85d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:52.879281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4021f93-a52b-4595-a674-d2d1c1b85d08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:52.879921 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4021f93-a52b-4595-a674-d2d1c1b85d08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:47:52.880216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4021f93-a52b-4595-a674-d2d1c1b85d08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:52.881807 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4021f93-a52b-4595-a674-d2d1c1b85d08 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:52.894547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1176/2353] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:47:52.898942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d3535-aff8-4053-af2f-9b37d67f5380 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:52.909423 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d3535-aff8-4053-af2f-9b37d67f5380 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:52.914134 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23786717-b8e5-45ff-888f-c744e0fb3fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:52.914740 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23786717-b8e5-45ff-888f-c744e0fb3fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:52.915598 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23786717-b8e5-45ff-888f-c744e0fb3fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:52.916148 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23786717-b8e5-45ff-888f-c744e0fb3fc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:52.916807 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23786717-b8e5-45ff-888f-c744e0fb3fc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:52.918781 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23786717-b8e5-45ff-888f-c744e0fb3fc7 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:52.934517 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:52.950376 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1178/2354] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:47:52 2022] POST /identity/v3/projects => generated 401 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:47:52.954553 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4021f93-a52b-4595-a674-d2d1c1b85d08 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:52.969163 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4021f93-a52b-4595-a674-d2d1c1b85d08 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:53.027788 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b4fbd-23e3-439c-94d1-99663b2af769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:53.028668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b4fbd-23e3-439c-94d1-99663b2af769 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:53.028776 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b4fbd-23e3-439c-94d1-99663b2af769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:53.029023 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b4fbd-23e3-439c-94d1-99663b2af769 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:53.029743 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b4fbd-23e3-439c-94d1-99663b2af769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:53.031956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b4fbd-23e3-439c-94d1-99663b2af769 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:53.054213 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1177/2355] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:47:52 2022] POST /identity/v3/users => generated 301 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:47:53.058348 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23786717-b8e5-45ff-888f-c744e0fb3fc7 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:53.068566 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23786717-b8e5-45ff-888f-c744e0fb3fc7 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:53.074442 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe7d7e-199d-49fe-9dc1-8fe9ca9be645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:53.075075 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe7d7e-199d-49fe-9dc1-8fe9ca9be645 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:53.075488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe7d7e-199d-49fe-9dc1-8fe9ca9be645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:53.076678 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe7d7e-199d-49fe-9dc1-8fe9ca9be645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:53.077630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe7d7e-199d-49fe-9dc1-8fe9ca9be645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:53.079271 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe7d7e-199d-49fe-9dc1-8fe9ca9be645 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:53.092463 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1179/2356] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:47:53.096413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b4fbd-23e3-439c-94d1-99663b2af769 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:53.106792 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b4fbd-23e3-439c-94d1-99663b2af769 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:53.112771 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9bf56-49df-40c3-ac2f-ebef4602ca30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:53.113377 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9bf56-49df-40c3-ac2f-ebef4602ca30 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:53.113660 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9bf56-49df-40c3-ac2f-ebef4602ca30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:53.113959 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9bf56-49df-40c3-ac2f-ebef4602ca30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:53.114603 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9bf56-49df-40c3-ac2f-ebef4602ca30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:53.116201 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9bf56-49df-40c3-ac2f-ebef4602ca30 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:53.119528 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:53.134476 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1178/2357] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:47:53.135609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe7d7e-199d-49fe-9dc1-8fe9ca9be645 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:53.146091 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe7d7e-199d-49fe-9dc1-8fe9ca9be645 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:53.151593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f8452-e3d1-4300-8435-9ec7c1ef1506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:53.152306 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f8452-e3d1-4300-8435-9ec7c1ef1506 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:53.152582 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f8452-e3d1-4300-8435-9ec7c1ef1506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:53.152855 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f8452-e3d1-4300-8435-9ec7c1ef1506 admin admin] PATH_INFO: `/v3/projects/132877a8771e4bc1ab0f4b5c1d734eba/users/b04a0771700742759c8bf7d82a935d37/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:53.170095 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f8452-e3d1-4300-8435-9ec7c1ef1506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=132877a8771e4bc1ab0f4b5c1d734eba, user_id=b04a0771700742759c8bf7d82a935d37, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:53.173118 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f8452-e3d1-4300-8435-9ec7c1ef1506 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:53.191978 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1180/2358] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:47:53 2022] PUT /identity/v3/projects/132877a8771e4bc1ab0f4b5c1d734eba/users/b04a0771700742759c8bf7d82a935d37/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:53.204517 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f5f79-d11f-4b3e-a882-8225c388a7e7 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:53.204806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f5f79-d11f-4b3e-a882-8225c388a7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:53.205081 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f5f79-d11f-4b3e-a882-8225c388a7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:53.236323 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-553f5f79-d11f-4b3e-a882-8225c388a7e7 None None] MFA Rules not processed for user `b04a0771700742759c8bf7d82a935d37`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:53.237656 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-553f5f79-d11f-4b3e-a882-8225c388a7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:53.305289 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1179/2359] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:53 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:53.310345 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f8452-e3d1-4300-8435-9ec7c1ef1506 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:53.376159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f8452-e3d1-4300-8435-9ec7c1ef1506 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:53.381079 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b4372-63e3-48fa-9411-d22879d84943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:53.381698 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b4372-63e3-48fa-9411-d22879d84943 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:53.382005 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b4372-63e3-48fa-9411-d22879d84943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:53.382276 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b4372-63e3-48fa-9411-d22879d84943 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:53.382925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b4372-63e3-48fa-9411-d22879d84943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:53.385356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b4372-63e3-48fa-9411-d22879d84943 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:53.414657 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1181/2360] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:47:53 2022] POST /identity/v3/projects => generated 399 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:47:53.419666 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f5f79-d11f-4b3e-a882-8225c388a7e7 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:53.431221 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f5f79-d11f-4b3e-a882-8225c388a7e7 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:53.491097 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f823f3-929a-4a5a-8728-95b0544df73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:53.491712 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f823f3-929a-4a5a-8728-95b0544df73e admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:53.491995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f823f3-929a-4a5a-8728-95b0544df73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:53.492267 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f823f3-929a-4a5a-8728-95b0544df73e admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:53.492995 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f823f3-929a-4a5a-8728-95b0544df73e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:53.495338 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f823f3-929a-4a5a-8728-95b0544df73e admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:53.518687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1180/2361] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:47:53 2022] POST /identity/v3/users => generated 306 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:47:53.522809 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b4372-63e3-48fa-9411-d22879d84943 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:53.534817 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b4372-63e3-48fa-9411-d22879d84943 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:53.540031 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0aee9-f4c1-423b-923a-9d7a5ca3dfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:53.540824 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0aee9-f4c1-423b-923a-9d7a5ca3dfde admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:53.541226 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0aee9-f4c1-423b-923a-9d7a5ca3dfde admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:53.541567 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0aee9-f4c1-423b-923a-9d7a5ca3dfde admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:53.542320 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0aee9-f4c1-423b-923a-9d7a5ca3dfde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:53.543959 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0aee9-f4c1-423b-923a-9d7a5ca3dfde admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:53.554890 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1182/2362] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:47:53.559621 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f823f3-929a-4a5a-8728-95b0544df73e admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:53.570458 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f823f3-929a-4a5a-8728-95b0544df73e admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:53.579174 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db8b03-3388-4059-9386-4d7f3fd64892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:53.579848 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db8b03-3388-4059-9386-4d7f3fd64892 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:53.580128 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db8b03-3388-4059-9386-4d7f3fd64892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:53.580399 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db8b03-3388-4059-9386-4d7f3fd64892 admin admin] PATH_INFO: `/v3/projects/cd4d985578ad435cbb6eb08e9ecb3b0f/users/25b5c82f2b41428d9fe59a23d41a063b/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:53.598538 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db8b03-3388-4059-9386-4d7f3fd64892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4d985578ad435cbb6eb08e9ecb3b0f, user_id=25b5c82f2b41428d9fe59a23d41a063b, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:53.601202 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db8b03-3388-4059-9386-4d7f3fd64892 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:53.615690 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1181/2363] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:47:53 2022] PUT /identity/v3/projects/cd4d985578ad435cbb6eb08e9ecb3b0f/users/25b5c82f2b41428d9fe59a23d41a063b/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:53.619619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0aee9-f4c1-423b-923a-9d7a5ca3dfde admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:53.631745 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0aee9-f4c1-423b-923a-9d7a5ca3dfde admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:53.692665 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a5f52-2f7e-4950-b912-1cf72b3a692d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:53.693314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a5f52-2f7e-4950-b912-1cf72b3a692d admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:53.693594 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a5f52-2f7e-4950-b912-1cf72b3a692d admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:53.693883 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a5f52-2f7e-4950-b912-1cf72b3a692d admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:53.694522 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a5f52-2f7e-4950-b912-1cf72b3a692d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:53.696620 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a5f52-2f7e-4950-b912-1cf72b3a692d admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:53.709593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1183/2364] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:47:53.711157 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db8b03-3388-4059-9386-4d7f3fd64892 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:53.723828 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db8b03-3388-4059-9386-4d7f3fd64892 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:53.729905 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a535e0-8cef-4736-9e2e-bc08e3709cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:53.731011 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a535e0-8cef-4736-9e2e-bc08e3709cde admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:53.731382 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a535e0-8cef-4736-9e2e-bc08e3709cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:53.731713 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a535e0-8cef-4736-9e2e-bc08e3709cde admin admin] PATH_INFO: `/v3/projects/cd4d985578ad435cbb6eb08e9ecb3b0f/users/25b5c82f2b41428d9fe59a23d41a063b/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:53.734218 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a535e0-8cef-4736-9e2e-bc08e3709cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4d985578ad435cbb6eb08e9ecb3b0f, user_id=25b5c82f2b41428d9fe59a23d41a063b, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:53.737364 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a535e0-8cef-4736-9e2e-bc08e3709cde admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:53.748684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1182/2365] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:47:53 2022] PUT /identity/v3/projects/cd4d985578ad435cbb6eb08e9ecb3b0f/users/25b5c82f2b41428d9fe59a23d41a063b/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:53.749686 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd296017-279d-42ad-a372-085086431767 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:53.750005 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd296017-279d-42ad-a372-085086431767 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:53.750280 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd296017-279d-42ad-a372-085086431767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:53.759146 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d175ee4-a40b-4be0-a72b-e610102b8fc5 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:53.759437 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d175ee4-a40b-4be0-a72b-e610102b8fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:53.759764 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d175ee4-a40b-4be0-a72b-e610102b8fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:53.769864 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-fd296017-279d-42ad-a372-085086431767 None None] MFA Rules not processed for user `b38de7c21009499291ba1db0fd295a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:53.771089 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-fd296017-279d-42ad-a372-085086431767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:53.787579 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-1d175ee4-a40b-4be0-a72b-e610102b8fc5 None None] MFA Rules not processed for user `25b5c82f2b41428d9fe59a23d41a063b`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:53.788820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-1d175ee4-a40b-4be0-a72b-e610102b8fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:53.796545 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:53.822614 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:53.837725 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1184/2366] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:47:53.866285 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1183/2367] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:53 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:47:53.877615 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd296017-279d-42ad-a372-085086431767 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:53.879366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-fd296017-279d-42ad-a372-085086431767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:53.941984 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd296017-279d-42ad-a372-085086431767 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:53.946123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f09b96-1a35-4153-8ec5-a6a2beebf34d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:53.947089 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f09b96-1a35-4153-8ec5-a6a2beebf34d service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:53.947358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f09b96-1a35-4153-8ec5-a6a2beebf34d service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:53.947623 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f09b96-1a35-4153-8ec5-a6a2beebf34d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:53.958104 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f09b96-1a35-4153-8ec5-a6a2beebf34d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:53.959655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f09b96-1a35-4153-8ec5-a6a2beebf34d service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:53.970658 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1185/2368] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:47:53 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:47:54.053697 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d175ee4-a40b-4be0-a72b-e610102b8fc5 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:54.064109 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d175ee4-a40b-4be0-a72b-e610102b8fc5 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:54.067731 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828f8ff-a08b-414e-b1ca-d9adff98aab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:54.068329 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828f8ff-a08b-414e-b1ca-d9adff98aab9 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:54.068604 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828f8ff-a08b-414e-b1ca-d9adff98aab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:54.068868 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828f8ff-a08b-414e-b1ca-d9adff98aab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:54.127903 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828f8ff-a08b-414e-b1ca-d9adff98aab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:54.129736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828f8ff-a08b-414e-b1ca-d9adff98aab9 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:54.138916 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1184/2369] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:47:54 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:47:58.312344 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f09b96-1a35-4153-8ec5-a6a2beebf34d service cinder] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:58.374181 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f09b96-1a35-4153-8ec5-a6a2beebf34d service cinder] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:58.378888 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8240b-8269-4508-ae45-002b8da09677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:58.379508 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8240b-8269-4508-ae45-002b8da09677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:58.379789 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8240b-8269-4508-ae45-002b8da09677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:58.380059 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8240b-8269-4508-ae45-002b8da09677 admin admin] PATH_INFO: `/v3/users/b04a0771700742759c8bf7d82a935d37` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:58.381154 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8240b-8269-4508-ae45-002b8da09677 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b04a0771700742759c8bf7d82a935d37)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:58.383143 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8240b-8269-4508-ae45-002b8da09677 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:58.436360 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-59a8240b-8269-4508-ae45-002b8da09677 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b04a0771700742759c8bf7d82a935d37'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:58.443688 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-59a8240b-8269-4508-ae45-002b8da09677 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b04a0771700742759c8bf7d82a935d37'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:58.456818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-59a8240b-8269-4508-ae45-002b8da09677 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b04a0771700742759c8bf7d82a935d37'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:58.457543 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-59a8240b-8269-4508-ae45-002b8da09677 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b04a0771700742759c8bf7d82a935d37'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:58.461999 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:58.465724 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-59a8240b-8269-4508-ae45-002b8da09677 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b04a0771700742759c8bf7d82a935d37'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:58.473202 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1186/2370] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:47:58 2022] DELETE /identity/v3/users/b04a0771700742759c8bf7d82a935d37 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:58.478452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de678276-bc93-46f3-8331-1ec9269415e3 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:58.478900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de678276-bc93-46f3-8331-1ec9269415e3 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:58.479034 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de678276-bc93-46f3-8331-1ec9269415e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:58.498736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-de678276-bc93-46f3-8331-1ec9269415e3 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:58.499949 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-de678276-bc93-46f3-8331-1ec9269415e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:58.561455 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1185/2371] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:58.570951 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8240b-8269-4508-ae45-002b8da09677 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:58.572384 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-59a8240b-8269-4508-ae45-002b8da09677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:58.638256 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8240b-8269-4508-ae45-002b8da09677 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:58.641945 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f9869-4c42-4ec3-8401-636958f1146d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:58.642557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f9869-4c42-4ec3-8401-636958f1146d service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:58.642834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f9869-4c42-4ec3-8401-636958f1146d service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:58.643110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f9869-4c42-4ec3-8401-636958f1146d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:58.656572 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f9869-4c42-4ec3-8401-636958f1146d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:58.658056 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f9869-4c42-4ec3-8401-636958f1146d service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:58.668151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1187/2372] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:47:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:47:59.177458 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de678276-bc93-46f3-8331-1ec9269415e3 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:59.179150 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-de678276-bc93-46f3-8331-1ec9269415e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:59.191893 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de678276-bc93-46f3-8331-1ec9269415e3 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:59.198134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a39da-6c89-4396-94d5-984253131f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:59.198939 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a39da-6c89-4396-94d5-984253131f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:59.199306 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a39da-6c89-4396-94d5-984253131f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:59.199742 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a39da-6c89-4396-94d5-984253131f4b admin admin] PATH_INFO: `/v3/projects/132877a8771e4bc1ab0f4b5c1d734eba` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:59.201413 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a39da-6c89-4396-94d5-984253131f4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=132877a8771e4bc1ab0f4b5c1d734eba)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:59.212230 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a39da-6c89-4396-94d5-984253131f4b admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:59.270408 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d08a39da-6c89-4396-94d5-984253131f4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '132877a8771e4bc1ab0f4b5c1d734eba', 'request_id': 'req-d08a39da-6c89-4396-94d5-984253131f4b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:59.277863 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d08a39da-6c89-4396-94d5-984253131f4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '132877a8771e4bc1ab0f4b5c1d734eba', 'request_id': 'req-d08a39da-6c89-4396-94d5-984253131f4b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:59.279763 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:59.284234 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d08a39da-6c89-4396-94d5-984253131f4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '132877a8771e4bc1ab0f4b5c1d734eba', 'request_id': 'req-d08a39da-6c89-4396-94d5-984253131f4b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:59.297260 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d08a39da-6c89-4396-94d5-984253131f4b admin admin] The token cache is being invalidate because project 132877a8771e4bc1ab0f4b5c1d734eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:47:59.297540 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d08a39da-6c89-4396-94d5-984253131f4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:59.298178 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d08a39da-6c89-4396-94d5-984253131f4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:59.299646 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1186/2373] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:47:59 2022] DELETE /identity/v3/projects/132877a8771e4bc1ab0f4b5c1d734eba => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:59.303800 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f9869-4c42-4ec3-8401-636958f1146d service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:59.313425 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f9869-4c42-4ec3-8401-636958f1146d service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:59.369271 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b3692-c504-4d09-8662-001cf4e40880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:59.369928 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b3692-c504-4d09-8662-001cf4e40880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:59.370207 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b3692-c504-4d09-8662-001cf4e40880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:59.370476 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b3692-c504-4d09-8662-001cf4e40880 admin admin] PATH_INFO: `/v3/users/25b5c82f2b41428d9fe59a23d41a063b` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:59.371564 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b3692-c504-4d09-8662-001cf4e40880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25b5c82f2b41428d9fe59a23d41a063b)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:59.373500 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b3692-c504-4d09-8662-001cf4e40880 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:59.419101 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-197b3692-c504-4d09-8662-001cf4e40880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25b5c82f2b41428d9fe59a23d41a063b'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:59.426397 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-197b3692-c504-4d09-8662-001cf4e40880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25b5c82f2b41428d9fe59a23d41a063b'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:59.439212 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-197b3692-c504-4d09-8662-001cf4e40880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25b5c82f2b41428d9fe59a23d41a063b'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:59.439882 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-197b3692-c504-4d09-8662-001cf4e40880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25b5c82f2b41428d9fe59a23d41a063b'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:59.447404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-197b3692-c504-4d09-8662-001cf4e40880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25b5c82f2b41428d9fe59a23d41a063b'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:59.453568 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1188/2374] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:47:59 2022] DELETE /identity/v3/users/25b5c82f2b41428d9fe59a23d41a063b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:59.722942 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a39da-6c89-4396-94d5-984253131f4b admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:47:59.724383 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d08a39da-6c89-4396-94d5-984253131f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:59.740191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a39da-6c89-4396-94d5-984253131f4b admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:47:59.797778 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab7c69-9e8d-432a-8d40-c93693946ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:47:59.798442 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab7c69-9e8d-432a-8d40-c93693946ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:59.798725 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab7c69-9e8d-432a-8d40-c93693946ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:59.799000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab7c69-9e8d-432a-8d40-c93693946ffb admin admin] PATH_INFO: `/v3/projects/cd4d985578ad435cbb6eb08e9ecb3b0f` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:59.800141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab7c69-9e8d-432a-8d40-c93693946ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4d985578ad435cbb6eb08e9ecb3b0f)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:47:59.802095 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab7c69-9e8d-432a-8d40-c93693946ffb admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:47:59.848822 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-02ab7c69-9e8d-432a-8d40-c93693946ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4d985578ad435cbb6eb08e9ecb3b0f', 'request_id': 'req-02ab7c69-9e8d-432a-8d40-c93693946ffb'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:59.855957 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-02ab7c69-9e8d-432a-8d40-c93693946ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4d985578ad435cbb6eb08e9ecb3b0f', 'request_id': 'req-02ab7c69-9e8d-432a-8d40-c93693946ffb'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:59.861555 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-02ab7c69-9e8d-432a-8d40-c93693946ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4d985578ad435cbb6eb08e9ecb3b0f', 'request_id': 'req-02ab7c69-9e8d-432a-8d40-c93693946ffb'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:59.873216 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-02ab7c69-9e8d-432a-8d40-c93693946ffb admin admin] The token cache is being invalidate because project cd4d985578ad435cbb6eb08e9ecb3b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:47:59.873505 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-02ab7c69-9e8d-432a-8d40-c93693946ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:59.874220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-02ab7c69-9e8d-432a-8d40-c93693946ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:47:59.875687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1187/2375] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:47:59 2022] DELETE /identity/v3/projects/cd4d985578ad435cbb6eb08e9ecb3b0f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:47:59.880732 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb459f2-eefb-4ef0-8935-214dd7daa1ef None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:59.881004 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb459f2-eefb-4ef0-8935-214dd7daa1ef None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:59.881279 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb459f2-eefb-4ef0-8935-214dd7daa1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:59.901439 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-aeb459f2-eefb-4ef0-8935-214dd7daa1ef None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:59.902660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-aeb459f2-eefb-4ef0-8935-214dd7daa1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:47:59.914366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:59.967935 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1189/2376] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:47:59.975497 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5a8bc-9cfc-4ceb-99eb-cf592105fbd3 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:47:59.975779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5a8bc-9cfc-4ceb-99eb-cf592105fbd3 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:47:59.976054 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5a8bc-9cfc-4ceb-99eb-cf592105fbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:47:59.997342 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-1af5a8bc-9cfc-4ceb-99eb-cf592105fbd3 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:47:59.998581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-1af5a8bc-9cfc-4ceb-99eb-cf592105fbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:00.006655 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1188/2377] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:00.011002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb459f2-eefb-4ef0-8935-214dd7daa1ef None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:00.020527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb459f2-eefb-4ef0-8935-214dd7daa1ef None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:00.025576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50850b-33ff-465d-ab19-80f32d32170d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:00.026208 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50850b-33ff-465d-ab19-80f32d32170d admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:00.026474 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50850b-33ff-465d-ab19-80f32d32170d admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:00.026741 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50850b-33ff-465d-ab19-80f32d32170d admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:00.027378 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50850b-33ff-465d-ab19-80f32d32170d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:48:00.027673 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50850b-33ff-465d-ab19-80f32d32170d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:00.029268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50850b-33ff-465d-ab19-80f32d32170d admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:00.041042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1190/2378] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:48:00.045270 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5a8bc-9cfc-4ceb-99eb-cf592105fbd3 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:00.054284 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5a8bc-9cfc-4ceb-99eb-cf592105fbd3 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:00.059634 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3560fb-90e1-40ee-b99b-f5d45b88d0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:00.060231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3560fb-90e1-40ee-b99b-f5d45b88d0e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:00.060512 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3560fb-90e1-40ee-b99b-f5d45b88d0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:00.060784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3560fb-90e1-40ee-b99b-f5d45b88d0e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:00.061411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3560fb-90e1-40ee-b99b-f5d45b88d0e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:00.063384 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3560fb-90e1-40ee-b99b-f5d45b88d0e2 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:00.094128 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1189/2379] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:48:00 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:48:00.095268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50850b-33ff-465d-ab19-80f32d32170d admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:00.105755 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50850b-33ff-465d-ab19-80f32d32170d admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:00.161012 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba162b-c7dc-4677-abfa-e3ad5aabb8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:00.162065 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba162b-c7dc-4677-abfa-e3ad5aabb8da admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:00.162356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba162b-c7dc-4677-abfa-e3ad5aabb8da admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:00.162625 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba162b-c7dc-4677-abfa-e3ad5aabb8da admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:00.163251 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba162b-c7dc-4677-abfa-e3ad5aabb8da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:00.165307 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba162b-c7dc-4677-abfa-e3ad5aabb8da admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:00.186669 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1191/2380] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:48:00 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:48:00.190786 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3560fb-90e1-40ee-b99b-f5d45b88d0e2 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:00.201652 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3560fb-90e1-40ee-b99b-f5d45b88d0e2 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:00.206238 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9f405-6919-4bb1-a821-ff0cba366128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:00.206827 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9f405-6919-4bb1-a821-ff0cba366128 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:00.207120 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9f405-6919-4bb1-a821-ff0cba366128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:00.207367 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9f405-6919-4bb1-a821-ff0cba366128 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:00.207997 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9f405-6919-4bb1-a821-ff0cba366128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:00.209579 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9f405-6919-4bb1-a821-ff0cba366128 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:00.220485 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1190/2381] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:48:00.224347 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba162b-c7dc-4677-abfa-e3ad5aabb8da admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:00.234351 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba162b-c7dc-4677-abfa-e3ad5aabb8da admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:00.238837 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e187d3-7bfd-47b6-9f5f-a420a3663b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:00.239420 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e187d3-7bfd-47b6-9f5f-a420a3663b8b admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:00.239697 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e187d3-7bfd-47b6-9f5f-a420a3663b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:00.239966 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e187d3-7bfd-47b6-9f5f-a420a3663b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:00.240607 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e187d3-7bfd-47b6-9f5f-a420a3663b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:00.242244 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e187d3-7bfd-47b6-9f5f-a420a3663b8b admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:00.256201 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1192/2382] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:48:00.257622 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9f405-6919-4bb1-a821-ff0cba366128 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:00.268276 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9f405-6919-4bb1-a821-ff0cba366128 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:00.273294 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34ca35-7c04-4d28-a78e-d969d4c2f005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:00.274810 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34ca35-7c04-4d28-a78e-d969d4c2f005 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:00.275091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34ca35-7c04-4d28-a78e-d969d4c2f005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:00.275415 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34ca35-7c04-4d28-a78e-d969d4c2f005 admin admin] PATH_INFO: `/v3/projects/d79e345d14db45f59ebd42d571fb846c/users/5b31411a7be24139aba6e11abf18fbbc/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:00.290542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34ca35-7c04-4d28-a78e-d969d4c2f005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d79e345d14db45f59ebd42d571fb846c, user_id=5b31411a7be24139aba6e11abf18fbbc, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:00.293336 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34ca35-7c04-4d28-a78e-d969d4c2f005 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:00.306781 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1191/2383] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:48:00 2022] PUT /identity/v3/projects/d79e345d14db45f59ebd42d571fb846c/users/5b31411a7be24139aba6e11abf18fbbc/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:00.318136 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377893c8-e545-4240-9480-47309746d5cb None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:00.318615 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377893c8-e545-4240-9480-47309746d5cb None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:00.318728 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377893c8-e545-4240-9480-47309746d5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:00.348540 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-377893c8-e545-4240-9480-47309746d5cb None None] MFA Rules not processed for user `5b31411a7be24139aba6e11abf18fbbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:00.349742 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-377893c8-e545-4240-9480-47309746d5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:00.417804 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1193/2384] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:00.422320 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34ca35-7c04-4d28-a78e-d969d4c2f005 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:00.435453 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:00.485100 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34ca35-7c04-4d28-a78e-d969d4c2f005 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:00.489559 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3e128-83e9-4480-acef-236d415f1bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:00.490182 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3e128-83e9-4480-acef-236d415f1bee admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:00.490460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3e128-83e9-4480-acef-236d415f1bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:00.490729 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3e128-83e9-4480-acef-236d415f1bee admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:00.491346 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3e128-83e9-4480-acef-236d415f1bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:00.494059 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3e128-83e9-4480-acef-236d415f1bee admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:00.520257 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1192/2385] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:48:00 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:48:00.524636 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377893c8-e545-4240-9480-47309746d5cb None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:00.535355 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377893c8-e545-4240-9480-47309746d5cb None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:00.544028 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:00.594308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2638bb8-c34b-432e-94a2-37e5f7bdab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:00.595085 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2638bb8-c34b-432e-94a2-37e5f7bdab1c admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:00.595397 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2638bb8-c34b-432e-94a2-37e5f7bdab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:00.595707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2638bb8-c34b-432e-94a2-37e5f7bdab1c admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:00.596375 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2638bb8-c34b-432e-94a2-37e5f7bdab1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:00.598329 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2638bb8-c34b-432e-94a2-37e5f7bdab1c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:00.620529 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1194/2386] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:48:00 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:48:00.624755 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3e128-83e9-4480-acef-236d415f1bee admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:00.636187 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3e128-83e9-4480-acef-236d415f1bee admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:00.640944 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c8b43-6663-4856-894b-f1b70e1214b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:00.641544 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c8b43-6663-4856-894b-f1b70e1214b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:00.641822 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c8b43-6663-4856-894b-f1b70e1214b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:00.642121 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c8b43-6663-4856-894b-f1b70e1214b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:00.642786 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c8b43-6663-4856-894b-f1b70e1214b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:00.644417 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c8b43-6663-4856-894b-f1b70e1214b2 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:00.655170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1193/2387] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:48:00.659366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2638bb8-c34b-432e-94a2-37e5f7bdab1c admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:00.669609 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2638bb8-c34b-432e-94a2-37e5f7bdab1c admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:00.674266 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651bf94-7fae-40dc-92c4-9a47704dc9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:00.674862 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651bf94-7fae-40dc-92c4-9a47704dc9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:00.675139 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651bf94-7fae-40dc-92c4-9a47704dc9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:00.675404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651bf94-7fae-40dc-92c4-9a47704dc9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:00.676029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651bf94-7fae-40dc-92c4-9a47704dc9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:00.677633 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651bf94-7fae-40dc-92c4-9a47704dc9b5 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:00.688231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1195/2388] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:48:00.692384 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c8b43-6663-4856-894b-f1b70e1214b2 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:00.702864 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c8b43-6663-4856-894b-f1b70e1214b2 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:00.707571 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffd767-1750-4582-bd3b-aa1972390ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:00.708288 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffd767-1750-4582-bd3b-aa1972390ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:00.708634 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffd767-1750-4582-bd3b-aa1972390ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:00.709005 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffd767-1750-4582-bd3b-aa1972390ef6 admin admin] PATH_INFO: `/v3/projects/4ea029b5fb87487b8a17a8df85f546ae/users/029efe99da8d47a0b216ec013d1a63d0/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:00.724693 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ffd767-1750-4582-bd3b-aa1972390ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea029b5fb87487b8a17a8df85f546ae, user_id=029efe99da8d47a0b216ec013d1a63d0, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:00.728318 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ffd767-1750-4582-bd3b-aa1972390ef6 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:00.746627 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1194/2389] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:48:00 2022] PUT /identity/v3/projects/4ea029b5fb87487b8a17a8df85f546ae/users/029efe99da8d47a0b216ec013d1a63d0/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:00.757981 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d16c72-0e64-46dd-a702-8b7bfc43067f None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:00.758498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d16c72-0e64-46dd-a702-8b7bfc43067f None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:00.759101 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d16c72-0e64-46dd-a702-8b7bfc43067f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:00.793514 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-43d16c72-0e64-46dd-a702-8b7bfc43067f None None] MFA Rules not processed for user `029efe99da8d47a0b216ec013d1a63d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:00.794781 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-43d16c72-0e64-46dd-a702-8b7bfc43067f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:00.865581 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1196/2390] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:00.870240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffd767-1750-4582-bd3b-aa1972390ef6 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:00.933917 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffd767-1750-4582-bd3b-aa1972390ef6 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:00.938557 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babb8fd-d5dd-4068-8884-b240b7059556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:00.939164 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babb8fd-d5dd-4068-8884-b240b7059556 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:00.939439 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babb8fd-d5dd-4068-8884-b240b7059556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:00.939708 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babb8fd-d5dd-4068-8884-b240b7059556 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:00.940350 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babb8fd-d5dd-4068-8884-b240b7059556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:00.942295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babb8fd-d5dd-4068-8884-b240b7059556 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:00.972563 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1195/2391] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:48:00 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:48:00.973656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d16c72-0e64-46dd-a702-8b7bfc43067f None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:00.984812 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d16c72-0e64-46dd-a702-8b7bfc43067f None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:01.041227 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e3693-d13e-44ea-8638-271676fafb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:01.041832 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e3693-d13e-44ea-8638-271676fafb86 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:01.042135 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e3693-d13e-44ea-8638-271676fafb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:01.042404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e3693-d13e-44ea-8638-271676fafb86 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:01.043036 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e3693-d13e-44ea-8638-271676fafb86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:01.044999 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e3693-d13e-44ea-8638-271676fafb86 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:01.065497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1197/2392] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:48:00 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:48:01.069472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babb8fd-d5dd-4068-8884-b240b7059556 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:01.079755 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babb8fd-d5dd-4068-8884-b240b7059556 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:01.084300 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e46608-8faa-4b5d-b7a9-e01f7a676c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:01.084891 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e46608-8faa-4b5d-b7a9-e01f7a676c19 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:01.085171 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e46608-8faa-4b5d-b7a9-e01f7a676c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:01.085443 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e46608-8faa-4b5d-b7a9-e01f7a676c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:01.086149 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e46608-8faa-4b5d-b7a9-e01f7a676c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:01.087820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e46608-8faa-4b5d-b7a9-e01f7a676c19 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:01.098144 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1196/2393] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:48:01.102721 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e3693-d13e-44ea-8638-271676fafb86 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:01.112570 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e3693-d13e-44ea-8638-271676fafb86 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:01.117283 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33477a56-7a08-4e3a-a1be-13b3d5248382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:01.118653 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33477a56-7a08-4e3a-a1be-13b3d5248382 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:01.118954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33477a56-7a08-4e3a-a1be-13b3d5248382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:01.119212 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33477a56-7a08-4e3a-a1be-13b3d5248382 admin admin] PATH_INFO: `/v3/projects/5384d8fa5f264993a0e955a50e4b5ab8/users/cfc0c86c974646379d85a80929edd0aa/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:01.127997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:01.136293 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33477a56-7a08-4e3a-a1be-13b3d5248382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5384d8fa5f264993a0e955a50e4b5ab8, user_id=cfc0c86c974646379d85a80929edd0aa, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:01.139023 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33477a56-7a08-4e3a-a1be-13b3d5248382 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:01.151212 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1198/2394] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:48:01 2022] PUT /identity/v3/projects/5384d8fa5f264993a0e955a50e4b5ab8/users/cfc0c86c974646379d85a80929edd0aa/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:01.155125 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e46608-8faa-4b5d-b7a9-e01f7a676c19 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:01.165549 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e46608-8faa-4b5d-b7a9-e01f7a676c19 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:01.199274 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:01.223269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c03e5e-c617-4b85-b260-a8b6621e2e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:01.223875 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c03e5e-c617-4b85-b260-a8b6621e2e25 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:01.224160 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c03e5e-c617-4b85-b260-a8b6621e2e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:01.224437 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c03e5e-c617-4b85-b260-a8b6621e2e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:01.225078 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c03e5e-c617-4b85-b260-a8b6621e2e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:01.227202 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c03e5e-c617-4b85-b260-a8b6621e2e25 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:01.236819 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1197/2395] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:48:01.241016 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33477a56-7a08-4e3a-a1be-13b3d5248382 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:01.251615 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33477a56-7a08-4e3a-a1be-13b3d5248382 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:01.256417 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf345a-9188-4dcd-bc4b-fb8c2ad76078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:01.257055 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf345a-9188-4dcd-bc4b-fb8c2ad76078 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:01.257437 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf345a-9188-4dcd-bc4b-fb8c2ad76078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:01.257605 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf345a-9188-4dcd-bc4b-fb8c2ad76078 admin admin] PATH_INFO: `/v3/projects/5384d8fa5f264993a0e955a50e4b5ab8/users/cfc0c86c974646379d85a80929edd0aa/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:01.259958 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf345a-9188-4dcd-bc4b-fb8c2ad76078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5384d8fa5f264993a0e955a50e4b5ab8, user_id=cfc0c86c974646379d85a80929edd0aa, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:01.262715 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf345a-9188-4dcd-bc4b-fb8c2ad76078 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:01.273234 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1199/2396] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:48:01 2022] PUT /identity/v3/projects/5384d8fa5f264993a0e955a50e4b5ab8/users/cfc0c86c974646379d85a80929edd0aa/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:01.284540 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e445ebe-d181-4fca-99b5-ddb9d6636934 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:01.284834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e445ebe-d181-4fca-99b5-ddb9d6636934 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:01.285115 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e445ebe-d181-4fca-99b5-ddb9d6636934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:01.313523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-1e445ebe-d181-4fca-99b5-ddb9d6636934 None None] MFA Rules not processed for user `cfc0c86c974646379d85a80929edd0aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:01.314771 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-1e445ebe-d181-4fca-99b5-ddb9d6636934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:01.381901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1198/2397] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:01.393134 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf345a-9188-4dcd-bc4b-fb8c2ad76078 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:01.394888 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a3cf345a-9188-4dcd-bc4b-fb8c2ad76078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:01.452870 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf345a-9188-4dcd-bc4b-fb8c2ad76078 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:01.456777 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8092077-fe27-481f-8d81-6eedfa7d085b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:01.457380 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8092077-fe27-481f-8d81-6eedfa7d085b service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:01.457677 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8092077-fe27-481f-8d81-6eedfa7d085b service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:01.457984 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8092077-fe27-481f-8d81-6eedfa7d085b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:01.468050 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8092077-fe27-481f-8d81-6eedfa7d085b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:01.469487 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8092077-fe27-481f-8d81-6eedfa7d085b service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:01.479707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1200/2398] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:48:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:48:01.521076 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e445ebe-d181-4fca-99b5-ddb9d6636934 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:01.522607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-1e445ebe-d181-4fca-99b5-ddb9d6636934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:01.535474 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e445ebe-d181-4fca-99b5-ddb9d6636934 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:01.539689 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e3341-56f6-4b5e-ae96-c35b23789709 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:01.540311 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e3341-56f6-4b5e-ae96-c35b23789709 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:01.540591 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e3341-56f6-4b5e-ae96-c35b23789709 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:01.540867 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e3341-56f6-4b5e-ae96-c35b23789709 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:01.599697 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e3341-56f6-4b5e-ae96-c35b23789709 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:01.601131 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e3341-56f6-4b5e-ae96-c35b23789709 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:01.610336 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1199/2399] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:48:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:48:04.498207 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8092077-fe27-481f-8d81-6eedfa7d085b service cinder] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:04.565380 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8092077-fe27-481f-8d81-6eedfa7d085b service cinder] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:04.570163 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c911370-ce67-4a04-88ee-88f7545d740d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:04.571392 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c911370-ce67-4a04-88ee-88f7545d740d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:04.571679 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c911370-ce67-4a04-88ee-88f7545d740d admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:04.571952 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c911370-ce67-4a04-88ee-88f7545d740d admin admin] PATH_INFO: `/v3/users/5b31411a7be24139aba6e11abf18fbbc` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:04.573203 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c911370-ce67-4a04-88ee-88f7545d740d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b31411a7be24139aba6e11abf18fbbc)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:04.575147 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c911370-ce67-4a04-88ee-88f7545d740d admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:04.622064 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-5c911370-ce67-4a04-88ee-88f7545d740d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b31411a7be24139aba6e11abf18fbbc'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:04.629811 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-5c911370-ce67-4a04-88ee-88f7545d740d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b31411a7be24139aba6e11abf18fbbc'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:04.643054 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-5c911370-ce67-4a04-88ee-88f7545d740d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b31411a7be24139aba6e11abf18fbbc'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:04.643799 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-5c911370-ce67-4a04-88ee-88f7545d740d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b31411a7be24139aba6e11abf18fbbc'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:04.647621 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:04.652339 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-5c911370-ce67-4a04-88ee-88f7545d740d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b31411a7be24139aba6e11abf18fbbc'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:04.660156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1201/2400] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:48:04 2022] DELETE /identity/v3/users/5b31411a7be24139aba6e11abf18fbbc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:04.665766 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcddb2-7b7b-4646-b5bb-4c6ba01ab859 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:04.666334 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcddb2-7b7b-4646-b5bb-4c6ba01ab859 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:04.666334 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcddb2-7b7b-4646-b5bb-4c6ba01ab859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:04.688142 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-bcfcddb2-7b7b-4646-b5bb-4c6ba01ab859 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:04.689535 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-bcfcddb2-7b7b-4646-b5bb-4c6ba01ab859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:04.745522 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:04.755644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1200/2401] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:04.767147 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c911370-ce67-4a04-88ee-88f7545d740d admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:04.768608 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-5c911370-ce67-4a04-88ee-88f7545d740d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:04.829815 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c911370-ce67-4a04-88ee-88f7545d740d admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:04.834567 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d2977-4d44-4166-ac4a-341bd1490a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:04.835179 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d2977-4d44-4166-ac4a-341bd1490a71 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:04.835461 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d2977-4d44-4166-ac4a-341bd1490a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:04.835734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d2977-4d44-4166-ac4a-341bd1490a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:04.846842 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d2977-4d44-4166-ac4a-341bd1490a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:04.848394 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d2977-4d44-4166-ac4a-341bd1490a71 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:04.859014 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1202/2402] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:48:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:48:05.126689 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcddb2-7b7b-4646-b5bb-4c6ba01ab859 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:05.128505 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-bcfcddb2-7b7b-4646-b5bb-4c6ba01ab859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:05.141862 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcddb2-7b7b-4646-b5bb-4c6ba01ab859 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:05.146652 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46bc17-1780-4517-8295-a7d4eca5fff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:05.147290 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46bc17-1780-4517-8295-a7d4eca5fff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:05.147975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46bc17-1780-4517-8295-a7d4eca5fff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:05.147975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46bc17-1780-4517-8295-a7d4eca5fff6 admin admin] PATH_INFO: `/v3/projects/d79e345d14db45f59ebd42d571fb846c` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:05.149158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46bc17-1780-4517-8295-a7d4eca5fff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d79e345d14db45f59ebd42d571fb846c)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:05.151753 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46bc17-1780-4517-8295-a7d4eca5fff6 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:05.203311 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-dd46bc17-1780-4517-8295-a7d4eca5fff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd79e345d14db45f59ebd42d571fb846c', 'request_id': 'req-dd46bc17-1780-4517-8295-a7d4eca5fff6'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:05.210374 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-dd46bc17-1780-4517-8295-a7d4eca5fff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd79e345d14db45f59ebd42d571fb846c', 'request_id': 'req-dd46bc17-1780-4517-8295-a7d4eca5fff6'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:05.215876 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-dd46bc17-1780-4517-8295-a7d4eca5fff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd79e345d14db45f59ebd42d571fb846c', 'request_id': 'req-dd46bc17-1780-4517-8295-a7d4eca5fff6'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:05.226781 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-dd46bc17-1780-4517-8295-a7d4eca5fff6 admin admin] The token cache is being invalidate because project d79e345d14db45f59ebd42d571fb846c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:48:05.227068 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-dd46bc17-1780-4517-8295-a7d4eca5fff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:05.227702 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-dd46bc17-1780-4517-8295-a7d4eca5fff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:05.229181 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1201/2403] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:48:05 2022] DELETE /identity/v3/projects/d79e345d14db45f59ebd42d571fb846c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:05.233139 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d2977-4d44-4166-ac4a-341bd1490a71 service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:05.243171 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d2977-4d44-4166-ac4a-341bd1490a71 service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:05.298819 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be6852-fc63-4f23-a269-d9470d69bee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:05.299446 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be6852-fc63-4f23-a269-d9470d69bee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:05.299729 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be6852-fc63-4f23-a269-d9470d69bee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:05.300004 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be6852-fc63-4f23-a269-d9470d69bee7 admin admin] PATH_INFO: `/v3/users/029efe99da8d47a0b216ec013d1a63d0` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:05.301120 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be6852-fc63-4f23-a269-d9470d69bee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=029efe99da8d47a0b216ec013d1a63d0)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:05.303088 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be6852-fc63-4f23-a269-d9470d69bee7 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:05.349263 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c1be6852-fc63-4f23-a269-d9470d69bee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '029efe99da8d47a0b216ec013d1a63d0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:05.356552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c1be6852-fc63-4f23-a269-d9470d69bee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '029efe99da8d47a0b216ec013d1a63d0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:05.369012 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c1be6852-fc63-4f23-a269-d9470d69bee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '029efe99da8d47a0b216ec013d1a63d0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:05.369660 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c1be6852-fc63-4f23-a269-d9470d69bee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '029efe99da8d47a0b216ec013d1a63d0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:05.376771 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-c1be6852-fc63-4f23-a269-d9470d69bee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '029efe99da8d47a0b216ec013d1a63d0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:05.383110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1203/2404] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:48:05 2022] DELETE /identity/v3/users/029efe99da8d47a0b216ec013d1a63d0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:05.656753 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46bc17-1780-4517-8295-a7d4eca5fff6 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:05.658309 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-dd46bc17-1780-4517-8295-a7d4eca5fff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:05.671845 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46bc17-1780-4517-8295-a7d4eca5fff6 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:05.730484 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49713d98-9c6c-4817-8ffb-6c8de0db49e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:05.731114 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49713d98-9c6c-4817-8ffb-6c8de0db49e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:05.731390 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49713d98-9c6c-4817-8ffb-6c8de0db49e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:05.731662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49713d98-9c6c-4817-8ffb-6c8de0db49e5 admin admin] PATH_INFO: `/v3/projects/4ea029b5fb87487b8a17a8df85f546ae` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:05.732755 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49713d98-9c6c-4817-8ffb-6c8de0db49e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ea029b5fb87487b8a17a8df85f546ae)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:05.734687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49713d98-9c6c-4817-8ffb-6c8de0db49e5 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:05.780803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-49713d98-9c6c-4817-8ffb-6c8de0db49e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ea029b5fb87487b8a17a8df85f546ae', 'request_id': 'req-49713d98-9c6c-4817-8ffb-6c8de0db49e5'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:05.787754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-49713d98-9c6c-4817-8ffb-6c8de0db49e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ea029b5fb87487b8a17a8df85f546ae', 'request_id': 'req-49713d98-9c6c-4817-8ffb-6c8de0db49e5'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:05.793348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-49713d98-9c6c-4817-8ffb-6c8de0db49e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ea029b5fb87487b8a17a8df85f546ae', 'request_id': 'req-49713d98-9c6c-4817-8ffb-6c8de0db49e5'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:05.804175 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-49713d98-9c6c-4817-8ffb-6c8de0db49e5 admin admin] The token cache is being invalidate because project 4ea029b5fb87487b8a17a8df85f546ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:48:05.804467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-49713d98-9c6c-4817-8ffb-6c8de0db49e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:05.805592 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-49713d98-9c6c-4817-8ffb-6c8de0db49e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:05.807091 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1202/2405] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:48:05 2022] DELETE /identity/v3/projects/4ea029b5fb87487b8a17a8df85f546ae => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:05.811194 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be6852-fc63-4f23-a269-d9470d69bee7 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:05.812634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-c1be6852-fc63-4f23-a269-d9470d69bee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:05.826029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be6852-fc63-4f23-a269-d9470d69bee7 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:05.838571 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:05.885549 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b128f8a-5b4f-4a2a-8d43-ea1521642ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:05.886130 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b128f8a-5b4f-4a2a-8d43-ea1521642ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:05.886414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b128f8a-5b4f-4a2a-8d43-ea1521642ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:05.886691 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b128f8a-5b4f-4a2a-8d43-ea1521642ca8 admin admin] PATH_INFO: `/v3/users/cfc0c86c974646379d85a80929edd0aa` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:05.887812 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b128f8a-5b4f-4a2a-8d43-ea1521642ca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc0c86c974646379d85a80929edd0aa)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:05.889739 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b128f8a-5b4f-4a2a-8d43-ea1521642ca8 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:05.934976 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-4b128f8a-5b4f-4a2a-8d43-ea1521642ca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc0c86c974646379d85a80929edd0aa'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:05.942027 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-4b128f8a-5b4f-4a2a-8d43-ea1521642ca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc0c86c974646379d85a80929edd0aa'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:05.954595 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-4b128f8a-5b4f-4a2a-8d43-ea1521642ca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc0c86c974646379d85a80929edd0aa'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:05.955278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-4b128f8a-5b4f-4a2a-8d43-ea1521642ca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc0c86c974646379d85a80929edd0aa'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:05.963499 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-4b128f8a-5b4f-4a2a-8d43-ea1521642ca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc0c86c974646379d85a80929edd0aa'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:05.969591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1204/2406] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:48:05 2022] DELETE /identity/v3/users/cfc0c86c974646379d85a80929edd0aa => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:06.245530 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49713d98-9c6c-4817-8ffb-6c8de0db49e5 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:06.247003 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-49713d98-9c6c-4817-8ffb-6c8de0db49e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:06.261226 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49713d98-9c6c-4817-8ffb-6c8de0db49e5 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:06.269038 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:06.324215 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63a100-8527-4a56-ab7d-50b2427386b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:06.324876 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63a100-8527-4a56-ab7d-50b2427386b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:06.325157 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63a100-8527-4a56-ab7d-50b2427386b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:06.325427 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63a100-8527-4a56-ab7d-50b2427386b3 admin admin] PATH_INFO: `/v3/projects/5384d8fa5f264993a0e955a50e4b5ab8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:06.326563 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63a100-8527-4a56-ab7d-50b2427386b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5384d8fa5f264993a0e955a50e4b5ab8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:06.328454 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63a100-8527-4a56-ab7d-50b2427386b3 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:06.375118 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8b63a100-8527-4a56-ab7d-50b2427386b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5384d8fa5f264993a0e955a50e4b5ab8', 'request_id': 'req-8b63a100-8527-4a56-ab7d-50b2427386b3'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:06.382515 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8b63a100-8527-4a56-ab7d-50b2427386b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5384d8fa5f264993a0e955a50e4b5ab8', 'request_id': 'req-8b63a100-8527-4a56-ab7d-50b2427386b3'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:06.388990 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8b63a100-8527-4a56-ab7d-50b2427386b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5384d8fa5f264993a0e955a50e4b5ab8', 'request_id': 'req-8b63a100-8527-4a56-ab7d-50b2427386b3'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:06.400635 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8b63a100-8527-4a56-ab7d-50b2427386b3 admin admin] The token cache is being invalidate because project 5384d8fa5f264993a0e955a50e4b5ab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:48:06.400923 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8b63a100-8527-4a56-ab7d-50b2427386b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:06.401563 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-8b63a100-8527-4a56-ab7d-50b2427386b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:06.403093 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1203/2407] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:48:06 2022] DELETE /identity/v3/projects/5384d8fa5f264993a0e955a50e4b5ab8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:06.409059 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf4c2e-3432-44d9-92e4-91d3f8c4cbe3 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:06.409343 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf4c2e-3432-44d9-92e4-91d3f8c4cbe3 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:06.409612 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf4c2e-3432-44d9-92e4-91d3f8c4cbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:06.429366 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-5cbf4c2e-3432-44d9-92e4-91d3f8c4cbe3 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:06.430610 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-5cbf4c2e-3432-44d9-92e4-91d3f8c4cbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:06.487225 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1205/2408] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:06.496083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fce2b-63e9-4714-92dc-ff659ebd6d99 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:06.496372 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fce2b-63e9-4714-92dc-ff659ebd6d99 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:06.496643 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fce2b-63e9-4714-92dc-ff659ebd6d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:06.516661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-896fce2b-63e9-4714-92dc-ff659ebd6d99 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:06.517903 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-896fce2b-63e9-4714-92dc-ff659ebd6d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:06.525717 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1204/2409] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:06.529887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf4c2e-3432-44d9-92e4-91d3f8c4cbe3 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:06.539428 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf4c2e-3432-44d9-92e4-91d3f8c4cbe3 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:06.543931 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e814200-9eef-443a-82eb-2e16a3585ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:06.544523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e814200-9eef-443a-82eb-2e16a3585ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:06.544801 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e814200-9eef-443a-82eb-2e16a3585ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:06.545070 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e814200-9eef-443a-82eb-2e16a3585ff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:06.545703 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e814200-9eef-443a-82eb-2e16a3585ff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:48:06.546036 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e814200-9eef-443a-82eb-2e16a3585ff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:06.547644 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e814200-9eef-443a-82eb-2e16a3585ff0 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:06.559297 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1206/2410] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:48:06.563683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fce2b-63e9-4714-92dc-ff659ebd6d99 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:06.572945 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fce2b-63e9-4714-92dc-ff659ebd6d99 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:06.577477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e490fb7-ed24-4360-9233-b5a31dd94940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:06.578096 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e490fb7-ed24-4360-9233-b5a31dd94940 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:06.578379 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e490fb7-ed24-4360-9233-b5a31dd94940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:06.578648 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e490fb7-ed24-4360-9233-b5a31dd94940 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:06.579283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e490fb7-ed24-4360-9233-b5a31dd94940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:06.581158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e490fb7-ed24-4360-9233-b5a31dd94940 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:06.609558 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1205/2411] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:48:06 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:48:06.613226 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e814200-9eef-443a-82eb-2e16a3585ff0 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:06.623261 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e814200-9eef-443a-82eb-2e16a3585ff0 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:06.643592 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:06.682057 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d21f0-fcfa-4e3c-9c9e-32fe958b47b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:06.682599 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d21f0-fcfa-4e3c-9c9e-32fe958b47b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:06.682881 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d21f0-fcfa-4e3c-9c9e-32fe958b47b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:06.683159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d21f0-fcfa-4e3c-9c9e-32fe958b47b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:06.683783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d21f0-fcfa-4e3c-9c9e-32fe958b47b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:06.685715 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d21f0-fcfa-4e3c-9c9e-32fe958b47b0 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:06.706304 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1207/2412] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:48:06 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:48:06.710521 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e490fb7-ed24-4360-9233-b5a31dd94940 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:06.721052 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e490fb7-ed24-4360-9233-b5a31dd94940 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:06.725644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0a04f-00d1-462f-8aa1-43f37aa37d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:06.726278 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0a04f-00d1-462f-8aa1-43f37aa37d94 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:06.726666 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0a04f-00d1-462f-8aa1-43f37aa37d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:06.726998 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0a04f-00d1-462f-8aa1-43f37aa37d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:06.727638 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0a04f-00d1-462f-8aa1-43f37aa37d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:06.729335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0a04f-00d1-462f-8aa1-43f37aa37d94 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:06.739075 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1206/2413] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:48:06.744158 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d21f0-fcfa-4e3c-9c9e-32fe958b47b0 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:06.754715 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d21f0-fcfa-4e3c-9c9e-32fe958b47b0 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:06.760113 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef952d32-a99f-4d1b-9310-8ebc50d5628b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:06.760711 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef952d32-a99f-4d1b-9310-8ebc50d5628b admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:06.760988 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef952d32-a99f-4d1b-9310-8ebc50d5628b admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:06.761412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef952d32-a99f-4d1b-9310-8ebc50d5628b admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:06.762085 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef952d32-a99f-4d1b-9310-8ebc50d5628b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:06.763674 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef952d32-a99f-4d1b-9310-8ebc50d5628b admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:06.774173 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1208/2414] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:48:06.778269 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0a04f-00d1-462f-8aa1-43f37aa37d94 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:06.788627 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0a04f-00d1-462f-8aa1-43f37aa37d94 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:06.793528 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9a76b-3324-4cd0-b147-7abf5902eebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:06.794211 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9a76b-3324-4cd0-b147-7abf5902eebe admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:06.794497 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9a76b-3324-4cd0-b147-7abf5902eebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:06.794772 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9a76b-3324-4cd0-b147-7abf5902eebe admin admin] PATH_INFO: `/v3/projects/d6f5fafe2c624ca8824a4e68d4f1afda/users/3900b27ada54425782b473221bb8ef01/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:06.809571 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9a76b-3324-4cd0-b147-7abf5902eebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6f5fafe2c624ca8824a4e68d4f1afda, user_id=3900b27ada54425782b473221bb8ef01, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:06.812259 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9a76b-3324-4cd0-b147-7abf5902eebe admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:06.825563 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1207/2415] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:48:06 2022] PUT /identity/v3/projects/d6f5fafe2c624ca8824a4e68d4f1afda/users/3900b27ada54425782b473221bb8ef01/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:06.837020 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b969fb-3a51-4648-bee3-7087294d6b29 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:06.837478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b969fb-3a51-4648-bee3-7087294d6b29 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:06.837577 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b969fb-3a51-4648-bee3-7087294d6b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:06.865494 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-35b969fb-3a51-4648-bee3-7087294d6b29 None None] MFA Rules not processed for user `3900b27ada54425782b473221bb8ef01`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:06.866739 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-35b969fb-3a51-4648-bee3-7087294d6b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:06.932374 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1209/2416] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:06.936870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9a76b-3324-4cd0-b147-7abf5902eebe admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:06.981301 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:07.005468 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9a76b-3324-4cd0-b147-7abf5902eebe admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:07.010414 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82967cf0-adc3-4724-bb71-7a02d691040e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:07.011032 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82967cf0-adc3-4724-bb71-7a02d691040e admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:07.011322 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82967cf0-adc3-4724-bb71-7a02d691040e admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:07.011594 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82967cf0-adc3-4724-bb71-7a02d691040e admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:07.012229 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82967cf0-adc3-4724-bb71-7a02d691040e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:07.014190 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82967cf0-adc3-4724-bb71-7a02d691040e admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:07.042814 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1208/2417] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:48:06 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:48:07.046777 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b969fb-3a51-4648-bee3-7087294d6b29 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:07.059269 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b969fb-3a51-4648-bee3-7087294d6b29 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:07.118966 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d3c64-15a3-4cec-896b-22bfd49afd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:07.119585 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d3c64-15a3-4cec-896b-22bfd49afd3f admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:07.119977 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d3c64-15a3-4cec-896b-22bfd49afd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:07.120252 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d3c64-15a3-4cec-896b-22bfd49afd3f admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:07.121034 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d3c64-15a3-4cec-896b-22bfd49afd3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:07.123041 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d3c64-15a3-4cec-896b-22bfd49afd3f admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:07.146229 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1210/2418] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:48:07 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:48:07.150847 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82967cf0-adc3-4724-bb71-7a02d691040e admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:07.162003 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82967cf0-adc3-4724-bb71-7a02d691040e admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:07.167516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26294961-d381-4604-a8ea-1184c73cdf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:07.168203 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26294961-d381-4604-a8ea-1184c73cdf46 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:07.168557 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26294961-d381-4604-a8ea-1184c73cdf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:07.168900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26294961-d381-4604-a8ea-1184c73cdf46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:07.170045 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26294961-d381-4604-a8ea-1184c73cdf46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:07.171750 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26294961-d381-4604-a8ea-1184c73cdf46 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:07.185120 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1209/2419] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:48:07.189108 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d3c64-15a3-4cec-896b-22bfd49afd3f admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:07.200409 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d3c64-15a3-4cec-896b-22bfd49afd3f admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:07.205000 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdafac8-2378-4f86-a3ea-241f19dc28b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:07.205639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdafac8-2378-4f86-a3ea-241f19dc28b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:07.205951 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdafac8-2378-4f86-a3ea-241f19dc28b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:07.206390 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdafac8-2378-4f86-a3ea-241f19dc28b4 admin admin] PATH_INFO: `/v3/projects/06c45dc5cc1a4495b1c50b182865b456/users/c8bf14807bb34556a139eb2251c7d8db/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:07.221515 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdafac8-2378-4f86-a3ea-241f19dc28b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c45dc5cc1a4495b1c50b182865b456, user_id=c8bf14807bb34556a139eb2251c7d8db, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:07.224319 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdafac8-2378-4f86-a3ea-241f19dc28b4 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:07.233787 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:07.240459 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1211/2420] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:48:07 2022] PUT /identity/v3/projects/06c45dc5cc1a4495b1c50b182865b456/users/c8bf14807bb34556a139eb2251c7d8db/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:07.244916 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26294961-d381-4604-a8ea-1184c73cdf46 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:07.255147 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26294961-d381-4604-a8ea-1184c73cdf46 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:07.312229 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad1747-4bfa-4131-b52d-a8c009741927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:07.312830 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad1747-4bfa-4131-b52d-a8c009741927 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:07.313109 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad1747-4bfa-4131-b52d-a8c009741927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:07.313379 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad1747-4bfa-4131-b52d-a8c009741927 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:07.314044 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad1747-4bfa-4131-b52d-a8c009741927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:07.315662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad1747-4bfa-4131-b52d-a8c009741927 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:07.325514 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1210/2421] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:48:07.329623 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdafac8-2378-4f86-a3ea-241f19dc28b4 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:07.340320 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdafac8-2378-4f86-a3ea-241f19dc28b4 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:07.344754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f4308-0cab-4b53-a798-d4c3bbe7280a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:07.345391 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f4308-0cab-4b53-a798-d4c3bbe7280a admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:07.345666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f4308-0cab-4b53-a798-d4c3bbe7280a admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:07.345968 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f4308-0cab-4b53-a798-d4c3bbe7280a admin admin] PATH_INFO: `/v3/projects/06c45dc5cc1a4495b1c50b182865b456/users/c8bf14807bb34556a139eb2251c7d8db/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:07.347825 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f4308-0cab-4b53-a798-d4c3bbe7280a admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c45dc5cc1a4495b1c50b182865b456, user_id=c8bf14807bb34556a139eb2251c7d8db, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:07.350487 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f4308-0cab-4b53-a798-d4c3bbe7280a admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:07.360879 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1212/2422] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:48:07 2022] PUT /identity/v3/projects/06c45dc5cc1a4495b1c50b182865b456/users/c8bf14807bb34556a139eb2251c7d8db/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:07.427077 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0bea5-72d2-48e1-b3f2-74c3623fa41a None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:07.427393 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0bea5-72d2-48e1-b3f2-74c3623fa41a None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:07.427670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0bea5-72d2-48e1-b3f2-74c3623fa41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:07.455763 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-92f0bea5-72d2-48e1-b3f2-74c3623fa41a None None] MFA Rules not processed for user `c8bf14807bb34556a139eb2251c7d8db`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:07.456903 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-92f0bea5-72d2-48e1-b3f2-74c3623fa41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:07.525955 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1211/2423] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:07.537413 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f4308-0cab-4b53-a798-d4c3bbe7280a admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:07.539699 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-663f4308-0cab-4b53-a798-d4c3bbe7280a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:07.594914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f4308-0cab-4b53-a798-d4c3bbe7280a admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:07.598495 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddc7eb-9687-460e-82f5-26529eb3c819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:07.599088 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddc7eb-9687-460e-82f5-26529eb3c819 service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:07.599364 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddc7eb-9687-460e-82f5-26529eb3c819 service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:07.599635 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddc7eb-9687-460e-82f5-26529eb3c819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:07.608905 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddc7eb-9687-460e-82f5-26529eb3c819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:07.610365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddc7eb-9687-460e-82f5-26529eb3c819 service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:07.619405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1213/2424] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:48:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:48:07.703170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0bea5-72d2-48e1-b3f2-74c3623fa41a None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:07.713458 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0bea5-72d2-48e1-b3f2-74c3623fa41a None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:07.717294 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86304d67-0109-40cf-8d0f-ae8df72b8ef7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:07.718028 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86304d67-0109-40cf-8d0f-ae8df72b8ef7 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:07.718316 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86304d67-0109-40cf-8d0f-ae8df72b8ef7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:07.718592 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86304d67-0109-40cf-8d0f-ae8df72b8ef7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:07.748118 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:07.777067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86304d67-0109-40cf-8d0f-ae8df72b8ef7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:07.778543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86304d67-0109-40cf-8d0f-ae8df72b8ef7 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:07.787616 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1212/2425] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:48:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:48:12.481978 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddc7eb-9687-460e-82f5-26529eb3c819 service cinder] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:12.542438 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddc7eb-9687-460e-82f5-26529eb3c819 service cinder] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:12.546886 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b37809-fa81-4454-b149-3f7dbdd39272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:12.547498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b37809-fa81-4454-b149-3f7dbdd39272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:12.547771 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b37809-fa81-4454-b149-3f7dbdd39272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:12.548038 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b37809-fa81-4454-b149-3f7dbdd39272 admin admin] PATH_INFO: `/v3/users/3900b27ada54425782b473221bb8ef01` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:12.549123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b37809-fa81-4454-b149-3f7dbdd39272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3900b27ada54425782b473221bb8ef01)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:12.551075 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b37809-fa81-4454-b149-3f7dbdd39272 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:12.596317 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b1b37809-fa81-4454-b149-3f7dbdd39272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3900b27ada54425782b473221bb8ef01'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:12.603564 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b1b37809-fa81-4454-b149-3f7dbdd39272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3900b27ada54425782b473221bb8ef01'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:12.615219 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b1b37809-fa81-4454-b149-3f7dbdd39272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3900b27ada54425782b473221bb8ef01'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:12.615871 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b1b37809-fa81-4454-b149-3f7dbdd39272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3900b27ada54425782b473221bb8ef01'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:12.623649 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-b1b37809-fa81-4454-b149-3f7dbdd39272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3900b27ada54425782b473221bb8ef01'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:12.629687 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1214/2426] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:48:12 2022] DELETE /identity/v3/users/3900b27ada54425782b473221bb8ef01 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:12.634513 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83a170-b22b-4476-b85d-77de5255ef72 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:12.634967 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83a170-b22b-4476-b85d-77de5255ef72 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:12.635082 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83a170-b22b-4476-b85d-77de5255ef72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:12.653948 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-bb83a170-b22b-4476-b85d-77de5255ef72 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:12.655133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-bb83a170-b22b-4476-b85d-77de5255ef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:12.715198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1213/2427] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:12.724944 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b37809-fa81-4454-b149-3f7dbdd39272 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:12.727132 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b1b37809-fa81-4454-b149-3f7dbdd39272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:12.736727 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:12.785542 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b37809-fa81-4454-b149-3f7dbdd39272 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:12.789667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4fd96-e1f0-4d4e-a288-bd6485107168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:12.790302 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4fd96-e1f0-4d4e-a288-bd6485107168 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:12.790574 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4fd96-e1f0-4d4e-a288-bd6485107168 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:12.790844 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4fd96-e1f0-4d4e-a288-bd6485107168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:12.799639 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4fd96-e1f0-4d4e-a288-bd6485107168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:12.801079 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4fd96-e1f0-4d4e-a288-bd6485107168 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:12.812256 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1215/2428] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:48:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:48:13.086842 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83a170-b22b-4476-b85d-77de5255ef72 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:13.088323 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-bb83a170-b22b-4476-b85d-77de5255ef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:13.100149 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83a170-b22b-4476-b85d-77de5255ef72 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:13.104788 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815043c-bd8e-47f9-86b1-15ab7128a19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:13.105499 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815043c-bd8e-47f9-86b1-15ab7128a19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:13.105834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815043c-bd8e-47f9-86b1-15ab7128a19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:13.106200 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815043c-bd8e-47f9-86b1-15ab7128a19d admin admin] PATH_INFO: `/v3/projects/d6f5fafe2c624ca8824a4e68d4f1afda` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:13.107401 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815043c-bd8e-47f9-86b1-15ab7128a19d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6f5fafe2c624ca8824a4e68d4f1afda)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:13.109295 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815043c-bd8e-47f9-86b1-15ab7128a19d admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:13.156159 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-5815043c-bd8e-47f9-86b1-15ab7128a19d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6f5fafe2c624ca8824a4e68d4f1afda', 'request_id': 'req-5815043c-bd8e-47f9-86b1-15ab7128a19d'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:13.163884 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-5815043c-bd8e-47f9-86b1-15ab7128a19d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6f5fafe2c624ca8824a4e68d4f1afda', 'request_id': 'req-5815043c-bd8e-47f9-86b1-15ab7128a19d'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:13.171158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-5815043c-bd8e-47f9-86b1-15ab7128a19d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6f5fafe2c624ca8824a4e68d4f1afda', 'request_id': 'req-5815043c-bd8e-47f9-86b1-15ab7128a19d'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:13.183838 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-5815043c-bd8e-47f9-86b1-15ab7128a19d admin admin] The token cache is being invalidate because project d6f5fafe2c624ca8824a4e68d4f1afda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:48:13.184131 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-5815043c-bd8e-47f9-86b1-15ab7128a19d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:13.184789 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-5815043c-bd8e-47f9-86b1-15ab7128a19d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:13.186366 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1214/2429] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:48:13 2022] DELETE /identity/v3/projects/d6f5fafe2c624ca8824a4e68d4f1afda => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:13.190458 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4fd96-e1f0-4d4e-a288-bd6485107168 service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:13.200852 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4fd96-e1f0-4d4e-a288-bd6485107168 service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:13.258388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afed4f-2f02-44f6-901c-063b7c646ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:13.258931 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afed4f-2f02-44f6-901c-063b7c646ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:13.259203 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afed4f-2f02-44f6-901c-063b7c646ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:13.259471 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afed4f-2f02-44f6-901c-063b7c646ac5 admin admin] PATH_INFO: `/v3/users/c8bf14807bb34556a139eb2251c7d8db` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:13.260627 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afed4f-2f02-44f6-901c-063b7c646ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8bf14807bb34556a139eb2251c7d8db)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:13.262567 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afed4f-2f02-44f6-901c-063b7c646ac5 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:13.309314 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-f9afed4f-2f02-44f6-901c-063b7c646ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8bf14807bb34556a139eb2251c7d8db'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:13.316303 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-f9afed4f-2f02-44f6-901c-063b7c646ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8bf14807bb34556a139eb2251c7d8db'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:13.328693 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-f9afed4f-2f02-44f6-901c-063b7c646ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8bf14807bb34556a139eb2251c7d8db'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:13.329355 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-f9afed4f-2f02-44f6-901c-063b7c646ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8bf14807bb34556a139eb2251c7d8db'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:13.337085 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-f9afed4f-2f02-44f6-901c-063b7c646ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8bf14807bb34556a139eb2251c7d8db'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:13.342940 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1216/2430] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:48:13 2022] DELETE /identity/v3/users/c8bf14807bb34556a139eb2251c7d8db => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:13.617472 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815043c-bd8e-47f9-86b1-15ab7128a19d admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:13.619036 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-5815043c-bd8e-47f9-86b1-15ab7128a19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:13.633979 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815043c-bd8e-47f9-86b1-15ab7128a19d admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:13.688921 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:13.698116 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ce7cd-2bfa-40f8-a578-e1adb878418d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:13.698962 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ce7cd-2bfa-40f8-a578-e1adb878418d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:13.699375 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ce7cd-2bfa-40f8-a578-e1adb878418d admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:13.699804 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ce7cd-2bfa-40f8-a578-e1adb878418d admin admin] PATH_INFO: `/v3/projects/06c45dc5cc1a4495b1c50b182865b456` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:13.701433 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ce7cd-2bfa-40f8-a578-e1adb878418d admin admin] RBAC: Authorizing `identity:delete_project(project_id=06c45dc5cc1a4495b1c50b182865b456)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:13.703659 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ce7cd-2bfa-40f8-a578-e1adb878418d admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:13.752435 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7e4ce7cd-2bfa-40f8-a578-e1adb878418d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06c45dc5cc1a4495b1c50b182865b456', 'request_id': 'req-7e4ce7cd-2bfa-40f8-a578-e1adb878418d'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:13.761355 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7e4ce7cd-2bfa-40f8-a578-e1adb878418d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06c45dc5cc1a4495b1c50b182865b456', 'request_id': 'req-7e4ce7cd-2bfa-40f8-a578-e1adb878418d'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:13.767451 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7e4ce7cd-2bfa-40f8-a578-e1adb878418d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06c45dc5cc1a4495b1c50b182865b456', 'request_id': 'req-7e4ce7cd-2bfa-40f8-a578-e1adb878418d'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:13.779987 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7e4ce7cd-2bfa-40f8-a578-e1adb878418d admin admin] The token cache is being invalidate because project 06c45dc5cc1a4495b1c50b182865b456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:48:13.780392 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7e4ce7cd-2bfa-40f8-a578-e1adb878418d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:13.781133 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7e4ce7cd-2bfa-40f8-a578-e1adb878418d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:13.782757 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1215/2431] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:48:13 2022] DELETE /identity/v3/projects/06c45dc5cc1a4495b1c50b182865b456 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:13.787692 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dc6ad-6620-472c-8c55-4429616b17a3 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:13.788210 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dc6ad-6620-472c-8c55-4429616b17a3 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:13.788310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dc6ad-6620-472c-8c55-4429616b17a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:13.807448 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-216dc6ad-6620-472c-8c55-4429616b17a3 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:13.808728 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-216dc6ad-6620-472c-8c55-4429616b17a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:13.836579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:13.872982 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1217/2432] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:13.880911 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd091865-de4c-41d3-a83d-aa7a9ccaaeff None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:13.881203 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd091865-de4c-41d3-a83d-aa7a9ccaaeff None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:13.881479 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd091865-de4c-41d3-a83d-aa7a9ccaaeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:13.903251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-dd091865-de4c-41d3-a83d-aa7a9ccaaeff None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:13.904456 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-dd091865-de4c-41d3-a83d-aa7a9ccaaeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:13.912337 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1216/2433] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:13.916596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dc6ad-6620-472c-8c55-4429616b17a3 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:13.926357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dc6ad-6620-472c-8c55-4429616b17a3 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:13.930950 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04166d-6392-49f1-b228-c2d0ced571a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:13.931544 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04166d-6392-49f1-b228-c2d0ced571a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:13.931824 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04166d-6392-49f1-b228-c2d0ced571a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:13.932095 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04166d-6392-49f1-b228-c2d0ced571a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:13.932734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04166d-6392-49f1-b228-c2d0ced571a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:48:13.933034 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04166d-6392-49f1-b228-c2d0ced571a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:13.934683 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04166d-6392-49f1-b228-c2d0ced571a1 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:13.946562 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1218/2434] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:48:13.950479 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd091865-de4c-41d3-a83d-aa7a9ccaaeff None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:13.961063 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd091865-de4c-41d3-a83d-aa7a9ccaaeff None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:13.965835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f17708-0f81-455e-b613-ae4415b5841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:13.966460 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f17708-0f81-455e-b613-ae4415b5841d admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:13.966738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f17708-0f81-455e-b613-ae4415b5841d admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:13.967009 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f17708-0f81-455e-b613-ae4415b5841d admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:13.967644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f17708-0f81-455e-b613-ae4415b5841d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:13.969556 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f17708-0f81-455e-b613-ae4415b5841d admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:13.996665 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1217/2435] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:48:13 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:48:14.000968 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04166d-6392-49f1-b228-c2d0ced571a1 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:14.011164 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04166d-6392-49f1-b228-c2d0ced571a1 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:14.066808 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7761d48-1762-487e-8860-83a5b6681e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:14.067411 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7761d48-1762-487e-8860-83a5b6681e7c admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:14.067689 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7761d48-1762-487e-8860-83a5b6681e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:14.067960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7761d48-1762-487e-8860-83a5b6681e7c admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:14.068591 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7761d48-1762-487e-8860-83a5b6681e7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:14.070593 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7761d48-1762-487e-8860-83a5b6681e7c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:14.091757 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1219/2436] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:48:14 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:48:14.095935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f17708-0f81-455e-b613-ae4415b5841d admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:14.106621 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f17708-0f81-455e-b613-ae4415b5841d admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:14.111740 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee06e3-e9cc-4d55-b459-4d1ea286648f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:14.112332 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee06e3-e9cc-4d55-b459-4d1ea286648f admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:14.112621 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee06e3-e9cc-4d55-b459-4d1ea286648f admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:14.113072 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee06e3-e9cc-4d55-b459-4d1ea286648f admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:14.113722 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee06e3-e9cc-4d55-b459-4d1ea286648f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:14.115356 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee06e3-e9cc-4d55-b459-4d1ea286648f admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:14.126020 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1218/2437] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:48:14.130368 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7761d48-1762-487e-8860-83a5b6681e7c admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:14.140234 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7761d48-1762-487e-8860-83a5b6681e7c admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:14.144789 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e6bd9-2e51-42f2-93d9-b400bb625bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:14.145383 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e6bd9-2e51-42f2-93d9-b400bb625bbe admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:14.145661 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e6bd9-2e51-42f2-93d9-b400bb625bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:14.145963 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e6bd9-2e51-42f2-93d9-b400bb625bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:14.146598 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e6bd9-2e51-42f2-93d9-b400bb625bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:14.148723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e6bd9-2e51-42f2-93d9-b400bb625bbe admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:14.159078 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1220/2438] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:48:14.163158 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee06e3-e9cc-4d55-b459-4d1ea286648f admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:14.173989 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee06e3-e9cc-4d55-b459-4d1ea286648f admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:14.179556 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d192b-cd3b-400b-884c-340a3a0f9bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:14.180334 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d192b-cd3b-400b-884c-340a3a0f9bbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:14.180639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d192b-cd3b-400b-884c-340a3a0f9bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:14.180913 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d192b-cd3b-400b-884c-340a3a0f9bbb admin admin] PATH_INFO: `/v3/projects/fd81f5385a8b40ef9c89c76133338967/users/e763c351fe67413ebc983740fddc036f/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:14.195876 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d192b-cd3b-400b-884c-340a3a0f9bbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd81f5385a8b40ef9c89c76133338967, user_id=e763c351fe67413ebc983740fddc036f, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:14.198647 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d192b-cd3b-400b-884c-340a3a0f9bbb admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:14.212214 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1219/2439] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:48:14 2022] PUT /identity/v3/projects/fd81f5385a8b40ef9c89c76133338967/users/e763c351fe67413ebc983740fddc036f/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:14.217051 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e4519-dfac-4adc-a68e-d766894e01cc None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:14.217339 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e4519-dfac-4adc-a68e-d766894e01cc None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:14.217611 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e4519-dfac-4adc-a68e-d766894e01cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:14.237085 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-ae7e4519-dfac-4adc-a68e-d766894e01cc None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:14.238320 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ae7e4519-dfac-4adc-a68e-d766894e01cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:14.297146 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1221/2440] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:14.306923 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d192b-cd3b-400b-884c-340a3a0f9bbb admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:14.308760 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d60d192b-cd3b-400b-884c-340a3a0f9bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:14.366851 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d192b-cd3b-400b-884c-340a3a0f9bbb admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:14.370479 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b589631-0d37-419c-9cea-e47a084fd9e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:14.372057 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b589631-0d37-419c-9cea-e47a084fd9e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:14.372479 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b589631-0d37-419c-9cea-e47a084fd9e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:14.373159 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b589631-0d37-419c-9cea-e47a084fd9e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:14.389892 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b589631-0d37-419c-9cea-e47a084fd9e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:14.391600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b589631-0d37-419c-9cea-e47a084fd9e9 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:14.401716 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1220/2441] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:48:15.019037 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d0262-b80c-401e-a899-279483edfa73 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:15.019576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d0262-b80c-401e-a899-279483edfa73 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:15.019576 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d0262-b80c-401e-a899-279483edfa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:15.047758 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-f62d0262-b80c-401e-a899-279483edfa73 None None] MFA Rules not processed for user `e763c351fe67413ebc983740fddc036f`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:15.048965 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-f62d0262-b80c-401e-a899-279483edfa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:15.074032 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:15.116574 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1222/2442] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:15.121705 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b589631-0d37-419c-9cea-e47a084fd9e9 service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:15.131487 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b589631-0d37-419c-9cea-e47a084fd9e9 service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:15.136685 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74a841-8160-425b-8e9b-487e50be5a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:15.137345 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74a841-8160-425b-8e9b-487e50be5a5e admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:15.137689 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74a841-8160-425b-8e9b-487e50be5a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:15.138054 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74a841-8160-425b-8e9b-487e50be5a5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:15.138749 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74a841-8160-425b-8e9b-487e50be5a5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:15.140710 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74a841-8160-425b-8e9b-487e50be5a5e admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:15.176793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1221/2443] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:48:15 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:48:15.178047 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d0262-b80c-401e-a899-279483edfa73 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:15.189616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d0262-b80c-401e-a899-279483edfa73 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:15.245157 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4884b-ce79-4482-bba9-7fdc8ebfa0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:15.245761 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4884b-ce79-4482-bba9-7fdc8ebfa0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:15.246074 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4884b-ce79-4482-bba9-7fdc8ebfa0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:15.246367 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4884b-ce79-4482-bba9-7fdc8ebfa0c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:15.246996 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4884b-ce79-4482-bba9-7fdc8ebfa0c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:15.248911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4884b-ce79-4482-bba9-7fdc8ebfa0c3 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:15.270897 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1223/2444] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:48:15 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:48:15.274903 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74a841-8160-425b-8e9b-487e50be5a5e admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:15.280263 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:15.287149 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74a841-8160-425b-8e9b-487e50be5a5e admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:15.293421 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcc8e3-4b3a-4914-a596-0ba9c231a6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:15.294073 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcc8e3-4b3a-4914-a596-0ba9c231a6dd admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:15.294364 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcc8e3-4b3a-4914-a596-0ba9c231a6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:15.294636 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcc8e3-4b3a-4914-a596-0ba9c231a6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:15.295280 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcc8e3-4b3a-4914-a596-0ba9c231a6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:15.296878 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcc8e3-4b3a-4914-a596-0ba9c231a6dd admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:15.308556 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1222/2445] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:48:15.312706 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4884b-ce79-4482-bba9-7fdc8ebfa0c3 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:15.322541 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4884b-ce79-4482-bba9-7fdc8ebfa0c3 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:15.327428 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c692bb5-eb03-4464-8af4-d38cb35afbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:15.328080 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c692bb5-eb03-4464-8af4-d38cb35afbfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:15.328358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c692bb5-eb03-4464-8af4-d38cb35afbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:15.328628 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c692bb5-eb03-4464-8af4-d38cb35afbfb admin admin] PATH_INFO: `/v3/projects/a7ceaefaafd34467a4611f4b1b15f731/users/fcc7f91beaec4c9ca7aca45c08b310ff/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:15.343124 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c692bb5-eb03-4464-8af4-d38cb35afbfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ceaefaafd34467a4611f4b1b15f731, user_id=fcc7f91beaec4c9ca7aca45c08b310ff, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:15.345762 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c692bb5-eb03-4464-8af4-d38cb35afbfb admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:15.358927 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1224/2446] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:48:15 2022] PUT /identity/v3/projects/a7ceaefaafd34467a4611f4b1b15f731/users/fcc7f91beaec4c9ca7aca45c08b310ff/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:15.362911 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcc8e3-4b3a-4914-a596-0ba9c231a6dd admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:15.373491 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcc8e3-4b3a-4914-a596-0ba9c231a6dd admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:15.429700 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d510e1b-6170-4c6a-8a47-85a70e767b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:15.430257 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d510e1b-6170-4c6a-8a47-85a70e767b9a admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:15.430559 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d510e1b-6170-4c6a-8a47-85a70e767b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:15.430827 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d510e1b-6170-4c6a-8a47-85a70e767b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:15.431450 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d510e1b-6170-4c6a-8a47-85a70e767b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:15.433027 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d510e1b-6170-4c6a-8a47-85a70e767b9a admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:15.442459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1223/2447] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:48:15.446805 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c692bb5-eb03-4464-8af4-d38cb35afbfb admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:15.456987 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c692bb5-eb03-4464-8af4-d38cb35afbfb admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:15.462614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55069937-0ad0-4477-b310-d3f727281198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:15.463265 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55069937-0ad0-4477-b310-d3f727281198 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:15.463545 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55069937-0ad0-4477-b310-d3f727281198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:15.463816 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55069937-0ad0-4477-b310-d3f727281198 admin admin] PATH_INFO: `/v3/projects/a7ceaefaafd34467a4611f4b1b15f731/users/fcc7f91beaec4c9ca7aca45c08b310ff/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:15.465731 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55069937-0ad0-4477-b310-d3f727281198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ceaefaafd34467a4611f4b1b15f731, user_id=fcc7f91beaec4c9ca7aca45c08b310ff, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:15.468398 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55069937-0ad0-4477-b310-d3f727281198 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:15.479401 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1225/2448] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:48:15 2022] PUT /identity/v3/projects/a7ceaefaafd34467a4611f4b1b15f731/users/fcc7f91beaec4c9ca7aca45c08b310ff/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:16.083485 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca62bc-0bbc-4547-8a2d-5c7c01accef7 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:16.083773 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca62bc-0bbc-4547-8a2d-5c7c01accef7 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:16.084050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca62bc-0bbc-4547-8a2d-5c7c01accef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:16.112952 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-c4ca62bc-0bbc-4547-8a2d-5c7c01accef7 None None] MFA Rules not processed for user `fcc7f91beaec4c9ca7aca45c08b310ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:16.114359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-c4ca62bc-0bbc-4547-8a2d-5c7c01accef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:16.197127 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1224/2449] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:16.207897 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385f014-f8aa-46f1-9dc2-c48a3b7fc3c2 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:16.208338 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385f014-f8aa-46f1-9dc2-c48a3b7fc3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:16.208880 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385f014-f8aa-46f1-9dc2-c48a3b7fc3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:16.229081 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-7385f014-f8aa-46f1-9dc2-c48a3b7fc3c2 None None] MFA Rules not processed for user `e763c351fe67413ebc983740fddc036f`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:16.230243 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-7385f014-f8aa-46f1-9dc2-c48a3b7fc3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:16.286427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1226/2450] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:16.311563 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca62bc-0bbc-4547-8a2d-5c7c01accef7 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:16.312950 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-c4ca62bc-0bbc-4547-8a2d-5c7c01accef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:16.385940 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca62bc-0bbc-4547-8a2d-5c7c01accef7 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:16.391369 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ff377-0203-4aa4-ba99-ee84bbb45338 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172b859c0d774c8f8a98ce23bdc237d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:16.391974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ff377-0203-4aa4-ba99-ee84bbb45338 service nova] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:16.392256 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ff377-0203-4aa4-ba99-ee84bbb45338 service nova] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:16.392523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ff377-0203-4aa4-ba99-ee84bbb45338 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:16.400816 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ff377-0203-4aa4-ba99-ee84bbb45338 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:16.402424 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ff377-0203-4aa4-ba99-ee84bbb45338 service nova] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:16.405832 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=100 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:16.412244 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1225/2451] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:48:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:48:16.636626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385f014-f8aa-46f1-9dc2-c48a3b7fc3c2 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:16.638095 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-7385f014-f8aa-46f1-9dc2-c48a3b7fc3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:16.664438 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:16.698612 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385f014-f8aa-46f1-9dc2-c48a3b7fc3c2 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:16.702153 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce3707-56ea-4a21-86a8-5d38488a3878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:16.702755 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce3707-56ea-4a21-86a8-5d38488a3878 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:16.703036 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce3707-56ea-4a21-86a8-5d38488a3878 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:16.703310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce3707-56ea-4a21-86a8-5d38488a3878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:16.705028 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-18ce3707-56ea-4a21-86a8-5d38488a3878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:16.715231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce3707-56ea-4a21-86a8-5d38488a3878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:16.716656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce3707-56ea-4a21-86a8-5d38488a3878 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:16.726257 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1227/2452] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:48:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:48:26.409736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:26.720973 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=16 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:26.881827 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ff377-0203-4aa4-ba99-ee84bbb45338 service nova] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:26.883506 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-cd3ff377-0203-4aa4-ba99-ee84bbb45338 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:26.937887 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ff377-0203-4aa4-ba99-ee84bbb45338 service nova] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:26.941412 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebf0ab-3245-4e71-a8d9-e114fbcadaf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:26.942026 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebf0ab-3245-4e71-a8d9-e114fbcadaf1 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:26.942302 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebf0ab-3245-4e71-a8d9-e114fbcadaf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:26.942570 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebf0ab-3245-4e71-a8d9-e114fbcadaf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:26.951129 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ebf0ab-3245-4e71-a8d9-e114fbcadaf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:26.952548 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ebf0ab-3245-4e71-a8d9-e114fbcadaf1 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:26.963663 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1226/2453] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:48:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:48:36.957625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=26 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:46.784018 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce3707-56ea-4a21-86a8-5d38488a3878 service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:46.847883 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce3707-56ea-4a21-86a8-5d38488a3878 service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:46.853143 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffabe3-4e81-4dd2-b7b8-a86ee5bd1ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:46.853763 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffabe3-4e81-4dd2-b7b8-a86ee5bd1ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:46.854075 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffabe3-4e81-4dd2-b7b8-a86ee5bd1ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:46.854347 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffabe3-4e81-4dd2-b7b8-a86ee5bd1ef9 admin admin] PATH_INFO: `/v3/users/e763c351fe67413ebc983740fddc036f` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:46.855462 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffabe3-4e81-4dd2-b7b8-a86ee5bd1ef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e763c351fe67413ebc983740fddc036f)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:46.857381 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffabe3-4e81-4dd2-b7b8-a86ee5bd1ef9 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:46.905002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-faffabe3-4e81-4dd2-b7b8-a86ee5bd1ef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e763c351fe67413ebc983740fddc036f'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:46.911794 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-faffabe3-4e81-4dd2-b7b8-a86ee5bd1ef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e763c351fe67413ebc983740fddc036f'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:46.924094 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-faffabe3-4e81-4dd2-b7b8-a86ee5bd1ef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e763c351fe67413ebc983740fddc036f'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:46.924759 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-faffabe3-4e81-4dd2-b7b8-a86ee5bd1ef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e763c351fe67413ebc983740fddc036f'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:46.933227 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-faffabe3-4e81-4dd2-b7b8-a86ee5bd1ef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e763c351fe67413ebc983740fddc036f'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:46.939907 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1228/2454] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:48:46 2022] DELETE /identity/v3/users/e763c351fe67413ebc983740fddc036f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:47.113987 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebf0ab-3245-4e71-a8d9-e114fbcadaf1 service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:47.126902 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebf0ab-3245-4e71-a8d9-e114fbcadaf1 service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:47.185783 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207a118-40f7-45d7-8412-f1988a2c1d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:47.186446 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207a118-40f7-45d7-8412-f1988a2c1d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:47.186734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207a118-40f7-45d7-8412-f1988a2c1d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:47.187010 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207a118-40f7-45d7-8412-f1988a2c1d3f admin admin] PATH_INFO: `/v3/projects/fd81f5385a8b40ef9c89c76133338967` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:47.188124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207a118-40f7-45d7-8412-f1988a2c1d3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd81f5385a8b40ef9c89c76133338967)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:47.190095 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207a118-40f7-45d7-8412-f1988a2c1d3f admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:47.235896 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-6207a118-40f7-45d7-8412-f1988a2c1d3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd81f5385a8b40ef9c89c76133338967', 'request_id': 'req-6207a118-40f7-45d7-8412-f1988a2c1d3f'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:47.243525 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-6207a118-40f7-45d7-8412-f1988a2c1d3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd81f5385a8b40ef9c89c76133338967', 'request_id': 'req-6207a118-40f7-45d7-8412-f1988a2c1d3f'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:47.249141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-6207a118-40f7-45d7-8412-f1988a2c1d3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd81f5385a8b40ef9c89c76133338967', 'request_id': 'req-6207a118-40f7-45d7-8412-f1988a2c1d3f'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:47.261449 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-6207a118-40f7-45d7-8412-f1988a2c1d3f admin admin] The token cache is being invalidate because project fd81f5385a8b40ef9c89c76133338967 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:48:47.261674 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-6207a118-40f7-45d7-8412-f1988a2c1d3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:47.262347 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-6207a118-40f7-45d7-8412-f1988a2c1d3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:47.264003 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1227/2455] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:48:47 2022] DELETE /identity/v3/projects/fd81f5385a8b40ef9c89c76133338967 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:47.268403 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffabe3-4e81-4dd2-b7b8-a86ee5bd1ef9 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:47.269820 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-faffabe3-4e81-4dd2-b7b8-a86ee5bd1ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:47.283042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffabe3-4e81-4dd2-b7b8-a86ee5bd1ef9 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:47.341078 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f64e4-03dc-4d49-ad5b-1f6149cda7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:47.341716 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f64e4-03dc-4d49-ad5b-1f6149cda7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:47.342036 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f64e4-03dc-4d49-ad5b-1f6149cda7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:47.342313 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f64e4-03dc-4d49-ad5b-1f6149cda7fe admin admin] PATH_INFO: `/v3/users/fcc7f91beaec4c9ca7aca45c08b310ff` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:47.343443 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f64e4-03dc-4d49-ad5b-1f6149cda7fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcc7f91beaec4c9ca7aca45c08b310ff)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:47.345363 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f64e4-03dc-4d49-ad5b-1f6149cda7fe admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:47.367596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:47.392013 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-cb2f64e4-03dc-4d49-ad5b-1f6149cda7fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcc7f91beaec4c9ca7aca45c08b310ff'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:47.398887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-cb2f64e4-03dc-4d49-ad5b-1f6149cda7fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcc7f91beaec4c9ca7aca45c08b310ff'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:47.411040 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-cb2f64e4-03dc-4d49-ad5b-1f6149cda7fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcc7f91beaec4c9ca7aca45c08b310ff'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:47.411726 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-cb2f64e4-03dc-4d49-ad5b-1f6149cda7fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcc7f91beaec4c9ca7aca45c08b310ff'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:47.419690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-cb2f64e4-03dc-4d49-ad5b-1f6149cda7fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcc7f91beaec4c9ca7aca45c08b310ff'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:47.425555 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1229/2456] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:48:47 2022] DELETE /identity/v3/users/fcc7f91beaec4c9ca7aca45c08b310ff => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:47.634761 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207a118-40f7-45d7-8412-f1988a2c1d3f admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:47.636416 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-6207a118-40f7-45d7-8412-f1988a2c1d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:47.654517 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207a118-40f7-45d7-8412-f1988a2c1d3f admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:47.720148 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ca72b-21ed-4627-b8cf-7ff7f047b16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:47.720823 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ca72b-21ed-4627-b8cf-7ff7f047b16b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:47.721108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ca72b-21ed-4627-b8cf-7ff7f047b16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:47.721389 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ca72b-21ed-4627-b8cf-7ff7f047b16b admin admin] PATH_INFO: `/v3/projects/a7ceaefaafd34467a4611f4b1b15f731` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:47.722559 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ca72b-21ed-4627-b8cf-7ff7f047b16b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7ceaefaafd34467a4611f4b1b15f731)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:47.724495 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ca72b-21ed-4627-b8cf-7ff7f047b16b admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:47.762525 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:47.777228 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-aa2ca72b-21ed-4627-b8cf-7ff7f047b16b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ceaefaafd34467a4611f4b1b15f731', 'request_id': 'req-aa2ca72b-21ed-4627-b8cf-7ff7f047b16b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:47.785289 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-aa2ca72b-21ed-4627-b8cf-7ff7f047b16b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ceaefaafd34467a4611f4b1b15f731', 'request_id': 'req-aa2ca72b-21ed-4627-b8cf-7ff7f047b16b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:47.792003 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-aa2ca72b-21ed-4627-b8cf-7ff7f047b16b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ceaefaafd34467a4611f4b1b15f731', 'request_id': 'req-aa2ca72b-21ed-4627-b8cf-7ff7f047b16b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:47.803519 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-aa2ca72b-21ed-4627-b8cf-7ff7f047b16b admin admin] The token cache is being invalidate because project a7ceaefaafd34467a4611f4b1b15f731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:48:47.803803 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-aa2ca72b-21ed-4627-b8cf-7ff7f047b16b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:47.804569 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-aa2ca72b-21ed-4627-b8cf-7ff7f047b16b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:47.806121 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1228/2457] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:48:47 2022] DELETE /identity/v3/projects/a7ceaefaafd34467a4611f4b1b15f731 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:47.810999 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dddcd1-6350-4d4d-92bc-a4e02f2f3b0f None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:47.811482 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dddcd1-6350-4d4d-92bc-a4e02f2f3b0f None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:47.811590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dddcd1-6350-4d4d-92bc-a4e02f2f3b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:47.830794 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-c6dddcd1-6350-4d4d-92bc-a4e02f2f3b0f None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:47.832003 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-c6dddcd1-6350-4d4d-92bc-a4e02f2f3b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:47.892334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1230/2458] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:47.901163 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117845b-81dd-43da-93bc-2379bda507e6 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:47.901766 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117845b-81dd-43da-93bc-2379bda507e6 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:47.902228 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117845b-81dd-43da-93bc-2379bda507e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:47.923169 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-1117845b-81dd-43da-93bc-2379bda507e6 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:47.924377 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-1117845b-81dd-43da-93bc-2379bda507e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:47.932414 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1229/2459] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:47.936730 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dddcd1-6350-4d4d-92bc-a4e02f2f3b0f None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:47.946970 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dddcd1-6350-4d4d-92bc-a4e02f2f3b0f None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:47.951550 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425dbe4c-55b2-4bcc-b9fd-fb1e23eaa401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:47.952153 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dbe4c-55b2-4bcc-b9fd-fb1e23eaa401 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:47.952433 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dbe4c-55b2-4bcc-b9fd-fb1e23eaa401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:47.952704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dbe4c-55b2-4bcc-b9fd-fb1e23eaa401 admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:47.953357 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425dbe4c-55b2-4bcc-b9fd-fb1e23eaa401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:48:47.953752 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425dbe4c-55b2-4bcc-b9fd-fb1e23eaa401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:47.955590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425dbe4c-55b2-4bcc-b9fd-fb1e23eaa401 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:47.969896 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1231/2460] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:48:47.974237 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117845b-81dd-43da-93bc-2379bda507e6 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:47.983888 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117845b-81dd-43da-93bc-2379bda507e6 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:47.988712 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7355b5-1dd9-4742-bad3-c808d668d721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:47.989304 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7355b5-1dd9-4742-bad3-c808d668d721 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:47.989577 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7355b5-1dd9-4742-bad3-c808d668d721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:47.989863 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7355b5-1dd9-4742-bad3-c808d668d721 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:47.990530 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7355b5-1dd9-4742-bad3-c808d668d721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:47.992587 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7355b5-1dd9-4742-bad3-c808d668d721 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:48.022493 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1230/2461] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:48:47 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:48:48.027266 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425dbe4c-55b2-4bcc-b9fd-fb1e23eaa401 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:48.037411 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425dbe4c-55b2-4bcc-b9fd-fb1e23eaa401 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:48.101213 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dfa6f-9cfa-4a08-915b-088801780d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:48.102036 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dfa6f-9cfa-4a08-915b-088801780d5a admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:48.102320 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dfa6f-9cfa-4a08-915b-088801780d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:48.102594 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dfa6f-9cfa-4a08-915b-088801780d5a admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:48.103225 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941dfa6f-9cfa-4a08-915b-088801780d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:48.105475 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941dfa6f-9cfa-4a08-915b-088801780d5a admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:48.134892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1232/2462] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:48:48 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:48:48.136161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7355b5-1dd9-4742-bad3-c808d668d721 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:48.146693 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7355b5-1dd9-4742-bad3-c808d668d721 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:48.152707 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c660f-a4ff-42f6-b9cf-15e1b36c54db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:48.153485 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c660f-a4ff-42f6-b9cf-15e1b36c54db admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:48.153806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c660f-a4ff-42f6-b9cf-15e1b36c54db admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:48.154114 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c660f-a4ff-42f6-b9cf-15e1b36c54db admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:48.154830 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c660f-a4ff-42f6-b9cf-15e1b36c54db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:48.156397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c660f-a4ff-42f6-b9cf-15e1b36c54db admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:48.172843 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1231/2463] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:48:48.176521 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dfa6f-9cfa-4a08-915b-088801780d5a admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:48.190358 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dfa6f-9cfa-4a08-915b-088801780d5a admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:48.196004 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac586338-5e92-476f-ae00-002e8513a95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:48.196618 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac586338-5e92-476f-ae00-002e8513a95c admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:48.196898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac586338-5e92-476f-ae00-002e8513a95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:48.197168 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac586338-5e92-476f-ae00-002e8513a95c admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:48.197807 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac586338-5e92-476f-ae00-002e8513a95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:48.199483 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac586338-5e92-476f-ae00-002e8513a95c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:48.213583 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1233/2464] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:48:48.217332 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c660f-a4ff-42f6-b9cf-15e1b36c54db admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:48.231522 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c660f-a4ff-42f6-b9cf-15e1b36c54db admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:48.236368 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef9f76-2a20-41b8-8fc1-8189a5de0c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:48.237016 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef9f76-2a20-41b8-8fc1-8189a5de0c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:48.237299 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef9f76-2a20-41b8-8fc1-8189a5de0c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:48.237583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef9f76-2a20-41b8-8fc1-8189a5de0c04 admin admin] PATH_INFO: `/v3/projects/0c2876e048504f8788e1af7628756046/users/d25809945fed43ba829baebe92bda0e0/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:48.252948 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef9f76-2a20-41b8-8fc1-8189a5de0c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c2876e048504f8788e1af7628756046, user_id=d25809945fed43ba829baebe92bda0e0, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:48.255615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef9f76-2a20-41b8-8fc1-8189a5de0c04 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:48.270084 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1232/2465] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:48:48 2022] PUT /identity/v3/projects/0c2876e048504f8788e1af7628756046/users/d25809945fed43ba829baebe92bda0e0/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:48:48.280491 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c64efa-ca95-4b76-b8ae-79b53a705e65 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:48.280780 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c64efa-ca95-4b76-b8ae-79b53a705e65 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:48.281055 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c64efa-ca95-4b76-b8ae-79b53a705e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:48.290202 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:48.324755 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-b7c64efa-ca95-4b76-b8ae-79b53a705e65 None None] MFA Rules not processed for user `d25809945fed43ba829baebe92bda0e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:48.326568 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-b7c64efa-ca95-4b76-b8ae-79b53a705e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:48.424220 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1234/2466] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:48.428549 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef9f76-2a20-41b8-8fc1-8189a5de0c04 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:48.504563 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef9f76-2a20-41b8-8fc1-8189a5de0c04 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:48.511085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad0089-1498-4bcf-a8af-4c3829258551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:48.511870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad0089-1498-4bcf-a8af-4c3829258551 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:48.512214 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad0089-1498-4bcf-a8af-4c3829258551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:48.512723 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad0089-1498-4bcf-a8af-4c3829258551 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:48.513927 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad0089-1498-4bcf-a8af-4c3829258551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:48.516049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad0089-1498-4bcf-a8af-4c3829258551 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:48.551191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1233/2467] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:48:48 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:48:48.555685 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c64efa-ca95-4b76-b8ae-79b53a705e65 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:48.572582 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c64efa-ca95-4b76-b8ae-79b53a705e65 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:48.651736 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64659e2-12fd-441f-82db-9f5be9270a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:48.652998 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64659e2-12fd-441f-82db-9f5be9270a08 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:48.653293 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64659e2-12fd-441f-82db-9f5be9270a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:48.653563 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64659e2-12fd-441f-82db-9f5be9270a08 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:48.654235 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64659e2-12fd-441f-82db-9f5be9270a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:48.656770 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64659e2-12fd-441f-82db-9f5be9270a08 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:48.681163 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1235/2468] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:48:48 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:48:48.685056 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad0089-1498-4bcf-a8af-4c3829258551 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:48.696625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad0089-1498-4bcf-a8af-4c3829258551 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:48.701240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2c3d1-9a1c-478f-8103-c14a44034566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:48.701976 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2c3d1-9a1c-478f-8103-c14a44034566 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:48.702395 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2c3d1-9a1c-478f-8103-c14a44034566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:48.702499 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2c3d1-9a1c-478f-8103-c14a44034566 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:48.703138 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2c3d1-9a1c-478f-8103-c14a44034566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:48.704765 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2c3d1-9a1c-478f-8103-c14a44034566 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:48.716139 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1234/2469] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:48:48.720077 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64659e2-12fd-441f-82db-9f5be9270a08 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:48.730487 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64659e2-12fd-441f-82db-9f5be9270a08 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:48.735033 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a4556-c255-44dd-b2d5-0cfb80cbc8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:48.735628 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a4556-c255-44dd-b2d5-0cfb80cbc8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:48.735911 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a4556-c255-44dd-b2d5-0cfb80cbc8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:48.736178 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a4556-c255-44dd-b2d5-0cfb80cbc8b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:48.736816 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a4556-c255-44dd-b2d5-0cfb80cbc8b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:48.738601 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a4556-c255-44dd-b2d5-0cfb80cbc8b3 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:48.750071 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1236/2470] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:48:48.754624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2c3d1-9a1c-478f-8103-c14a44034566 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:48.765099 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2c3d1-9a1c-478f-8103-c14a44034566 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:48.769678 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ed536-27d7-4d94-a444-9f4aa0e057b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:48.770366 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ed536-27d7-4d94-a444-9f4aa0e057b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:48.770642 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ed536-27d7-4d94-a444-9f4aa0e057b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:48.770909 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ed536-27d7-4d94-a444-9f4aa0e057b9 admin admin] PATH_INFO: `/v3/projects/ac58c567995747c08b7f7b155ec59e29/users/0d61de7c993548c09c6d8295a3af6d3d/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:48.786511 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ed536-27d7-4d94-a444-9f4aa0e057b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac58c567995747c08b7f7b155ec59e29, user_id=0d61de7c993548c09c6d8295a3af6d3d, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:48.789870 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ed536-27d7-4d94-a444-9f4aa0e057b9 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:48.804545 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1235/2471] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:48:48 2022] PUT /identity/v3/projects/ac58c567995747c08b7f7b155ec59e29/users/0d61de7c993548c09c6d8295a3af6d3d/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:48:48.815734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe648b-9b23-44ca-98c5-6227764a5b12 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:48.816617 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe648b-9b23-44ca-98c5-6227764a5b12 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:48.816892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe648b-9b23-44ca-98c5-6227764a5b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:48.845302 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-7bbe648b-9b23-44ca-98c5-6227764a5b12 None None] MFA Rules not processed for user `0d61de7c993548c09c6d8295a3af6d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:48.846543 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-7bbe648b-9b23-44ca-98c5-6227764a5b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:48.914013 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1237/2472] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:48.917581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ed536-27d7-4d94-a444-9f4aa0e057b9 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:48.926434 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:48.993348 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ed536-27d7-4d94-a444-9f4aa0e057b9 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:48.998242 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89bf2b-5e3b-4462-ab4f-2dfca5f1dd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:48.998957 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89bf2b-5e3b-4462-ab4f-2dfca5f1dd23 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:48.999311 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89bf2b-5e3b-4462-ab4f-2dfca5f1dd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:48.999658 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89bf2b-5e3b-4462-ab4f-2dfca5f1dd23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:49.000306 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89bf2b-5e3b-4462-ab4f-2dfca5f1dd23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:49.002612 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89bf2b-5e3b-4462-ab4f-2dfca5f1dd23 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:49.037960 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1236/2473] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:48:48 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:48:49.040635 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe648b-9b23-44ca-98c5-6227764a5b12 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:49.046523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:49.053301 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe648b-9b23-44ca-98c5-6227764a5b12 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:49.129297 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d624b-61cc-4e8b-8af8-34a6be6f9ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:49.130084 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d624b-61cc-4e8b-8af8-34a6be6f9ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:49.130361 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d624b-61cc-4e8b-8af8-34a6be6f9ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:49.130626 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d624b-61cc-4e8b-8af8-34a6be6f9ff2 admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:49.131278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d624b-61cc-4e8b-8af8-34a6be6f9ff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:49.133897 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d624b-61cc-4e8b-8af8-34a6be6f9ff2 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:49.156085 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1238/2474] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:48:49 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:48:49.160093 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89bf2b-5e3b-4462-ab4f-2dfca5f1dd23 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:49.171217 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89bf2b-5e3b-4462-ab4f-2dfca5f1dd23 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:49.175977 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f8914-b06c-4250-901c-5ce48cd66e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:49.176593 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f8914-b06c-4250-901c-5ce48cd66e8c admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:49.176872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f8914-b06c-4250-901c-5ce48cd66e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:49.177141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f8914-b06c-4250-901c-5ce48cd66e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:49.177786 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f8914-b06c-4250-901c-5ce48cd66e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:49.179945 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f8914-b06c-4250-901c-5ce48cd66e8c admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:49.191955 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1237/2475] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:48:49.196183 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d624b-61cc-4e8b-8af8-34a6be6f9ff2 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:49.206697 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d624b-61cc-4e8b-8af8-34a6be6f9ff2 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:49.212942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602d574-1abd-43fc-9519-935c6addaef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:49.213613 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602d574-1abd-43fc-9519-935c6addaef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:49.213921 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602d574-1abd-43fc-9519-935c6addaef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:49.214197 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602d574-1abd-43fc-9519-935c6addaef6 admin admin] PATH_INFO: `/v3/projects/9b22baf451574309bb3fc6f4d32bf63a/users/0ab648c213d5458987966da1d02c11ed/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:49.229897 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602d574-1abd-43fc-9519-935c6addaef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b22baf451574309bb3fc6f4d32bf63a, user_id=0ab648c213d5458987966da1d02c11ed, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:49.232630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602d574-1abd-43fc-9519-935c6addaef6 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:49.248924 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1239/2476] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:48:49 2022] PUT /identity/v3/projects/9b22baf451574309bb3fc6f4d32bf63a/users/0ab648c213d5458987966da1d02c11ed/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:49.253000 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f8914-b06c-4250-901c-5ce48cd66e8c admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:49.265655 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f8914-b06c-4250-901c-5ce48cd66e8c admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:49.343282 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae999e2-bf11-43b5-a6a7-9427ac1fe8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:49.343898 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae999e2-bf11-43b5-a6a7-9427ac1fe8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:49.344176 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae999e2-bf11-43b5-a6a7-9427ac1fe8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:49.344442 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae999e2-bf11-43b5-a6a7-9427ac1fe8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:49.345079 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae999e2-bf11-43b5-a6a7-9427ac1fe8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:49.346919 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae999e2-bf11-43b5-a6a7-9427ac1fe8a9 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:49.361196 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1238/2477] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:48:49.362388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602d574-1abd-43fc-9519-935c6addaef6 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:49.375214 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602d574-1abd-43fc-9519-935c6addaef6 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:49.380125 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c207cf-e63b-45bc-8bc2-1bc0c6f4b88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:49.380787 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c207cf-e63b-45bc-8bc2-1bc0c6f4b88f admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:49.381062 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c207cf-e63b-45bc-8bc2-1bc0c6f4b88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:49.381335 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c207cf-e63b-45bc-8bc2-1bc0c6f4b88f admin admin] PATH_INFO: `/v3/projects/9b22baf451574309bb3fc6f4d32bf63a/users/0ab648c213d5458987966da1d02c11ed/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:49.383512 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c207cf-e63b-45bc-8bc2-1bc0c6f4b88f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b22baf451574309bb3fc6f4d32bf63a, user_id=0ab648c213d5458987966da1d02c11ed, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:49.386241 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c207cf-e63b-45bc-8bc2-1bc0c6f4b88f admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:49.399042 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1240/2478] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:48:49 2022] PUT /identity/v3/projects/9b22baf451574309bb3fc6f4d32bf63a/users/0ab648c213d5458987966da1d02c11ed/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:48:49.409648 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b6fe5-bb47-4ef3-8667-feefd76a63b1 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:49.409967 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b6fe5-bb47-4ef3-8667-feefd76a63b1 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:49.410229 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b6fe5-bb47-4ef3-8667-feefd76a63b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:49.452330 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-329b6fe5-bb47-4ef3-8667-feefd76a63b1 None None] MFA Rules not processed for user `0ab648c213d5458987966da1d02c11ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:49.453543 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-329b6fe5-bb47-4ef3-8667-feefd76a63b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:49.530937 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1239/2479] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:49.542485 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c207cf-e63b-45bc-8bc2-1bc0c6f4b88f admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:49.544145 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-02c207cf-e63b-45bc-8bc2-1bc0c6f4b88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:49.603564 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c207cf-e63b-45bc-8bc2-1bc0c6f4b88f admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:49.607234 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096dce0-7439-47fb-b1e8-413ed797c066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:49.608159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096dce0-7439-47fb-b1e8-413ed797c066 service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:49.608159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096dce0-7439-47fb-b1e8-413ed797c066 service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:49.608374 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096dce0-7439-47fb-b1e8-413ed797c066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:49.666667 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096dce0-7439-47fb-b1e8-413ed797c066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:49.668300 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096dce0-7439-47fb-b1e8-413ed797c066 service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:49.677334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1241/2480] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:48:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:48:51.194140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b6fe5-bb47-4ef3-8667-feefd76a63b1 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:51.195787 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-329b6fe5-bb47-4ef3-8667-feefd76a63b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:51.202865 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:51.208237 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b6fe5-bb47-4ef3-8667-feefd76a63b1 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:51.214062 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35ec5b-fa88-4125-9241-ced569a69c43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:51.214848 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35ec5b-fa88-4125-9241-ced569a69c43 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:51.215130 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35ec5b-fa88-4125-9241-ced569a69c43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:51.215400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35ec5b-fa88-4125-9241-ced569a69c43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:51.273694 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35ec5b-fa88-4125-9241-ced569a69c43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:51.275193 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35ec5b-fa88-4125-9241-ced569a69c43 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:51.284717 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1240/2481] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:48:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:48:51.479231 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822216c-45bf-46a1-ba73-6eb690d2bab5 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:51.479879 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822216c-45bf-46a1-ba73-6eb690d2bab5 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:51.479879 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822216c-45bf-46a1-ba73-6eb690d2bab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:51.501588 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-d822216c-45bf-46a1-ba73-6eb690d2bab5 None None] MFA Rules not processed for user `b38de7c21009499291ba1db0fd295a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:51.502834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-d822216c-45bf-46a1-ba73-6eb690d2bab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:51.507174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:51.562910 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1242/2482] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:51.834835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35ec5b-fa88-4125-9241-ced569a69c43 service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:51.843366 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35ec5b-fa88-4125-9241-ced569a69c43 service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:51.846916 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193e9f6-a34c-4f69-b2bb-9a3674ff1916 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:51.847529 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193e9f6-a34c-4f69-b2bb-9a3674ff1916 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:51.847791 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193e9f6-a34c-4f69-b2bb-9a3674ff1916 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:51.848061 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193e9f6-a34c-4f69-b2bb-9a3674ff1916 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:51.858225 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193e9f6-a34c-4f69-b2bb-9a3674ff1916 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:51.859664 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193e9f6-a34c-4f69-b2bb-9a3674ff1916 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:51.869351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1241/2483] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:48:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:48:55.816451 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822216c-45bf-46a1-ba73-6eb690d2bab5 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:55.877529 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822216c-45bf-46a1-ba73-6eb690d2bab5 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:55.883225 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9d303-b331-4eed-ac84-2e4e39161551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:55.883847 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9d303-b331-4eed-ac84-2e4e39161551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:55.884121 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9d303-b331-4eed-ac84-2e4e39161551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:55.884388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9d303-b331-4eed-ac84-2e4e39161551 admin admin] PATH_INFO: `/v3/users/d25809945fed43ba829baebe92bda0e0` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:55.885469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9d303-b331-4eed-ac84-2e4e39161551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d25809945fed43ba829baebe92bda0e0)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:55.887418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9d303-b331-4eed-ac84-2e4e39161551 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:55.932341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e9c9d303-b331-4eed-ac84-2e4e39161551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd25809945fed43ba829baebe92bda0e0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:55.939427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e9c9d303-b331-4eed-ac84-2e4e39161551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd25809945fed43ba829baebe92bda0e0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:55.951585 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e9c9d303-b331-4eed-ac84-2e4e39161551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd25809945fed43ba829baebe92bda0e0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:55.952246 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e9c9d303-b331-4eed-ac84-2e4e39161551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd25809945fed43ba829baebe92bda0e0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:55.959348 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-e9c9d303-b331-4eed-ac84-2e4e39161551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd25809945fed43ba829baebe92bda0e0'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:55.965409 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1243/2484] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:48:55 2022] DELETE /identity/v3/users/d25809945fed43ba829baebe92bda0e0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:55.969961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c4b2e-99e3-433a-b7cb-1cc344724918 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:55.970411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c4b2e-99e3-433a-b7cb-1cc344724918 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:55.970560 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c4b2e-99e3-433a-b7cb-1cc344724918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:55.989442 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-804c4b2e-99e3-433a-b7cb-1cc344724918 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:48:55.991205 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-804c4b2e-99e3-433a-b7cb-1cc344724918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:56.049681 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1242/2485] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:48:56.059939 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9d303-b331-4eed-ac84-2e4e39161551 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:56.061365 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e9c9d303-b331-4eed-ac84-2e4e39161551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:56.096262 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:56.119876 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9d303-b331-4eed-ac84-2e4e39161551 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:56.123497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957015d-7179-47b7-bb54-0f4bbf8c20c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:56.124101 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957015d-7179-47b7-bb54-0f4bbf8c20c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:56.124376 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957015d-7179-47b7-bb54-0f4bbf8c20c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:56.124666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957015d-7179-47b7-bb54-0f4bbf8c20c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:56.134378 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957015d-7179-47b7-bb54-0f4bbf8c20c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:56.135749 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957015d-7179-47b7-bb54-0f4bbf8c20c4 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:56.144947 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1244/2486] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:48:56.510625 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c4b2e-99e3-433a-b7cb-1cc344724918 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:56.512335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-804c4b2e-99e3-433a-b7cb-1cc344724918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:56.530704 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c4b2e-99e3-433a-b7cb-1cc344724918 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:56.537127 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bf303-5a6d-41be-a358-94e87962e775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:56.538323 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bf303-5a6d-41be-a358-94e87962e775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:56.538793 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bf303-5a6d-41be-a358-94e87962e775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:56.539385 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bf303-5a6d-41be-a358-94e87962e775 admin admin] PATH_INFO: `/v3/projects/0c2876e048504f8788e1af7628756046` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:56.541654 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bf303-5a6d-41be-a358-94e87962e775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c2876e048504f8788e1af7628756046)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:56.544832 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bf303-5a6d-41be-a358-94e87962e775 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:56.592502 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7f0bf303-5a6d-41be-a358-94e87962e775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c2876e048504f8788e1af7628756046', 'request_id': 'req-7f0bf303-5a6d-41be-a358-94e87962e775'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:56.600919 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7f0bf303-5a6d-41be-a358-94e87962e775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c2876e048504f8788e1af7628756046', 'request_id': 'req-7f0bf303-5a6d-41be-a358-94e87962e775'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:56.607093 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7f0bf303-5a6d-41be-a358-94e87962e775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c2876e048504f8788e1af7628756046', 'request_id': 'req-7f0bf303-5a6d-41be-a358-94e87962e775'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:56.619661 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7f0bf303-5a6d-41be-a358-94e87962e775 admin admin] The token cache is being invalidate because project 0c2876e048504f8788e1af7628756046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:48:56.619949 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7f0bf303-5a6d-41be-a358-94e87962e775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:56.620592 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-7f0bf303-5a6d-41be-a358-94e87962e775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:56.622134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1243/2487] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:48:56 2022] DELETE /identity/v3/projects/0c2876e048504f8788e1af7628756046 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:56.626344 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957015d-7179-47b7-bb54-0f4bbf8c20c4 service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:56.636653 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957015d-7179-47b7-bb54-0f4bbf8c20c4 service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:56.695827 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4409a3-4872-41a4-a419-813f87edc63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:56.696463 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4409a3-4872-41a4-a419-813f87edc63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:56.696741 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4409a3-4872-41a4-a419-813f87edc63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:56.697022 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4409a3-4872-41a4-a419-813f87edc63f admin admin] PATH_INFO: `/v3/users/0d61de7c993548c09c6d8295a3af6d3d` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:56.698176 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4409a3-4872-41a4-a419-813f87edc63f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d61de7c993548c09c6d8295a3af6d3d)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:56.700124 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4409a3-4872-41a4-a419-813f87edc63f admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:56.746765 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-ef4409a3-4872-41a4-a419-813f87edc63f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d61de7c993548c09c6d8295a3af6d3d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:56.754077 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-ef4409a3-4872-41a4-a419-813f87edc63f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d61de7c993548c09c6d8295a3af6d3d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:56.768381 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-ef4409a3-4872-41a4-a419-813f87edc63f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d61de7c993548c09c6d8295a3af6d3d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:56.769133 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-ef4409a3-4872-41a4-a419-813f87edc63f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d61de7c993548c09c6d8295a3af6d3d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:56.777584 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-ef4409a3-4872-41a4-a419-813f87edc63f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d61de7c993548c09c6d8295a3af6d3d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:56.783872 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1245/2488] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:48:56 2022] DELETE /identity/v3/users/0d61de7c993548c09c6d8295a3af6d3d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:57.146571 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bf303-5a6d-41be-a358-94e87962e775 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:57.148834 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-7f0bf303-5a6d-41be-a358-94e87962e775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:57.171749 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bf303-5a6d-41be-a358-94e87962e775 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:57.188515 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:57.243592 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6084eb3-e8d0-485d-a572-d8cf6c138946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:57.244219 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6084eb3-e8d0-485d-a572-d8cf6c138946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:57.244497 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6084eb3-e8d0-485d-a572-d8cf6c138946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:57.244767 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6084eb3-e8d0-485d-a572-d8cf6c138946 admin admin] PATH_INFO: `/v3/projects/ac58c567995747c08b7f7b155ec59e29` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:57.245873 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6084eb3-e8d0-485d-a572-d8cf6c138946 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac58c567995747c08b7f7b155ec59e29)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:57.247787 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6084eb3-e8d0-485d-a572-d8cf6c138946 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:57.292100 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-f6084eb3-e8d0-485d-a572-d8cf6c138946 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac58c567995747c08b7f7b155ec59e29', 'request_id': 'req-f6084eb3-e8d0-485d-a572-d8cf6c138946'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:57.298368 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-f6084eb3-e8d0-485d-a572-d8cf6c138946 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac58c567995747c08b7f7b155ec59e29', 'request_id': 'req-f6084eb3-e8d0-485d-a572-d8cf6c138946'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:57.306180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-f6084eb3-e8d0-485d-a572-d8cf6c138946 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac58c567995747c08b7f7b155ec59e29', 'request_id': 'req-f6084eb3-e8d0-485d-a572-d8cf6c138946'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:57.319500 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-f6084eb3-e8d0-485d-a572-d8cf6c138946 admin admin] The token cache is being invalidate because project ac58c567995747c08b7f7b155ec59e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:48:57.319818 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-f6084eb3-e8d0-485d-a572-d8cf6c138946 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:57.320451 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-f6084eb3-e8d0-485d-a572-d8cf6c138946 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:57.321951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1244/2489] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:48:57 2022] DELETE /identity/v3/projects/ac58c567995747c08b7f7b155ec59e29 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:57.326143 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4409a3-4872-41a4-a419-813f87edc63f admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:57.327566 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ef4409a3-4872-41a4-a419-813f87edc63f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:57.340325 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4409a3-4872-41a4-a419-813f87edc63f admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:57.390912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:57.400055 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf1a7a-b3fb-4240-b18f-f074ac55507e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:57.400699 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf1a7a-b3fb-4240-b18f-f074ac55507e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:57.401466 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf1a7a-b3fb-4240-b18f-f074ac55507e admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:57.401659 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf1a7a-b3fb-4240-b18f-f074ac55507e admin admin] PATH_INFO: `/v3/users/0ab648c213d5458987966da1d02c11ed` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:57.403196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf1a7a-b3fb-4240-b18f-f074ac55507e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab648c213d5458987966da1d02c11ed)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:57.405572 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf1a7a-b3fb-4240-b18f-f074ac55507e admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:57.454029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-6daf1a7a-b3fb-4240-b18f-f074ac55507e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab648c213d5458987966da1d02c11ed'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:57.462173 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-6daf1a7a-b3fb-4240-b18f-f074ac55507e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab648c213d5458987966da1d02c11ed'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:57.474268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-6daf1a7a-b3fb-4240-b18f-f074ac55507e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab648c213d5458987966da1d02c11ed'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:57.475967 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-6daf1a7a-b3fb-4240-b18f-f074ac55507e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab648c213d5458987966da1d02c11ed'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:57.483478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-6daf1a7a-b3fb-4240-b18f-f074ac55507e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab648c213d5458987966da1d02c11ed'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:57.489502 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1246/2490] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:48:57 2022] DELETE /identity/v3/users/0ab648c213d5458987966da1d02c11ed => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:48:57.758953 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6084eb3-e8d0-485d-a572-d8cf6c138946 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:48:57.760495 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-f6084eb3-e8d0-485d-a572-d8cf6c138946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:48:57.774035 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6084eb3-e8d0-485d-a572-d8cf6c138946 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:48:57.830002 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a121d-babf-47ec-ae99-83ff28cbde06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:48:57.830624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a121d-babf-47ec-ae99-83ff28cbde06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:48:57.830901 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a121d-babf-47ec-ae99-83ff28cbde06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:48:57.831171 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a121d-babf-47ec-ae99-83ff28cbde06 admin admin] PATH_INFO: `/v3/projects/9b22baf451574309bb3fc6f4d32bf63a` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:48:57.832283 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a121d-babf-47ec-ae99-83ff28cbde06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b22baf451574309bb3fc6f4d32bf63a)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:48:57.834202 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a121d-babf-47ec-ae99-83ff28cbde06 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:48:57.875013 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:57.880118 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d21a121d-babf-47ec-ae99-83ff28cbde06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b22baf451574309bb3fc6f4d32bf63a', 'request_id': 'req-d21a121d-babf-47ec-ae99-83ff28cbde06'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:57.887726 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d21a121d-babf-47ec-ae99-83ff28cbde06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b22baf451574309bb3fc6f4d32bf63a', 'request_id': 'req-d21a121d-babf-47ec-ae99-83ff28cbde06'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:57.893190 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d21a121d-babf-47ec-ae99-83ff28cbde06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b22baf451574309bb3fc6f4d32bf63a', 'request_id': 'req-d21a121d-babf-47ec-ae99-83ff28cbde06'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:57.904452 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d21a121d-babf-47ec-ae99-83ff28cbde06 admin admin] The token cache is being invalidate because project 9b22baf451574309bb3fc6f4d32bf63a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:48:57.904736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d21a121d-babf-47ec-ae99-83ff28cbde06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:57.905359 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-d21a121d-babf-47ec-ae99-83ff28cbde06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:48:57.906835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1245/2491] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:48:57 2022] DELETE /identity/v3/projects/9b22baf451574309bb3fc6f4d32bf63a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:49:07.486100 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=28,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:49:07.901575 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=8,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:49:09.049552 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf1a7a-b3fb-4240-b18f-f074ac55507e admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:49:09.051002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-6daf1a7a-b3fb-4240-b18f-f074ac55507e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:49:09.187899 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf1a7a-b3fb-4240-b18f-f074ac55507e admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:49:09.247362 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c453a-d264-49f0-919e-5af6f0603595 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e94a60e43914cf38a5f2f88b182083f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:49:09.247895 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c453a-d264-49f0-919e-5af6f0603595 service placement] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:49:09.248204 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c453a-d264-49f0-919e-5af6f0603595 service placement] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:49:09.248484 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c453a-d264-49f0-919e-5af6f0603595 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:49:09.250218 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-ab3c453a-d264-49f0-919e-5af6f0603595 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:49:09.262246 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c453a-d264-49f0-919e-5af6f0603595 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:49:09.263828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c453a-d264-49f0-919e-5af6f0603595 service placement] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:49:09.273682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1247/2492] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:49:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:49:19.269448 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:49:48.475692 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e72885-ff71-4d5a-bb0d-3c227ee96228 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:49:48.476215 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e72885-ff71-4d5a-bb0d-3c227ee96228 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:49:48.476215 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e72885-ff71-4d5a-bb0d-3c227ee96228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:49:48.495542 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-b4e72885-ff71-4d5a-bb0d-3c227ee96228 None None] MFA Rules not processed for user `b38de7c21009499291ba1db0fd295a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:49:48.496746 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-b4e72885-ff71-4d5a-bb0d-3c227ee96228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:49:48.551214 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1246/2493] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:49:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:49:52.681739 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e19f92-353c-4483-b9e1-17c773820835 None None] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:49:52.682355 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e19f92-353c-4483-b9e1-17c773820835 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:49:52.682355 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e19f92-353c-4483-b9e1-17c773820835 None None] PATH_INFO: `/` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:49:52.683688 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1248/2494] 10.222.0.17 () {54 vars in 921 bytes} [Thu Oct 20 14:49:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:49:52.691513 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8cd2f-75bd-4a89-86df-c84bc7a480d4 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:49:52.692055 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8cd2f-75bd-4a89-86df-c84bc7a480d4 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:49:52.692055 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8cd2f-75bd-4a89-86df-c84bc7a480d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:49:52.745327 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-d2e8cd2f-75bd-4a89-86df-c84bc7a480d4 None None] MFA Rules not processed for user `359e9d904b0d43acae86337c1eb6a71d`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:49:52.746816 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d2e8cd2f-75bd-4a89-86df-c84bc7a480d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:49:52.812450 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1247/2495] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Oct 20 14:49:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:49:52.824835 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e19f92-353c-4483-b9e1-17c773820835 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:49:52.826569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-d1e19f92-353c-4483-b9e1-17c773820835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:49:52.842645 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e19f92-353c-4483-b9e1-17c773820835 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:49:52.846270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368faa4-1d5f-414b-8d24-a8e1f82aa64b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:49:52.847020 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368faa4-1d5f-414b-8d24-a8e1f82aa64b service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:49:52.847296 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368faa4-1d5f-414b-8d24-a8e1f82aa64b service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:49:52.847570 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368faa4-1d5f-414b-8d24-a8e1f82aa64b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:49:52.855364 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368faa4-1d5f-414b-8d24-a8e1f82aa64b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:49:52.857035 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368faa4-1d5f-414b-8d24-a8e1f82aa64b service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:49:52.866055 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1249/2496] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:49:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:49:52.953898 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9f257-db03-41a1-98d1-a0426c02c677 None None] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:49:52.954432 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9f257-db03-41a1-98d1-a0426c02c677 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:49:52.954810 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9f257-db03-41a1-98d1-a0426c02c677 None None] PATH_INFO: `/` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:49:52.956892 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1248/2497] 10.222.0.17 () {54 vars in 921 bytes} [Thu Oct 20 14:49:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 14:49:52.962465 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2c46c-ee9c-42b3-b520-d3cf393f9a6b None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:49:52.962749 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2c46c-ee9c-42b3-b520-d3cf393f9a6b None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:49:52.963025 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2c46c-ee9c-42b3-b520-d3cf393f9a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:49:52.999458 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-d2b2c46c-ee9c-42b3-b520-d3cf393f9a6b None None] MFA Rules not processed for user `172b859c0d774c8f8a98ce23bdc237d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:49:53.000677 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-d2b2c46c-ee9c-42b3-b520-d3cf393f9a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:49:53.100425 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1250/2498] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Oct 20 14:49:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:49:53.112469 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9f257-db03-41a1-98d1-a0426c02c677 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:49:53.123890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9f257-db03-41a1-98d1-a0426c02c677 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:49:53.127495 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74082917-7d55-41f2-ae87-5cc6baf4b367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:49:53.128401 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74082917-7d55-41f2-ae87-5cc6baf4b367 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:49:53.128687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74082917-7d55-41f2-ae87-5cc6baf4b367 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:49:53.129264 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74082917-7d55-41f2-ae87-5cc6baf4b367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:49:53.139581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74082917-7d55-41f2-ae87-5cc6baf4b367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:49:53.141022 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74082917-7d55-41f2-ae87-5cc6baf4b367 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:49:53.152674 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1249/2499] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:49:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 14:50:03.097254 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=49 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:03.148006 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=71 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:53.676797 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2c46c-ee9c-42b3-b520-d3cf393f9a6b None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:53.678044 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-d2b2c46c-ee9c-42b3-b520-d3cf393f9a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:50:53.696701 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2c46c-ee9c-42b3-b520-d3cf393f9a6b None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:53.701956 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca882c-b87d-4db0-9aba-220ae3ddfd38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e94a60e43914cf38a5f2f88b182083f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:53.703156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca882c-b87d-4db0-9aba-220ae3ddfd38 service placement] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:53.703156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca882c-b87d-4db0-9aba-220ae3ddfd38 service placement] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:53.703156 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca882c-b87d-4db0-9aba-220ae3ddfd38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:53.705404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-3cca882c-b87d-4db0-9aba-220ae3ddfd38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:50:53.719073 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca882c-b87d-4db0-9aba-220ae3ddfd38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:53.721327 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca882c-b87d-4db0-9aba-220ae3ddfd38 service placement] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:53.742037 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1251/2500] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:50:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:50:53.743552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74082917-7d55-41f2-ae87-5cc6baf4b367 service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:53.745079 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-74082917-7d55-41f2-ae87-5cc6baf4b367 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:50:53.853080 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74082917-7d55-41f2-ae87-5cc6baf4b367 service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:53.857583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f21724-e386-4f00-9d93-a013ca431255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:53.858779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f21724-e386-4f00-9d93-a013ca431255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:53.859124 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f21724-e386-4f00-9d93-a013ca431255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:53.859397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f21724-e386-4f00-9d93-a013ca431255 admin admin] PATH_INFO: `/v3/users/b38de7c21009499291ba1db0fd295a7b` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:53.860516 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f21724-e386-4f00-9d93-a013ca431255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b38de7c21009499291ba1db0fd295a7b)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:53.862463 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f21724-e386-4f00-9d93-a013ca431255 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:53.911488 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-70f21724-e386-4f00-9d93-a013ca431255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b38de7c21009499291ba1db0fd295a7b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:53.918205 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-70f21724-e386-4f00-9d93-a013ca431255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b38de7c21009499291ba1db0fd295a7b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:53.918861 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-70f21724-e386-4f00-9d93-a013ca431255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b38de7c21009499291ba1db0fd295a7b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:53.919487 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-70f21724-e386-4f00-9d93-a013ca431255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b38de7c21009499291ba1db0fd295a7b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:53.927980 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-70f21724-e386-4f00-9d93-a013ca431255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b38de7c21009499291ba1db0fd295a7b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:53.950137 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1250/2501] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:50:53 2022] DELETE /identity/v3/users/b38de7c21009499291ba1db0fd295a7b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:50:54.128060 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca882c-b87d-4db0-9aba-220ae3ddfd38 service placement] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:54.138640 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca882c-b87d-4db0-9aba-220ae3ddfd38 service placement] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:54.201370 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07955c87-46ce-475b-9151-4b10361c3112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:54.202123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07955c87-46ce-475b-9151-4b10361c3112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:54.202400 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07955c87-46ce-475b-9151-4b10361c3112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:54.202672 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07955c87-46ce-475b-9151-4b10361c3112 admin admin] PATH_INFO: `/v3/projects/cc62c491cd614c13af3d9fa30a32aa9d` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:54.203767 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07955c87-46ce-475b-9151-4b10361c3112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc62c491cd614c13af3d9fa30a32aa9d)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:54.205670 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07955c87-46ce-475b-9151-4b10361c3112 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:54.252218 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-07955c87-46ce-475b-9151-4b10361c3112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc62c491cd614c13af3d9fa30a32aa9d', 'request_id': 'req-07955c87-46ce-475b-9151-4b10361c3112'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:54.257570 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-07955c87-46ce-475b-9151-4b10361c3112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc62c491cd614c13af3d9fa30a32aa9d', 'request_id': 'req-07955c87-46ce-475b-9151-4b10361c3112'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:54.264942 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-07955c87-46ce-475b-9151-4b10361c3112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc62c491cd614c13af3d9fa30a32aa9d', 'request_id': 'req-07955c87-46ce-475b-9151-4b10361c3112'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:54.276925 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-07955c87-46ce-475b-9151-4b10361c3112 admin admin] The token cache is being invalidate because project cc62c491cd614c13af3d9fa30a32aa9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:50:54.277158 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-07955c87-46ce-475b-9151-4b10361c3112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:54.277791 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-07955c87-46ce-475b-9151-4b10361c3112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:54.279294 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1252/2502] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:50:54 2022] DELETE /identity/v3/projects/cc62c491cd614c13af3d9fa30a32aa9d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:50:54.284646 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6cbaf-c008-4db1-b44b-66819e9ae525 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:54.284933 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6cbaf-c008-4db1-b44b-66819e9ae525 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:54.285207 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6cbaf-c008-4db1-b44b-66819e9ae525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:54.332729 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-e5b6cbaf-c008-4db1-b44b-66819e9ae525 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:50:54.334011 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e5b6cbaf-c008-4db1-b44b-66819e9ae525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:50:54.359005 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:54.395938 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1251/2503] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:50:54.403541 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08214a-913f-4de2-8650-edfe22a8245a None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:54.403866 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08214a-913f-4de2-8650-edfe22a8245a None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:54.404144 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08214a-913f-4de2-8650-edfe22a8245a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:54.423895 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-fc08214a-913f-4de2-8650-edfe22a8245a None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:50:54.425110 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-fc08214a-913f-4de2-8650-edfe22a8245a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:50:54.433033 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1253/2504] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:50:54.437634 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6cbaf-c008-4db1-b44b-66819e9ae525 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:54.447180 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6cbaf-c008-4db1-b44b-66819e9ae525 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:54.451739 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d33ad-a53f-4fb3-8301-a7e93fc3a83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:54.452419 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d33ad-a53f-4fb3-8301-a7e93fc3a83d admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:54.452694 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d33ad-a53f-4fb3-8301-a7e93fc3a83d admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:54.452963 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d33ad-a53f-4fb3-8301-a7e93fc3a83d admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:54.453602 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d33ad-a53f-4fb3-8301-a7e93fc3a83d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:50:54.453930 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d33ad-a53f-4fb3-8301-a7e93fc3a83d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:54.455509 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d33ad-a53f-4fb3-8301-a7e93fc3a83d admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:54.466660 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1252/2505] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 14:50:54.470696 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08214a-913f-4de2-8650-edfe22a8245a None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:54.479868 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08214a-913f-4de2-8650-edfe22a8245a None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:54.485629 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75d0dc-9a5a-4c59-90a4-ecd200bd95c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:54.486266 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75d0dc-9a5a-4c59-90a4-ecd200bd95c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:54.486548 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75d0dc-9a5a-4c59-90a4-ecd200bd95c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:54.486818 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75d0dc-9a5a-4c59-90a4-ecd200bd95c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:54.487461 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75d0dc-9a5a-4c59-90a4-ecd200bd95c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:54.489393 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75d0dc-9a5a-4c59-90a4-ecd200bd95c9 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:54.518158 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1254/2506] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:50:54 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:50:54.522218 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d33ad-a53f-4fb3-8301-a7e93fc3a83d admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:54.532757 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d33ad-a53f-4fb3-8301-a7e93fc3a83d admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:54.587651 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71388c16-9a62-4391-a088-cf998fd80641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:54.588360 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71388c16-9a62-4391-a088-cf998fd80641 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:54.588643 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71388c16-9a62-4391-a088-cf998fd80641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:54.588915 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71388c16-9a62-4391-a088-cf998fd80641 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:54.589554 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71388c16-9a62-4391-a088-cf998fd80641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:54.591481 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71388c16-9a62-4391-a088-cf998fd80641 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:54.613370 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1253/2507] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:50:54 2022] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:50:54.617421 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75d0dc-9a5a-4c59-90a4-ecd200bd95c9 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:54.628438 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75d0dc-9a5a-4c59-90a4-ecd200bd95c9 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:54.632987 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcdfd5-e00b-4267-8ace-00d4fd327020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:54.633575 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcdfd5-e00b-4267-8ace-00d4fd327020 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:54.633865 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcdfd5-e00b-4267-8ace-00d4fd327020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:54.634147 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcdfd5-e00b-4267-8ace-00d4fd327020 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:54.634774 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcdfd5-e00b-4267-8ace-00d4fd327020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:54.636388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcdfd5-e00b-4267-8ace-00d4fd327020 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:54.645971 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1255/2508] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:50:54.649774 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71388c16-9a62-4391-a088-cf998fd80641 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:54.659375 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71388c16-9a62-4391-a088-cf998fd80641 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:54.663862 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e17da-ba2f-4675-85e0-d6a4a88a94ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:54.664444 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e17da-ba2f-4675-85e0-d6a4a88a94ec admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:54.664719 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e17da-ba2f-4675-85e0-d6a4a88a94ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:54.664985 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e17da-ba2f-4675-85e0-d6a4a88a94ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:54.665615 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e17da-ba2f-4675-85e0-d6a4a88a94ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:54.667213 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e17da-ba2f-4675-85e0-d6a4a88a94ec admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:54.678157 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1254/2509] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:50:54.682151 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcdfd5-e00b-4267-8ace-00d4fd327020 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:54.692368 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcdfd5-e00b-4267-8ace-00d4fd327020 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:54.696883 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9de58-5b47-4f71-b77c-12187fb54c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:54.697516 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9de58-5b47-4f71-b77c-12187fb54c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:54.697793 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9de58-5b47-4f71-b77c-12187fb54c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:54.698094 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9de58-5b47-4f71-b77c-12187fb54c4c admin admin] PATH_INFO: `/v3/projects/897af8755b74435dacfbd6acc994b54b/users/7647861316bb422696f3b6d1714e7eda/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:54.713453 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9de58-5b47-4f71-b77c-12187fb54c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=897af8755b74435dacfbd6acc994b54b, user_id=7647861316bb422696f3b6d1714e7eda, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:54.716149 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9de58-5b47-4f71-b77c-12187fb54c4c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:54.730723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1256/2510] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:50:54 2022] PUT /identity/v3/projects/897af8755b74435dacfbd6acc994b54b/users/7647861316bb422696f3b6d1714e7eda/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:50:54.736407 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7e6e3-d961-409a-bfa9-3162a8ecdad5 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:54.736691 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7e6e3-d961-409a-bfa9-3162a8ecdad5 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:54.736968 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7e6e3-d961-409a-bfa9-3162a8ecdad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:54.757146 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-2dc7e6e3-d961-409a-bfa9-3162a8ecdad5 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:50:54.758377 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-2dc7e6e3-d961-409a-bfa9-3162a8ecdad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:50:54.817182 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1255/2511] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:50:54.826830 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9de58-5b47-4f71-b77c-12187fb54c4c admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:54.828548 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-21c9de58-5b47-4f71-b77c-12187fb54c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:50:54.843451 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:54.887395 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9de58-5b47-4f71-b77c-12187fb54c4c admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:54.891067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89339b94-8490-4b40-ab6a-c841a0b4fee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:54.891661 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89339b94-8490-4b40-ab6a-c841a0b4fee3 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:54.891940 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89339b94-8490-4b40-ab6a-c841a0b4fee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:54.892202 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89339b94-8490-4b40-ab6a-c841a0b4fee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:54.900932 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89339b94-8490-4b40-ab6a-c841a0b4fee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:54.902386 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89339b94-8490-4b40-ab6a-c841a0b4fee3 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:54.912213 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1257/2512] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:50:55.515837 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b59955-2377-475f-8ad5-442397f29d4a None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:55.516125 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b59955-2377-475f-8ad5-442397f29d4a None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:55.516398 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b59955-2377-475f-8ad5-442397f29d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:55.545943 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-33b59955-2377-475f-8ad5-442397f29d4a None None] MFA Rules not processed for user `7647861316bb422696f3b6d1714e7eda`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:50:55.547332 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-33b59955-2377-475f-8ad5-442397f29d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:50:55.571097 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:55.613201 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1256/2513] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:50:55 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:50:55.617779 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89339b94-8490-4b40-ab6a-c841a0b4fee3 service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:55.627648 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89339b94-8490-4b40-ab6a-c841a0b4fee3 service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:55.632153 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e250e2-fe10-4297-87cc-2ce8cc56a134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:55.632746 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e250e2-fe10-4297-87cc-2ce8cc56a134 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:55.633029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e250e2-fe10-4297-87cc-2ce8cc56a134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:55.633309 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e250e2-fe10-4297-87cc-2ce8cc56a134 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:55.633974 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e250e2-fe10-4297-87cc-2ce8cc56a134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:55.635900 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e250e2-fe10-4297-87cc-2ce8cc56a134 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:55.667320 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1258/2514] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:50:55 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:50:55.668167 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b59955-2377-475f-8ad5-442397f29d4a None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:55.679104 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b59955-2377-475f-8ad5-442397f29d4a None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:55.736951 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78765050-7d9e-4b76-880f-c89f2d9e905c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:55.737669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78765050-7d9e-4b76-880f-c89f2d9e905c admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:55.737986 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78765050-7d9e-4b76-880f-c89f2d9e905c admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:55.739177 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78765050-7d9e-4b76-880f-c89f2d9e905c admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:55.739931 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78765050-7d9e-4b76-880f-c89f2d9e905c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:55.741859 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78765050-7d9e-4b76-880f-c89f2d9e905c admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:55.766440 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1257/2515] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:50:55 2022] POST /identity/v3/users => generated 309 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:50:55.768397 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e250e2-fe10-4297-87cc-2ce8cc56a134 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:55.778772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e250e2-fe10-4297-87cc-2ce8cc56a134 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:55.783905 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd712356-862c-4ff8-b413-1d1c4ac551be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:55.784497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd712356-862c-4ff8-b413-1d1c4ac551be admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:55.784779 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd712356-862c-4ff8-b413-1d1c4ac551be admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:55.785052 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd712356-862c-4ff8-b413-1d1c4ac551be admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:55.785690 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd712356-862c-4ff8-b413-1d1c4ac551be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:55.787339 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd712356-862c-4ff8-b413-1d1c4ac551be admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:55.798783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1259/2516] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:50:55.802808 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78765050-7d9e-4b76-880f-c89f2d9e905c admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:55.812865 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78765050-7d9e-4b76-880f-c89f2d9e905c admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:55.817467 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd058237-7990-4edd-9218-cd2ebed44efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:55.818144 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd058237-7990-4edd-9218-cd2ebed44efe admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:55.818457 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd058237-7990-4edd-9218-cd2ebed44efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:55.818734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd058237-7990-4edd-9218-cd2ebed44efe admin admin] PATH_INFO: `/v3/projects/809d1242fb1d4d9ab3d33f6b3656390c/users/c5f05d2db19e4166817f457ea2a79456/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:55.833459 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd058237-7990-4edd-9218-cd2ebed44efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=809d1242fb1d4d9ab3d33f6b3656390c, user_id=c5f05d2db19e4166817f457ea2a79456, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:55.836208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd058237-7990-4edd-9218-cd2ebed44efe admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:55.849108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1258/2517] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:50:55 2022] PUT /identity/v3/projects/809d1242fb1d4d9ab3d33f6b3656390c/users/c5f05d2db19e4166817f457ea2a79456/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:50:55.853164 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd712356-862c-4ff8-b413-1d1c4ac551be admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:55.863919 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd712356-862c-4ff8-b413-1d1c4ac551be admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:55.919178 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33fc5b-37c1-43f9-80e6-26b1ea8b29b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:55.919703 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33fc5b-37c1-43f9-80e6-26b1ea8b29b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:55.919978 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33fc5b-37c1-43f9-80e6-26b1ea8b29b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:55.920384 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33fc5b-37c1-43f9-80e6-26b1ea8b29b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:55.921055 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33fc5b-37c1-43f9-80e6-26b1ea8b29b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:55.922672 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33fc5b-37c1-43f9-80e6-26b1ea8b29b9 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:55.931971 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1260/2518] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:50:55.936134 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd058237-7990-4edd-9218-cd2ebed44efe admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:55.946626 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd058237-7990-4edd-9218-cd2ebed44efe admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:55.951106 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf6b13-5b37-4bae-849e-29bb1bc7fda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:55.952404 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf6b13-5b37-4bae-849e-29bb1bc7fda5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:55.952680 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf6b13-5b37-4bae-849e-29bb1bc7fda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:55.952949 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf6b13-5b37-4bae-849e-29bb1bc7fda5 admin admin] PATH_INFO: `/v3/projects/809d1242fb1d4d9ab3d33f6b3656390c/users/c5f05d2db19e4166817f457ea2a79456/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:55.955035 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf6b13-5b37-4bae-849e-29bb1bc7fda5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809d1242fb1d4d9ab3d33f6b3656390c, user_id=c5f05d2db19e4166817f457ea2a79456, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:55.957648 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf6b13-5b37-4bae-849e-29bb1bc7fda5 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:55.968228 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1259/2519] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:50:55 2022] PUT /identity/v3/projects/809d1242fb1d4d9ab3d33f6b3656390c/users/c5f05d2db19e4166817f457ea2a79456/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:50:56.596329 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd265e0-bfa7-406c-b3e6-6f8c42a6d7e1 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:56.596621 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd265e0-bfa7-406c-b3e6-6f8c42a6d7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:56.596937 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd265e0-bfa7-406c-b3e6-6f8c42a6d7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:56.625907 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-7cd265e0-bfa7-406c-b3e6-6f8c42a6d7e1 None None] MFA Rules not processed for user `c5f05d2db19e4166817f457ea2a79456`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:50:56.627138 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-7cd265e0-bfa7-406c-b3e6-6f8c42a6d7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:50:56.699947 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1261/2520] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:50:56 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:50:57.702898 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf6b13-5b37-4bae-849e-29bb1bc7fda5 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:57.769419 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf6b13-5b37-4bae-849e-29bb1bc7fda5 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:57.773908 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66600c26-109b-42e1-989d-c2a8b11e96bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:57.774529 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66600c26-109b-42e1-989d-c2a8b11e96bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:57.774805 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66600c26-109b-42e1-989d-c2a8b11e96bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:57.775072 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66600c26-109b-42e1-989d-c2a8b11e96bd admin admin] PATH_INFO: `/v3/users/7647861316bb422696f3b6d1714e7eda` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:57.776170 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66600c26-109b-42e1-989d-c2a8b11e96bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7647861316bb422696f3b6d1714e7eda)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:57.778128 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66600c26-109b-42e1-989d-c2a8b11e96bd admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:57.799303 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:57.825141 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-66600c26-109b-42e1-989d-c2a8b11e96bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7647861316bb422696f3b6d1714e7eda'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:57.832733 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-66600c26-109b-42e1-989d-c2a8b11e96bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7647861316bb422696f3b6d1714e7eda'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:57.833392 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-66600c26-109b-42e1-989d-c2a8b11e96bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7647861316bb422696f3b6d1714e7eda'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:57.834025 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-66600c26-109b-42e1-989d-c2a8b11e96bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7647861316bb422696f3b6d1714e7eda'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:57.841088 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-66600c26-109b-42e1-989d-c2a8b11e96bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7647861316bb422696f3b6d1714e7eda'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:57.858229 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1260/2521] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:50:57 2022] DELETE /identity/v3/users/7647861316bb422696f3b6d1714e7eda => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:50:58.023898 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd265e0-bfa7-406c-b3e6-6f8c42a6d7e1 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:58.031472 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:58.036766 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd265e0-bfa7-406c-b3e6-6f8c42a6d7e1 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:58.096174 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc5bd8-af9e-4b5e-bd87-69fec88b0546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:58.096739 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc5bd8-af9e-4b5e-bd87-69fec88b0546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:58.097043 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc5bd8-af9e-4b5e-bd87-69fec88b0546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:58.097302 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc5bd8-af9e-4b5e-bd87-69fec88b0546 admin admin] PATH_INFO: `/v3/projects/897af8755b74435dacfbd6acc994b54b` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:58.098425 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc5bd8-af9e-4b5e-bd87-69fec88b0546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=897af8755b74435dacfbd6acc994b54b)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:58.100338 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc5bd8-af9e-4b5e-bd87-69fec88b0546 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:58.147579 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-acfc5bd8-af9e-4b5e-bd87-69fec88b0546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '897af8755b74435dacfbd6acc994b54b', 'request_id': 'req-acfc5bd8-af9e-4b5e-bd87-69fec88b0546'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:58.153238 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-acfc5bd8-af9e-4b5e-bd87-69fec88b0546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '897af8755b74435dacfbd6acc994b54b', 'request_id': 'req-acfc5bd8-af9e-4b5e-bd87-69fec88b0546'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:58.161294 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-acfc5bd8-af9e-4b5e-bd87-69fec88b0546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '897af8755b74435dacfbd6acc994b54b', 'request_id': 'req-acfc5bd8-af9e-4b5e-bd87-69fec88b0546'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:58.172574 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-acfc5bd8-af9e-4b5e-bd87-69fec88b0546 admin admin] The token cache is being invalidate because project 897af8755b74435dacfbd6acc994b54b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:50:58.172878 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-acfc5bd8-af9e-4b5e-bd87-69fec88b0546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:58.173531 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-acfc5bd8-af9e-4b5e-bd87-69fec88b0546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:58.175024 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1262/2522] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:50:58 2022] DELETE /identity/v3/projects/897af8755b74435dacfbd6acc994b54b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:50:58.179010 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66600c26-109b-42e1-989d-c2a8b11e96bd admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:58.180686 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-66600c26-109b-42e1-989d-c2a8b11e96bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:50:58.193171 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66600c26-109b-42e1-989d-c2a8b11e96bd admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:58.249197 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3ccd9-ba33-449d-855b-ef0d7bdd4b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:58.249820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3ccd9-ba33-449d-855b-ef0d7bdd4b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:58.250122 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3ccd9-ba33-449d-855b-ef0d7bdd4b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:58.250416 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3ccd9-ba33-449d-855b-ef0d7bdd4b66 admin admin] PATH_INFO: `/v3/users/c5f05d2db19e4166817f457ea2a79456` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:58.251523 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3ccd9-ba33-449d-855b-ef0d7bdd4b66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f05d2db19e4166817f457ea2a79456)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:58.253466 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3ccd9-ba33-449d-855b-ef0d7bdd4b66 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:58.298914 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-39a3ccd9-ba33-449d-855b-ef0d7bdd4b66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f05d2db19e4166817f457ea2a79456'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:58.305632 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-39a3ccd9-ba33-449d-855b-ef0d7bdd4b66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f05d2db19e4166817f457ea2a79456'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:58.306317 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-39a3ccd9-ba33-449d-855b-ef0d7bdd4b66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f05d2db19e4166817f457ea2a79456'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:58.306922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-39a3ccd9-ba33-449d-855b-ef0d7bdd4b66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f05d2db19e4166817f457ea2a79456'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:58.314132 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-39a3ccd9-ba33-449d-855b-ef0d7bdd4b66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f05d2db19e4166817f457ea2a79456'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:58.331784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1261/2523] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:50:58 2022] DELETE /identity/v3/users/c5f05d2db19e4166817f457ea2a79456 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:50:58.501703 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc5bd8-af9e-4b5e-bd87-69fec88b0546 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:58.503202 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-acfc5bd8-af9e-4b5e-bd87-69fec88b0546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:50:58.516830 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc5bd8-af9e-4b5e-bd87-69fec88b0546 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:58.573788 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe55945-d2fd-4dd9-a8b5-e24c27120e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:58.574450 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe55945-d2fd-4dd9-a8b5-e24c27120e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:58.574730 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe55945-d2fd-4dd9-a8b5-e24c27120e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:58.575002 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe55945-d2fd-4dd9-a8b5-e24c27120e2d admin admin] PATH_INFO: `/v3/projects/809d1242fb1d4d9ab3d33f6b3656390c` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:58.576114 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe55945-d2fd-4dd9-a8b5-e24c27120e2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=809d1242fb1d4d9ab3d33f6b3656390c)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:58.578985 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe55945-d2fd-4dd9-a8b5-e24c27120e2d admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:58.615288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:58.626268 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8fe55945-d2fd-4dd9-a8b5-e24c27120e2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809d1242fb1d4d9ab3d33f6b3656390c', 'request_id': 'req-8fe55945-d2fd-4dd9-a8b5-e24c27120e2d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:58.631805 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8fe55945-d2fd-4dd9-a8b5-e24c27120e2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809d1242fb1d4d9ab3d33f6b3656390c', 'request_id': 'req-8fe55945-d2fd-4dd9-a8b5-e24c27120e2d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:58.638430 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8fe55945-d2fd-4dd9-a8b5-e24c27120e2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809d1242fb1d4d9ab3d33f6b3656390c', 'request_id': 'req-8fe55945-d2fd-4dd9-a8b5-e24c27120e2d'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:58.649654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8fe55945-d2fd-4dd9-a8b5-e24c27120e2d admin admin] The token cache is being invalidate because project 809d1242fb1d4d9ab3d33f6b3656390c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:50:58.649978 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8fe55945-d2fd-4dd9-a8b5-e24c27120e2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:58.650600 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-8fe55945-d2fd-4dd9-a8b5-e24c27120e2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:50:58.652046 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1263/2524] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:50:58 2022] DELETE /identity/v3/projects/809d1242fb1d4d9ab3d33f6b3656390c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:50:58.657541 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2472fca-60a9-4687-907e-b6425e50ef4f None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:58.657829 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2472fca-60a9-4687-907e-b6425e50ef4f None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:58.658129 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2472fca-60a9-4687-907e-b6425e50ef4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:58.677424 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-d2472fca-60a9-4687-907e-b6425e50ef4f None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:50:58.678650 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-d2472fca-60a9-4687-907e-b6425e50ef4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:50:58.688468 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:58.739440 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1262/2525] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:50:58.747430 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f7109-17f1-4999-be08-385217e3f69c None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:58.747723 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f7109-17f1-4999-be08-385217e3f69c None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:58.748504 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f7109-17f1-4999-be08-385217e3f69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:58.769224 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-267f7109-17f1-4999-be08-385217e3f69c None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:50:58.770454 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-267f7109-17f1-4999-be08-385217e3f69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:50:58.778350 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1264/2526] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:50:58.782511 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2472fca-60a9-4687-907e-b6425e50ef4f None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:58.791975 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2472fca-60a9-4687-907e-b6425e50ef4f None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:58.796731 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd399bd-bb29-4bcd-8dc6-70a3e0ef661f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:58.797330 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd399bd-bb29-4bcd-8dc6-70a3e0ef661f admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:58.797630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd399bd-bb29-4bcd-8dc6-70a3e0ef661f admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:58.797933 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd399bd-bb29-4bcd-8dc6-70a3e0ef661f admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:58.798581 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd399bd-bb29-4bcd-8dc6-70a3e0ef661f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:50:58.798879 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd399bd-bb29-4bcd-8dc6-70a3e0ef661f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:58.800503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd399bd-bb29-4bcd-8dc6-70a3e0ef661f admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:58.812502 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1263/2527] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:50:58.816387 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f7109-17f1-4999-be08-385217e3f69c None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:58.825461 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f7109-17f1-4999-be08-385217e3f69c None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:58.830697 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f4963-41c8-4bb3-8a97-4251af12380f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:58.831284 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f4963-41c8-4bb3-8a97-4251af12380f admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:58.831558 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f4963-41c8-4bb3-8a97-4251af12380f admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:58.831828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f4963-41c8-4bb3-8a97-4251af12380f admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:58.832454 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f4963-41c8-4bb3-8a97-4251af12380f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:58.834376 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f4963-41c8-4bb3-8a97-4251af12380f admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:58.871709 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1265/2528] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:50:58 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:50:58.876039 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd399bd-bb29-4bcd-8dc6-70a3e0ef661f admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:58.885810 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd399bd-bb29-4bcd-8dc6-70a3e0ef661f admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:58.941122 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fedf7-8b4f-44ce-b189-8aca917fb06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:58.941727 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fedf7-8b4f-44ce-b189-8aca917fb06a admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:58.942045 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fedf7-8b4f-44ce-b189-8aca917fb06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:58.942322 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fedf7-8b4f-44ce-b189-8aca917fb06a admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:58.942982 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4fedf7-8b4f-44ce-b189-8aca917fb06a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:58.944898 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4fedf7-8b4f-44ce-b189-8aca917fb06a admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:58.965580 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1264/2529] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:50:58 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:50:58.970415 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f4963-41c8-4bb3-8a97-4251af12380f admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:58.981374 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f4963-41c8-4bb3-8a97-4251af12380f admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:58.986427 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f15a3e-c7d5-4e4c-8e82-69207f6f6d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:58.987028 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f15a3e-c7d5-4e4c-8e82-69207f6f6d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:58.987308 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f15a3e-c7d5-4e4c-8e82-69207f6f6d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:58.987581 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f15a3e-c7d5-4e4c-8e82-69207f6f6d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:58.988218 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f15a3e-c7d5-4e4c-8e82-69207f6f6d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:58.989816 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f15a3e-c7d5-4e4c-8e82-69207f6f6d0e admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:58.999953 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1266/2530] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:50:59.003683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fedf7-8b4f-44ce-b189-8aca917fb06a admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:59.013473 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fedf7-8b4f-44ce-b189-8aca917fb06a admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:59.018633 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b193c1-c990-4bb1-aaac-037860a7309a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:59.019221 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b193c1-c990-4bb1-aaac-037860a7309a admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:59.019506 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b193c1-c990-4bb1-aaac-037860a7309a admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:59.019782 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b193c1-c990-4bb1-aaac-037860a7309a admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:59.020424 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b193c1-c990-4bb1-aaac-037860a7309a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:59.022047 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b193c1-c990-4bb1-aaac-037860a7309a admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:59.033053 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1265/2531] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:50:59.038073 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f15a3e-c7d5-4e4c-8e82-69207f6f6d0e admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:59.048523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f15a3e-c7d5-4e4c-8e82-69207f6f6d0e admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:59.053046 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be6454-e869-410e-b7b6-0f4e4fe2ec1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:59.053688 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be6454-e869-410e-b7b6-0f4e4fe2ec1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:59.053999 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be6454-e869-410e-b7b6-0f4e4fe2ec1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:59.054272 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be6454-e869-410e-b7b6-0f4e4fe2ec1d admin admin] PATH_INFO: `/v3/projects/7d3cebf4617448199eca9535655d6c84/users/6b0cbc3506634bfab70725f4eaea2023/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:59.069108 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be6454-e869-410e-b7b6-0f4e4fe2ec1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d3cebf4617448199eca9535655d6c84, user_id=6b0cbc3506634bfab70725f4eaea2023, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:59.071784 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be6454-e869-410e-b7b6-0f4e4fe2ec1d admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:59.085250 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1267/2532] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:50:59 2022] PUT /identity/v3/projects/7d3cebf4617448199eca9535655d6c84/users/6b0cbc3506634bfab70725f4eaea2023/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 14:50:59.097136 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073ae5e-49d1-46d5-8820-4c853269edba None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:59.097421 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073ae5e-49d1-46d5-8820-4c853269edba None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:59.097712 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073ae5e-49d1-46d5-8820-4c853269edba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:59.124790 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-4073ae5e-49d1-46d5-8820-4c853269edba None None] MFA Rules not processed for user `6b0cbc3506634bfab70725f4eaea2023`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:50:59.126013 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-4073ae5e-49d1-46d5-8820-4c853269edba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:50:59.189809 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1266/2533] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:50:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:50:59.194257 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be6454-e869-410e-b7b6-0f4e4fe2ec1d admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:59.255086 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be6454-e869-410e-b7b6-0f4e4fe2ec1d admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:59.259631 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59726d-8b24-495b-8f0c-816b8630ed8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:59.260233 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59726d-8b24-495b-8f0c-816b8630ed8d admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:59.260510 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59726d-8b24-495b-8f0c-816b8630ed8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:59.260778 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59726d-8b24-495b-8f0c-816b8630ed8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:59.261413 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59726d-8b24-495b-8f0c-816b8630ed8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:59.263368 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59726d-8b24-495b-8f0c-816b8630ed8d admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:59.290128 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1268/2534] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:50:59 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:50:59.293920 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073ae5e-49d1-46d5-8820-4c853269edba None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:59.304552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073ae5e-49d1-46d5-8820-4c853269edba None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:59.312698 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:59.362116 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45e8fc-ffcf-458c-8964-60a70f0a77cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:59.362724 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45e8fc-ffcf-458c-8964-60a70f0a77cf admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:59.363007 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45e8fc-ffcf-458c-8964-60a70f0a77cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:59.363281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45e8fc-ffcf-458c-8964-60a70f0a77cf admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:59.363935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45e8fc-ffcf-458c-8964-60a70f0a77cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:59.365815 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45e8fc-ffcf-458c-8964-60a70f0a77cf admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:59.387011 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1267/2535] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:50:59 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:50:59.391637 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59726d-8b24-495b-8f0c-816b8630ed8d admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:59.402558 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59726d-8b24-495b-8f0c-816b8630ed8d admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:59.407154 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19f6b9-ae52-462e-8e8b-a819bfd00425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:59.407748 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19f6b9-ae52-462e-8e8b-a819bfd00425 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:59.408027 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19f6b9-ae52-462e-8e8b-a819bfd00425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:59.408299 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19f6b9-ae52-462e-8e8b-a819bfd00425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:59.408932 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19f6b9-ae52-462e-8e8b-a819bfd00425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:59.410574 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19f6b9-ae52-462e-8e8b-a819bfd00425 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:59.420899 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1269/2536] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:50:59.425121 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45e8fc-ffcf-458c-8964-60a70f0a77cf admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:59.435346 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45e8fc-ffcf-458c-8964-60a70f0a77cf admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:59.440635 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eddc71-c698-43cf-9810-1136fe1e1243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:59.441280 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eddc71-c698-43cf-9810-1136fe1e1243 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:59.441558 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eddc71-c698-43cf-9810-1136fe1e1243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:59.441835 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eddc71-c698-43cf-9810-1136fe1e1243 admin admin] PATH_INFO: `/v3/projects/eb6fb62b6e9749e5ad1ca2acfb6da181/users/74d7aaa01a9c435bbcee74647144ba1e/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:59.456968 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eddc71-c698-43cf-9810-1136fe1e1243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6fb62b6e9749e5ad1ca2acfb6da181, user_id=74d7aaa01a9c435bbcee74647144ba1e, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:59.459632 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eddc71-c698-43cf-9810-1136fe1e1243 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:59.472382 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1268/2537] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:50:59 2022] PUT /identity/v3/projects/eb6fb62b6e9749e5ad1ca2acfb6da181/users/74d7aaa01a9c435bbcee74647144ba1e/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:50:59.476330 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19f6b9-ae52-462e-8e8b-a819bfd00425 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:59.486356 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19f6b9-ae52-462e-8e8b-a819bfd00425 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:59.510389 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:59.546022 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c1d55-90a8-4aaa-a558-908c7d7a882a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:59.546656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c1d55-90a8-4aaa-a558-908c7d7a882a admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:59.546921 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c1d55-90a8-4aaa-a558-908c7d7a882a admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:59.547196 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c1d55-90a8-4aaa-a558-908c7d7a882a admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:59.547858 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c1d55-90a8-4aaa-a558-908c7d7a882a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:59.549449 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c1d55-90a8-4aaa-a558-908c7d7a882a admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:59.559299 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1270/2538] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:50:59.564052 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eddc71-c698-43cf-9810-1136fe1e1243 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:59.574351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eddc71-c698-43cf-9810-1136fe1e1243 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:59.579317 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02ebd6-ae7d-45be-81e3-0d7b65b7344c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:59.579963 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02ebd6-ae7d-45be-81e3-0d7b65b7344c admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:59.580250 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02ebd6-ae7d-45be-81e3-0d7b65b7344c admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:59.580524 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02ebd6-ae7d-45be-81e3-0d7b65b7344c admin admin] PATH_INFO: `/v3/projects/eb6fb62b6e9749e5ad1ca2acfb6da181/users/74d7aaa01a9c435bbcee74647144ba1e/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:59.582496 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02ebd6-ae7d-45be-81e3-0d7b65b7344c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6fb62b6e9749e5ad1ca2acfb6da181, user_id=74d7aaa01a9c435bbcee74647144ba1e, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:59.585123 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02ebd6-ae7d-45be-81e3-0d7b65b7344c admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:59.595972 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1269/2539] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:50:59 2022] PUT /identity/v3/projects/eb6fb62b6e9749e5ad1ca2acfb6da181/users/74d7aaa01a9c435bbcee74647144ba1e/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:50:59.606035 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a09d22-da89-4164-b159-94525d92b979 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:59.606328 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a09d22-da89-4164-b159-94525d92b979 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:59.606605 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a09d22-da89-4164-b159-94525d92b979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:59.635227 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-f3a09d22-da89-4164-b159-94525d92b979 None None] MFA Rules not processed for user `74d7aaa01a9c435bbcee74647144ba1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:50:59.636428 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-f3a09d22-da89-4164-b159-94525d92b979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:50:59.704473 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1271/2540] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:50:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:50:59.715832 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02ebd6-ae7d-45be-81e3-0d7b65b7344c admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:59.718166 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-8b02ebd6-ae7d-45be-81e3-0d7b65b7344c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:50:59.802999 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02ebd6-ae7d-45be-81e3-0d7b65b7344c admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:59.806698 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1e20c-d074-4149-9140-913bb4ba0210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:59.807296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1e20c-d074-4149-9140-913bb4ba0210 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:59.807572 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1e20c-d074-4149-9140-913bb4ba0210 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:59.807841 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1e20c-d074-4149-9140-913bb4ba0210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:59.817872 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1e20c-d074-4149-9140-913bb4ba0210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:59.819329 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1e20c-d074-4149-9140-913bb4ba0210 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:59.828862 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1270/2541] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:50:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:50:59.905338 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a09d22-da89-4164-b159-94525d92b979 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:50:59.914798 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a09d22-da89-4164-b159-94525d92b979 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:50:59.918297 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcadc7-6f6a-4d3a-9764-940c84faf5fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:50:59.918887 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcadc7-6f6a-4d3a-9764-940c84faf5fd service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:50:59.919160 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcadc7-6f6a-4d3a-9764-940c84faf5fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:50:59.919426 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcadc7-6f6a-4d3a-9764-940c84faf5fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:50:59.975293 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fcadc7-6f6a-4d3a-9764-940c84faf5fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:50:59.976630 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fcadc7-6f6a-4d3a-9764-940c84faf5fd service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:50:59.988134 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1272/2542] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:50:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:51:09.824619 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=74,keystone:INSERT=5 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:09.982767 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=79 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:16.160044 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1e20c-d074-4149-9140-913bb4ba0210 service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:16.161734 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-68b1e20c-d074-4149-9140-913bb4ba0210 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:16.233820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1e20c-d074-4149-9140-913bb4ba0210 service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:16.237477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7972d-403b-4fef-9eec-337eb8c4a939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:16.238119 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7972d-403b-4fef-9eec-337eb8c4a939 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:16.238400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7972d-403b-4fef-9eec-337eb8c4a939 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:16.238669 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7972d-403b-4fef-9eec-337eb8c4a939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:16.240423 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a8c7972d-403b-4fef-9eec-337eb8c4a939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:16.312821 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7972d-403b-4fef-9eec-337eb8c4a939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:16.314169 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7972d-403b-4fef-9eec-337eb8c4a939 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:16.325729 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1271/2543] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:51:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:51:17.524211 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcadc7-6f6a-4d3a-9764-940c84faf5fd service cinder] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:17.534954 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcadc7-6f6a-4d3a-9764-940c84faf5fd service cinder] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:17.538896 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c806b2c-8fb0-4159-8492-244178409a23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:17.539505 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c806b2c-8fb0-4159-8492-244178409a23 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:17.539780 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c806b2c-8fb0-4159-8492-244178409a23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:17.540048 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c806b2c-8fb0-4159-8492-244178409a23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:17.541775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-6c806b2c-8fb0-4159-8492-244178409a23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:17.557489 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c806b2c-8fb0-4159-8492-244178409a23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:17.559013 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c806b2c-8fb0-4159-8492-244178409a23 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:17.574315 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1273/2544] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:51:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:51:26.320567 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=54 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:26.444303 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7972d-403b-4fef-9eec-337eb8c4a939 service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:26.446636 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a8c7972d-403b-4fef-9eec-337eb8c4a939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:26.527156 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7972d-403b-4fef-9eec-337eb8c4a939 service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:26.532135 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba421542-9dbd-401e-8355-4aeeec278cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:26.532774 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba421542-9dbd-401e-8355-4aeeec278cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:26.533050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba421542-9dbd-401e-8355-4aeeec278cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:26.533317 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba421542-9dbd-401e-8355-4aeeec278cfe admin admin] PATH_INFO: `/v3/users/5a1c58ca04a5465b812708d0f4c5742b` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:26.534568 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba421542-9dbd-401e-8355-4aeeec278cfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a1c58ca04a5465b812708d0f4c5742b)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:26.536797 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba421542-9dbd-401e-8355-4aeeec278cfe admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:26.589024 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ba421542-9dbd-401e-8355-4aeeec278cfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a1c58ca04a5465b812708d0f4c5742b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:26.597049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ba421542-9dbd-401e-8355-4aeeec278cfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a1c58ca04a5465b812708d0f4c5742b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:26.597772 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ba421542-9dbd-401e-8355-4aeeec278cfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a1c58ca04a5465b812708d0f4c5742b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:26.598409 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ba421542-9dbd-401e-8355-4aeeec278cfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a1c58ca04a5465b812708d0f4c5742b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:26.606891 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ba421542-9dbd-401e-8355-4aeeec278cfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a1c58ca04a5465b812708d0f4c5742b'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:26.626851 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1272/2545] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:51:26 2022] DELETE /identity/v3/users/5a1c58ca04a5465b812708d0f4c5742b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:26.802035 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c806b2c-8fb0-4159-8492-244178409a23 service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:26.819685 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c806b2c-8fb0-4159-8492-244178409a23 service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:26.876200 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f396edb-94b3-45ca-a2f0-999f9f011680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:26.876841 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f396edb-94b3-45ca-a2f0-999f9f011680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:26.877120 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f396edb-94b3-45ca-a2f0-999f9f011680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:26.877396 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f396edb-94b3-45ca-a2f0-999f9f011680 admin admin] PATH_INFO: `/v3/projects/257f2372d4a24fc89d530b5bf7228c40` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:26.878557 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f396edb-94b3-45ca-a2f0-999f9f011680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=257f2372d4a24fc89d530b5bf7228c40)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:26.880472 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f396edb-94b3-45ca-a2f0-999f9f011680 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:26.925860 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-6f396edb-94b3-45ca-a2f0-999f9f011680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '257f2372d4a24fc89d530b5bf7228c40', 'request_id': 'req-6f396edb-94b3-45ca-a2f0-999f9f011680'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:26.931299 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-6f396edb-94b3-45ca-a2f0-999f9f011680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '257f2372d4a24fc89d530b5bf7228c40', 'request_id': 'req-6f396edb-94b3-45ca-a2f0-999f9f011680'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:26.938600 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-6f396edb-94b3-45ca-a2f0-999f9f011680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '257f2372d4a24fc89d530b5bf7228c40', 'request_id': 'req-6f396edb-94b3-45ca-a2f0-999f9f011680'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:26.950177 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-6f396edb-94b3-45ca-a2f0-999f9f011680 admin admin] The token cache is being invalidate because project 257f2372d4a24fc89d530b5bf7228c40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:51:26.950624 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-6f396edb-94b3-45ca-a2f0-999f9f011680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:26.951257 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-6f396edb-94b3-45ca-a2f0-999f9f011680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:26.952762 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1274/2546] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:51:26 2022] DELETE /identity/v3/projects/257f2372d4a24fc89d530b5bf7228c40 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:26.956809 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba421542-9dbd-401e-8355-4aeeec278cfe admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:26.958586 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-ba421542-9dbd-401e-8355-4aeeec278cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:26.971579 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba421542-9dbd-401e-8355-4aeeec278cfe admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:27.029817 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886fa0e-785f-457c-8c8b-c5547c3a01b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:27.030401 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886fa0e-785f-457c-8c8b-c5547c3a01b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:27.030683 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886fa0e-785f-457c-8c8b-c5547c3a01b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:27.030957 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886fa0e-785f-457c-8c8b-c5547c3a01b5 admin admin] PATH_INFO: `/v3/users/99274556222a423aaa694ad2f01fd96c` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:27.032075 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886fa0e-785f-457c-8c8b-c5547c3a01b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99274556222a423aaa694ad2f01fd96c)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:27.034007 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886fa0e-785f-457c-8c8b-c5547c3a01b5 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:27.054886 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:27.090213 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e886fa0e-785f-457c-8c8b-c5547c3a01b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99274556222a423aaa694ad2f01fd96c'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:27.097428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e886fa0e-785f-457c-8c8b-c5547c3a01b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99274556222a423aaa694ad2f01fd96c'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:27.098121 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e886fa0e-785f-457c-8c8b-c5547c3a01b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99274556222a423aaa694ad2f01fd96c'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:27.098730 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e886fa0e-785f-457c-8c8b-c5547c3a01b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99274556222a423aaa694ad2f01fd96c'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:27.107151 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e886fa0e-785f-457c-8c8b-c5547c3a01b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99274556222a423aaa694ad2f01fd96c'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:27.125630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1273/2547] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:51:26 2022] DELETE /identity/v3/users/99274556222a423aaa694ad2f01fd96c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:27.298338 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f396edb-94b3-45ca-a2f0-999f9f011680 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:27.299776 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-6f396edb-94b3-45ca-a2f0-999f9f011680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:27.312759 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f396edb-94b3-45ca-a2f0-999f9f011680 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:27.370404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1b56e-bcd5-43bd-a7ce-718aeed53883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:27.371030 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1b56e-bcd5-43bd-a7ce-718aeed53883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:27.371317 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1b56e-bcd5-43bd-a7ce-718aeed53883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:27.371605 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1b56e-bcd5-43bd-a7ce-718aeed53883 admin admin] PATH_INFO: `/v3/projects/f2f5b5b24fa3415285378c31cad2bf0d` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:27.372713 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1b56e-bcd5-43bd-a7ce-718aeed53883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2f5b5b24fa3415285378c31cad2bf0d)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:27.374654 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1b56e-bcd5-43bd-a7ce-718aeed53883 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:27.396765 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:27.422929 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-79f1b56e-bcd5-43bd-a7ce-718aeed53883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f5b5b24fa3415285378c31cad2bf0d', 'request_id': 'req-79f1b56e-bcd5-43bd-a7ce-718aeed53883'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:27.428323 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-79f1b56e-bcd5-43bd-a7ce-718aeed53883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f5b5b24fa3415285378c31cad2bf0d', 'request_id': 'req-79f1b56e-bcd5-43bd-a7ce-718aeed53883'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:27.435331 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-79f1b56e-bcd5-43bd-a7ce-718aeed53883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f5b5b24fa3415285378c31cad2bf0d', 'request_id': 'req-79f1b56e-bcd5-43bd-a7ce-718aeed53883'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:27.446144 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-79f1b56e-bcd5-43bd-a7ce-718aeed53883 admin admin] The token cache is being invalidate because project f2f5b5b24fa3415285378c31cad2bf0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:51:27.446460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-79f1b56e-bcd5-43bd-a7ce-718aeed53883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:27.447100 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-79f1b56e-bcd5-43bd-a7ce-718aeed53883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:27.448584 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1275/2548] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:51:27 2022] DELETE /identity/v3/projects/f2f5b5b24fa3415285378c31cad2bf0d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:29.387758 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886fa0e-785f-457c-8c8b-c5547c3a01b5 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:29.389229 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e886fa0e-785f-457c-8c8b-c5547c3a01b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:29.401579 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886fa0e-785f-457c-8c8b-c5547c3a01b5 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:29.459049 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c4e96-72fc-487c-9a9b-d8869e7332aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:29.459605 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c4e96-72fc-487c-9a9b-d8869e7332aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:29.459891 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c4e96-72fc-487c-9a9b-d8869e7332aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:29.460162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c4e96-72fc-487c-9a9b-d8869e7332aa admin admin] PATH_INFO: `/v3/users/6b0cbc3506634bfab70725f4eaea2023` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:29.461279 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c4e96-72fc-487c-9a9b-d8869e7332aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b0cbc3506634bfab70725f4eaea2023)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:29.463235 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c4e96-72fc-487c-9a9b-d8869e7332aa admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:29.508784 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-716c4e96-72fc-487c-9a9b-d8869e7332aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b0cbc3506634bfab70725f4eaea2023'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:29.516127 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-716c4e96-72fc-487c-9a9b-d8869e7332aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b0cbc3506634bfab70725f4eaea2023'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:29.516768 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-716c4e96-72fc-487c-9a9b-d8869e7332aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b0cbc3506634bfab70725f4eaea2023'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:29.517386 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-716c4e96-72fc-487c-9a9b-d8869e7332aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b0cbc3506634bfab70725f4eaea2023'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:29.524252 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-716c4e96-72fc-487c-9a9b-d8869e7332aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b0cbc3506634bfab70725f4eaea2023'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:29.541437 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1274/2549] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:51:29 2022] DELETE /identity/v3/users/6b0cbc3506634bfab70725f4eaea2023 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:29.546031 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef2ced-641b-43b2-8d92-565eea0bee94 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:29.546523 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef2ced-641b-43b2-8d92-565eea0bee94 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:29.546657 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef2ced-641b-43b2-8d92-565eea0bee94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:29.566242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-f2ef2ced-641b-43b2-8d92-565eea0bee94 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:51:29.567569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-f2ef2ced-641b-43b2-8d92-565eea0bee94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:29.625643 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1276/2550] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:51:29.635464 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c4e96-72fc-487c-9a9b-d8869e7332aa admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:29.637007 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-716c4e96-72fc-487c-9a9b-d8869e7332aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:29.656607 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:29.695653 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c4e96-72fc-487c-9a9b-d8869e7332aa admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:29.699492 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b114a2-eb18-4216-821e-18ec61209ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:29.700108 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b114a2-eb18-4216-821e-18ec61209ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:29.700384 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b114a2-eb18-4216-821e-18ec61209ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:29.700654 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b114a2-eb18-4216-821e-18ec61209ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:29.709799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b114a2-eb18-4216-821e-18ec61209ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:29.711202 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b114a2-eb18-4216-821e-18ec61209ac4 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:29.720388 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1275/2551] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:51:29.979480 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef2ced-641b-43b2-8d92-565eea0bee94 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:29.981655 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-f2ef2ced-641b-43b2-8d92-565eea0bee94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:29.998641 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef2ced-641b-43b2-8d92-565eea0bee94 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:30.003768 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791e614-215f-4f02-9812-906f0245a1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:30.004407 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791e614-215f-4f02-9812-906f0245a1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:30.004708 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791e614-215f-4f02-9812-906f0245a1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:30.004981 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791e614-215f-4f02-9812-906f0245a1ff admin admin] PATH_INFO: `/v3/projects/7d3cebf4617448199eca9535655d6c84` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:30.006292 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791e614-215f-4f02-9812-906f0245a1ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d3cebf4617448199eca9535655d6c84)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:30.008180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791e614-215f-4f02-9812-906f0245a1ff admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:30.055499 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-f791e614-215f-4f02-9812-906f0245a1ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d3cebf4617448199eca9535655d6c84', 'request_id': 'req-f791e614-215f-4f02-9812-906f0245a1ff'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:30.061054 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-f791e614-215f-4f02-9812-906f0245a1ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d3cebf4617448199eca9535655d6c84', 'request_id': 'req-f791e614-215f-4f02-9812-906f0245a1ff'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:30.067737 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-f791e614-215f-4f02-9812-906f0245a1ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d3cebf4617448199eca9535655d6c84', 'request_id': 'req-f791e614-215f-4f02-9812-906f0245a1ff'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:30.078992 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-f791e614-215f-4f02-9812-906f0245a1ff admin admin] The token cache is being invalidate because project 7d3cebf4617448199eca9535655d6c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:51:30.079278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-f791e614-215f-4f02-9812-906f0245a1ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:30.079919 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-f791e614-215f-4f02-9812-906f0245a1ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:30.081412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1277/2552] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:51:29 2022] DELETE /identity/v3/projects/7d3cebf4617448199eca9535655d6c84 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:30.085639 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b114a2-eb18-4216-821e-18ec61209ac4 service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:30.095684 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b114a2-eb18-4216-821e-18ec61209ac4 service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:30.150608 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77bf1e-31f1-4d20-9925-015987dad0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:30.151230 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77bf1e-31f1-4d20-9925-015987dad0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:30.151509 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77bf1e-31f1-4d20-9925-015987dad0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:30.151781 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77bf1e-31f1-4d20-9925-015987dad0af admin admin] PATH_INFO: `/v3/users/74d7aaa01a9c435bbcee74647144ba1e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:30.153604 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77bf1e-31f1-4d20-9925-015987dad0af admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d7aaa01a9c435bbcee74647144ba1e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:30.155549 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77bf1e-31f1-4d20-9925-015987dad0af admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:30.202195 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1f77bf1e-31f1-4d20-9925-015987dad0af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d7aaa01a9c435bbcee74647144ba1e'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:30.208930 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1f77bf1e-31f1-4d20-9925-015987dad0af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d7aaa01a9c435bbcee74647144ba1e'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:30.209589 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1f77bf1e-31f1-4d20-9925-015987dad0af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d7aaa01a9c435bbcee74647144ba1e'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:30.210212 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1f77bf1e-31f1-4d20-9925-015987dad0af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d7aaa01a9c435bbcee74647144ba1e'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:30.217908 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-1f77bf1e-31f1-4d20-9925-015987dad0af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d7aaa01a9c435bbcee74647144ba1e'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:30.235587 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1276/2553] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:51:30 2022] DELETE /identity/v3/users/74d7aaa01a9c435bbcee74647144ba1e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:30.510605 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791e614-215f-4f02-9812-906f0245a1ff admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:30.513216 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-f791e614-215f-4f02-9812-906f0245a1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:30.526543 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791e614-215f-4f02-9812-906f0245a1ff admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:30.556460 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:30.585894 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba8b09-60de-4d9e-a950-e4d3edcef2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:30.586527 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba8b09-60de-4d9e-a950-e4d3edcef2ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:30.586813 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba8b09-60de-4d9e-a950-e4d3edcef2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:30.587089 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba8b09-60de-4d9e-a950-e4d3edcef2ae admin admin] PATH_INFO: `/v3/projects/eb6fb62b6e9749e5ad1ca2acfb6da181` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:30.588198 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba8b09-60de-4d9e-a950-e4d3edcef2ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb6fb62b6e9749e5ad1ca2acfb6da181)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:30.590999 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba8b09-60de-4d9e-a950-e4d3edcef2ae admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:30.635324 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-72ba8b09-60de-4d9e-a950-e4d3edcef2ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb6fb62b6e9749e5ad1ca2acfb6da181', 'request_id': 'req-72ba8b09-60de-4d9e-a950-e4d3edcef2ae'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:30.641370 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-72ba8b09-60de-4d9e-a950-e4d3edcef2ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb6fb62b6e9749e5ad1ca2acfb6da181', 'request_id': 'req-72ba8b09-60de-4d9e-a950-e4d3edcef2ae'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:30.648488 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-72ba8b09-60de-4d9e-a950-e4d3edcef2ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb6fb62b6e9749e5ad1ca2acfb6da181', 'request_id': 'req-72ba8b09-60de-4d9e-a950-e4d3edcef2ae'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:30.660257 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-72ba8b09-60de-4d9e-a950-e4d3edcef2ae admin admin] The token cache is being invalidate because project eb6fb62b6e9749e5ad1ca2acfb6da181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:51:30.660546 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-72ba8b09-60de-4d9e-a950-e4d3edcef2ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:30.661179 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-72ba8b09-60de-4d9e-a950-e4d3edcef2ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:30.662666 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1278/2554] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:51:30 2022] DELETE /identity/v3/projects/eb6fb62b6e9749e5ad1ca2acfb6da181 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:30.667963 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff278e-0c13-47f7-83b1-a9e4aa3b5888 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:30.668421 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff278e-0c13-47f7-83b1-a9e4aa3b5888 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:30.668588 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff278e-0c13-47f7-83b1-a9e4aa3b5888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:30.687837 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-00ff278e-0c13-47f7-83b1-a9e4aa3b5888 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:51:30.689019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-00ff278e-0c13-47f7-83b1-a9e4aa3b5888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:30.721668 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:30.747935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1277/2555] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:51:30.756102 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264d7a9-5330-4c29-8ffe-919513b1884f None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:30.756462 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264d7a9-5330-4c29-8ffe-919513b1884f None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:30.756733 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264d7a9-5330-4c29-8ffe-919513b1884f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:30.776940 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-8264d7a9-5330-4c29-8ffe-919513b1884f None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:51:30.778202 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-8264d7a9-5330-4c29-8ffe-919513b1884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:30.786072 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1279/2556] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:51:30.790311 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff278e-0c13-47f7-83b1-a9e4aa3b5888 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:30.799859 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff278e-0c13-47f7-83b1-a9e4aa3b5888 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:30.804338 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968eb8e4-5c1b-4644-9203-acab11f02d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:30.804923 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968eb8e4-5c1b-4644-9203-acab11f02d0a admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:30.805198 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968eb8e4-5c1b-4644-9203-acab11f02d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:30.805464 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968eb8e4-5c1b-4644-9203-acab11f02d0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:30.806140 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968eb8e4-5c1b-4644-9203-acab11f02d0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:51:30.806436 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968eb8e4-5c1b-4644-9203-acab11f02d0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:30.808017 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968eb8e4-5c1b-4644-9203-acab11f02d0a admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:30.819721 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1278/2557] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:51:30.823931 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264d7a9-5330-4c29-8ffe-919513b1884f None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:30.833923 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264d7a9-5330-4c29-8ffe-919513b1884f None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:30.838596 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c862e-44b3-4ef3-9365-21568fdfe55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:30.839186 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c862e-44b3-4ef3-9365-21568fdfe55a admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:30.839461 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c862e-44b3-4ef3-9365-21568fdfe55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:30.839775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c862e-44b3-4ef3-9365-21568fdfe55a admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:30.840394 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c862e-44b3-4ef3-9365-21568fdfe55a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:30.842374 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c862e-44b3-4ef3-9365-21568fdfe55a admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:30.868177 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1280/2558] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:51:30 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:51:30.873315 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968eb8e4-5c1b-4644-9203-acab11f02d0a admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:30.883149 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968eb8e4-5c1b-4644-9203-acab11f02d0a admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:30.939126 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f70dc8-e2cf-4e7f-b0d9-c85674beed91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:30.939727 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f70dc8-e2cf-4e7f-b0d9-c85674beed91 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:30.940008 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f70dc8-e2cf-4e7f-b0d9-c85674beed91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:30.940281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f70dc8-e2cf-4e7f-b0d9-c85674beed91 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:30.940919 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f70dc8-e2cf-4e7f-b0d9-c85674beed91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:30.942866 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f70dc8-e2cf-4e7f-b0d9-c85674beed91 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:30.963450 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1279/2559] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:51:30 2022] POST /identity/v3/users => generated 282 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:51:30.969120 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c862e-44b3-4ef3-9365-21568fdfe55a admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:30.979270 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c862e-44b3-4ef3-9365-21568fdfe55a admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:30.985005 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444045f-1ba3-496a-b66e-9d1adbe7ad52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:30.985680 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444045f-1ba3-496a-b66e-9d1adbe7ad52 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:30.986039 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444045f-1ba3-496a-b66e-9d1adbe7ad52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:30.986341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444045f-1ba3-496a-b66e-9d1adbe7ad52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:30.987122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444045f-1ba3-496a-b66e-9d1adbe7ad52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:30.988908 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444045f-1ba3-496a-b66e-9d1adbe7ad52 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:30.999102 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1281/2560] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:51:31.003052 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f70dc8-e2cf-4e7f-b0d9-c85674beed91 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:31.012989 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f70dc8-e2cf-4e7f-b0d9-c85674beed91 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:31.017525 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9f458-c200-4bd7-b183-ef3d838121c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:31.018146 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9f458-c200-4bd7-b183-ef3d838121c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:31.018428 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9f458-c200-4bd7-b183-ef3d838121c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:31.018705 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9f458-c200-4bd7-b183-ef3d838121c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:31.019335 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9f458-c200-4bd7-b183-ef3d838121c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:31.020908 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9f458-c200-4bd7-b183-ef3d838121c9 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:31.031736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1280/2561] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:51:31.035578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444045f-1ba3-496a-b66e-9d1adbe7ad52 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:31.046404 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444045f-1ba3-496a-b66e-9d1adbe7ad52 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:31.051008 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a69fa1-7465-42f9-a08e-6badd023d403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:31.051652 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a69fa1-7465-42f9-a08e-6badd023d403 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:31.051934 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a69fa1-7465-42f9-a08e-6badd023d403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:31.052209 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a69fa1-7465-42f9-a08e-6badd023d403 admin admin] PATH_INFO: `/v3/projects/691bf22175184ffc80711a8a34e38951/users/2e5a8a15534e4bb3b38b87100611f890/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:31.067135 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a69fa1-7465-42f9-a08e-6badd023d403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=691bf22175184ffc80711a8a34e38951, user_id=2e5a8a15534e4bb3b38b87100611f890, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:31.069771 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a69fa1-7465-42f9-a08e-6badd023d403 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:31.083587 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1282/2562] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:51:31 2022] PUT /identity/v3/projects/691bf22175184ffc80711a8a34e38951/users/2e5a8a15534e4bb3b38b87100611f890/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:31.094580 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78ffc3-77bd-4ec8-8394-c650377a747d None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:31.094889 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78ffc3-77bd-4ec8-8394-c650377a747d None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:31.095161 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78ffc3-77bd-4ec8-8394-c650377a747d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:31.122062 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-3e78ffc3-77bd-4ec8-8394-c650377a747d None None] MFA Rules not processed for user `2e5a8a15534e4bb3b38b87100611f890`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:51:31.123277 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-3e78ffc3-77bd-4ec8-8394-c650377a747d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:31.186831 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1281/2563] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:51:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:51:31.191328 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a69fa1-7465-42f9-a08e-6badd023d403 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:31.248857 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:31.252806 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a69fa1-7465-42f9-a08e-6badd023d403 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:31.258991 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c82f1-c08b-4700-a34d-882cd0f9a7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:31.259618 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c82f1-c08b-4700-a34d-882cd0f9a7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:31.260071 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c82f1-c08b-4700-a34d-882cd0f9a7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:31.260509 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c82f1-c08b-4700-a34d-882cd0f9a7b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:31.261147 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c82f1-c08b-4700-a34d-882cd0f9a7b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:31.263704 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c82f1-c08b-4700-a34d-882cd0f9a7b1 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:31.289152 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1283/2564] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:51:31 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:51:31.293754 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78ffc3-77bd-4ec8-8394-c650377a747d None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:31.304219 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78ffc3-77bd-4ec8-8394-c650377a747d None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:31.335650 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:31.360644 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f504ce5-10a8-44eb-9649-2e4325f5b267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:31.361235 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504ce5-10a8-44eb-9649-2e4325f5b267 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:31.361513 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504ce5-10a8-44eb-9649-2e4325f5b267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:31.361782 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504ce5-10a8-44eb-9649-2e4325f5b267 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:31.362447 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f504ce5-10a8-44eb-9649-2e4325f5b267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:31.364337 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f504ce5-10a8-44eb-9649-2e4325f5b267 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:31.384820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1282/2565] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:51:31 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:51:31.389559 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c82f1-c08b-4700-a34d-882cd0f9a7b1 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:31.399830 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c82f1-c08b-4700-a34d-882cd0f9a7b1 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:31.404987 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a1ee7-00e9-4549-9205-d230fe490eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:31.405578 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a1ee7-00e9-4549-9205-d230fe490eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:31.405874 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a1ee7-00e9-4549-9205-d230fe490eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:31.406159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a1ee7-00e9-4549-9205-d230fe490eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:31.406792 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a1ee7-00e9-4549-9205-d230fe490eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:31.408388 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a1ee7-00e9-4549-9205-d230fe490eb7 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:31.418928 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1284/2566] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:51:31.422895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f504ce5-10a8-44eb-9649-2e4325f5b267 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:31.432732 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f504ce5-10a8-44eb-9649-2e4325f5b267 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:31.437363 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fed8ca-27a1-4dec-95cc-329c5737722c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:31.438069 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fed8ca-27a1-4dec-95cc-329c5737722c admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:31.438346 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fed8ca-27a1-4dec-95cc-329c5737722c admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:31.438614 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fed8ca-27a1-4dec-95cc-329c5737722c admin admin] PATH_INFO: `/v3/projects/9614a156b7d843578536a30099b2f395/users/c87065e749b44ff3bdfed1993a773ee0/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:31.453409 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fed8ca-27a1-4dec-95cc-329c5737722c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9614a156b7d843578536a30099b2f395, user_id=c87065e749b44ff3bdfed1993a773ee0, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:31.456046 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fed8ca-27a1-4dec-95cc-329c5737722c admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:31.468890 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1283/2567] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:51:31 2022] PUT /identity/v3/projects/9614a156b7d843578536a30099b2f395/users/c87065e749b44ff3bdfed1993a773ee0/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:31.472810 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a1ee7-00e9-4549-9205-d230fe490eb7 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:31.482656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a1ee7-00e9-4549-9205-d230fe490eb7 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:31.538385 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac15db-26ec-4101-b23d-d3fe07af945c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:31.538924 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac15db-26ec-4101-b23d-d3fe07af945c admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:31.539200 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac15db-26ec-4101-b23d-d3fe07af945c admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:31.539469 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac15db-26ec-4101-b23d-d3fe07af945c admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:31.540096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac15db-26ec-4101-b23d-d3fe07af945c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:31.541677 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac15db-26ec-4101-b23d-d3fe07af945c admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:31.551778 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1285/2568] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:51:31.555985 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fed8ca-27a1-4dec-95cc-329c5737722c admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:31.566271 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fed8ca-27a1-4dec-95cc-329c5737722c admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:31.571122 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20138f9-41be-4e3a-8497-26e2fdf76128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:31.571767 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20138f9-41be-4e3a-8497-26e2fdf76128 admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:31.572050 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20138f9-41be-4e3a-8497-26e2fdf76128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:31.572327 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20138f9-41be-4e3a-8497-26e2fdf76128 admin admin] PATH_INFO: `/v3/projects/9614a156b7d843578536a30099b2f395/users/c87065e749b44ff3bdfed1993a773ee0/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:31.574461 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20138f9-41be-4e3a-8497-26e2fdf76128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9614a156b7d843578536a30099b2f395, user_id=c87065e749b44ff3bdfed1993a773ee0, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:31.577374 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20138f9-41be-4e3a-8497-26e2fdf76128 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:31.587843 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1284/2569] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:51:31 2022] PUT /identity/v3/projects/9614a156b7d843578536a30099b2f395/users/c87065e749b44ff3bdfed1993a773ee0/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:31.651433 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b6f8-fdf5-4538-9727-fbfa630627df None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:31.652035 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b6f8-fdf5-4538-9727-fbfa630627df None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:31.652035 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b6f8-fdf5-4538-9727-fbfa630627df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:31.681772 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-4b43b6f8-fdf5-4538-9727-fbfa630627df None None] MFA Rules not processed for user `c87065e749b44ff3bdfed1993a773ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:51:31.683059 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-4b43b6f8-fdf5-4538-9727-fbfa630627df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:31.751193 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1286/2570] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:51:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:51:31.762604 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20138f9-41be-4e3a-8497-26e2fdf76128 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:31.764364 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e20138f9-41be-4e3a-8497-26e2fdf76128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:31.821827 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20138f9-41be-4e3a-8497-26e2fdf76128 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:31.826284 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232f281-9169-414d-81bd-679f7fddc421 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:31.826879 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232f281-9169-414d-81bd-679f7fddc421 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:31.827157 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232f281-9169-414d-81bd-679f7fddc421 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:31.827430 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232f281-9169-414d-81bd-679f7fddc421 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:31.836199 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232f281-9169-414d-81bd-679f7fddc421 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:31.837611 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232f281-9169-414d-81bd-679f7fddc421 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:31.847799 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1285/2571] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:51:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:51:31.923997 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43b6f8-fdf5-4538-9727-fbfa630627df None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:31.933454 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43b6f8-fdf5-4538-9727-fbfa630627df None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:31.937014 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbf1a2-299c-4979-8987-ef49e07e6971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:31.937603 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbf1a2-299c-4979-8987-ef49e07e6971 service cinder] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:31.937912 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbf1a2-299c-4979-8987-ef49e07e6971 service cinder] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:31.938180 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbf1a2-299c-4979-8987-ef49e07e6971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:31.988628 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:31.999012 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbf1a2-299c-4979-8987-ef49e07e6971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:32.000498 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbf1a2-299c-4979-8987-ef49e07e6971 service cinder] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:32.009455 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1287/2572] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:51:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:51:37.923935 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232f281-9169-414d-81bd-679f7fddc421 service cinder] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:37.984767 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232f281-9169-414d-81bd-679f7fddc421 service cinder] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:37.989551 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02bcaf-2500-4a20-8bca-5187c749b028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:37.990205 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02bcaf-2500-4a20-8bca-5187c749b028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:37.990496 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02bcaf-2500-4a20-8bca-5187c749b028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:37.990770 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02bcaf-2500-4a20-8bca-5187c749b028 admin admin] PATH_INFO: `/v3/users/2e5a8a15534e4bb3b38b87100611f890` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:37.991900 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02bcaf-2500-4a20-8bca-5187c749b028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e5a8a15534e4bb3b38b87100611f890)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:37.994098 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02bcaf-2500-4a20-8bca-5187c749b028 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:38.029281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:38.042885 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ac02bcaf-2500-4a20-8bca-5187c749b028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e5a8a15534e4bb3b38b87100611f890'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:38.050273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ac02bcaf-2500-4a20-8bca-5187c749b028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e5a8a15534e4bb3b38b87100611f890'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:38.050938 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ac02bcaf-2500-4a20-8bca-5187c749b028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e5a8a15534e4bb3b38b87100611f890'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:38.051552 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ac02bcaf-2500-4a20-8bca-5187c749b028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e5a8a15534e4bb3b38b87100611f890'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:38.057806 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ac02bcaf-2500-4a20-8bca-5187c749b028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e5a8a15534e4bb3b38b87100611f890'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:38.076281 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1286/2573] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:51:37 2022] DELETE /identity/v3/users/2e5a8a15534e4bb3b38b87100611f890 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:38.080797 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a75da-bd8f-4eee-b071-bf62ad5fae07 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:38.081264 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a75da-bd8f-4eee-b071-bf62ad5fae07 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:38.081367 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a75da-bd8f-4eee-b071-bf62ad5fae07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:38.100278 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-e23a75da-bd8f-4eee-b071-bf62ad5fae07 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:51:38.101478 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e23a75da-bd8f-4eee-b071-bf62ad5fae07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:38.158124 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1288/2574] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:51:38.167873 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02bcaf-2500-4a20-8bca-5187c749b028 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:38.169366 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-ac02bcaf-2500-4a20-8bca-5187c749b028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:38.227337 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02bcaf-2500-4a20-8bca-5187c749b028 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:38.230957 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c70d1c-d91d-427b-b47b-d2c9134fa322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:38.232085 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c70d1c-d91d-427b-b47b-d2c9134fa322 service neutron] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:38.232442 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c70d1c-d91d-427b-b47b-d2c9134fa322 service neutron] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:38.232708 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c70d1c-d91d-427b-b47b-d2c9134fa322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:38.241367 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c70d1c-d91d-427b-b47b-d2c9134fa322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:38.242820 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c70d1c-d91d-427b-b47b-d2c9134fa322 service neutron] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:38.252895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1287/2575] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:51:38.512847 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a75da-bd8f-4eee-b071-bf62ad5fae07 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:38.514420 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-e23a75da-bd8f-4eee-b071-bf62ad5fae07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:38.528440 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a75da-bd8f-4eee-b071-bf62ad5fae07 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:38.533071 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cca723-b01b-4228-b268-4fbbe1fd5742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:38.534551 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cca723-b01b-4228-b268-4fbbe1fd5742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:38.534843 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cca723-b01b-4228-b268-4fbbe1fd5742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:38.535141 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cca723-b01b-4228-b268-4fbbe1fd5742 admin admin] PATH_INFO: `/v3/projects/691bf22175184ffc80711a8a34e38951` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:38.536237 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cca723-b01b-4228-b268-4fbbe1fd5742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=691bf22175184ffc80711a8a34e38951)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:38.538175 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cca723-b01b-4228-b268-4fbbe1fd5742 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:38.585046 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-f6cca723-b01b-4228-b268-4fbbe1fd5742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '691bf22175184ffc80711a8a34e38951', 'request_id': 'req-f6cca723-b01b-4228-b268-4fbbe1fd5742'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:38.590520 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-f6cca723-b01b-4228-b268-4fbbe1fd5742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '691bf22175184ffc80711a8a34e38951', 'request_id': 'req-f6cca723-b01b-4228-b268-4fbbe1fd5742'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:38.598135 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-f6cca723-b01b-4228-b268-4fbbe1fd5742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '691bf22175184ffc80711a8a34e38951', 'request_id': 'req-f6cca723-b01b-4228-b268-4fbbe1fd5742'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:38.609448 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-f6cca723-b01b-4228-b268-4fbbe1fd5742 admin admin] The token cache is being invalidate because project 691bf22175184ffc80711a8a34e38951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:51:38.609734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-f6cca723-b01b-4228-b268-4fbbe1fd5742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:38.610383 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-f6cca723-b01b-4228-b268-4fbbe1fd5742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:38.611828 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1289/2576] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:51:38 2022] DELETE /identity/v3/projects/691bf22175184ffc80711a8a34e38951 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:38.615878 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c70d1c-d91d-427b-b47b-d2c9134fa322 service neutron] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:38.625513 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c70d1c-d91d-427b-b47b-d2c9134fa322 service neutron] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:38.680488 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ce366-090e-4cdd-8f05-58387bf06d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:38.681107 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ce366-090e-4cdd-8f05-58387bf06d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:38.681382 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ce366-090e-4cdd-8f05-58387bf06d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:38.681654 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ce366-090e-4cdd-8f05-58387bf06d68 admin admin] PATH_INFO: `/v3/users/c87065e749b44ff3bdfed1993a773ee0` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:38.682778 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ce366-090e-4cdd-8f05-58387bf06d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c87065e749b44ff3bdfed1993a773ee0)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:38.684817 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ce366-090e-4cdd-8f05-58387bf06d68 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:38.729245 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ec7ce366-090e-4cdd-8f05-58387bf06d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c87065e749b44ff3bdfed1993a773ee0'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:38.736844 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:38.739244 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ec7ce366-090e-4cdd-8f05-58387bf06d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c87065e749b44ff3bdfed1993a773ee0'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:38.740136 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ec7ce366-090e-4cdd-8f05-58387bf06d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c87065e749b44ff3bdfed1993a773ee0'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:38.740850 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ec7ce366-090e-4cdd-8f05-58387bf06d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c87065e749b44ff3bdfed1993a773ee0'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:38.748211 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-ec7ce366-090e-4cdd-8f05-58387bf06d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c87065e749b44ff3bdfed1993a773ee0'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:38.765489 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1288/2577] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:51:38 2022] DELETE /identity/v3/users/c87065e749b44ff3bdfed1993a773ee0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:39.033228 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cca723-b01b-4228-b268-4fbbe1fd5742 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:39.034683 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-f6cca723-b01b-4228-b268-4fbbe1fd5742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:39.047685 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cca723-b01b-4228-b268-4fbbe1fd5742 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:39.104707 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650688e0-e35b-41a9-b360-a310fa973901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:39.105341 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650688e0-e35b-41a9-b360-a310fa973901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:39.105619 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650688e0-e35b-41a9-b360-a310fa973901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:39.105919 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650688e0-e35b-41a9-b360-a310fa973901 admin admin] PATH_INFO: `/v3/projects/9614a156b7d843578536a30099b2f395` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:39.107104 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650688e0-e35b-41a9-b360-a310fa973901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9614a156b7d843578536a30099b2f395)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:39.109056 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650688e0-e35b-41a9-b360-a310fa973901 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:39.125407 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:39.155077 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-650688e0-e35b-41a9-b360-a310fa973901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9614a156b7d843578536a30099b2f395', 'request_id': 'req-650688e0-e35b-41a9-b360-a310fa973901'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:39.160489 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-650688e0-e35b-41a9-b360-a310fa973901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9614a156b7d843578536a30099b2f395', 'request_id': 'req-650688e0-e35b-41a9-b360-a310fa973901'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:39.167874 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-650688e0-e35b-41a9-b360-a310fa973901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9614a156b7d843578536a30099b2f395', 'request_id': 'req-650688e0-e35b-41a9-b360-a310fa973901'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:39.179239 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-650688e0-e35b-41a9-b360-a310fa973901 admin admin] The token cache is being invalidate because project 9614a156b7d843578536a30099b2f395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81801) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:51:39.179528 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-650688e0-e35b-41a9-b360-a310fa973901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:39.180172 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-650688e0-e35b-41a9-b360-a310fa973901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:39.181721 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1290/2578] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:51:39 2022] DELETE /identity/v3/projects/9614a156b7d843578536a30099b2f395 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:39.186614 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72469f72-641d-4c45-a97a-b01720bcf24f None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:39.187086 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72469f72-641d-4c45-a97a-b01720bcf24f None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:39.187193 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72469f72-641d-4c45-a97a-b01720bcf24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:39.207019 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-72469f72-641d-4c45-a97a-b01720bcf24f None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:51:39.208200 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-72469f72-641d-4c45-a97a-b01720bcf24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:39.265670 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1289/2579] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:51:39.273214 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d64420-5e94-40ee-a1c8-0f9591d9b3ef None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:39.273504 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d64420-5e94-40ee-a1c8-0f9591d9b3ef None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:39.273779 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d64420-5e94-40ee-a1c8-0f9591d9b3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:39.294053 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-23d64420-5e94-40ee-a1c8-0f9591d9b3ef None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:51:39.295248 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-23d64420-5e94-40ee-a1c8-0f9591d9b3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:39.303032 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1291/2580] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 14:51:39.307136 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72469f72-641d-4c45-a97a-b01720bcf24f None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:39.317142 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72469f72-641d-4c45-a97a-b01720bcf24f None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:39.321662 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494aec77-e0f0-4629-b4df-627388068a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:39.322296 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494aec77-e0f0-4629-b4df-627388068a99 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:39.322579 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494aec77-e0f0-4629-b4df-627388068a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:39.322855 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494aec77-e0f0-4629-b4df-627388068a99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:39.323505 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494aec77-e0f0-4629-b4df-627388068a99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81802) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:51:39.323807 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494aec77-e0f0-4629-b4df-627388068a99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:39.326092 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494aec77-e0f0-4629-b4df-627388068a99 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:39.337505 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1290/2581] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:51:39.341775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d64420-5e94-40ee-a1c8-0f9591d9b3ef None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:39.350904 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d64420-5e94-40ee-a1c8-0f9591d9b3ef None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:39.355419 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884617f-734c-45eb-9366-b5ab3821755b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:39.356000 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884617f-734c-45eb-9366-b5ab3821755b admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:39.356310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884617f-734c-45eb-9366-b5ab3821755b admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:39.356682 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884617f-734c-45eb-9366-b5ab3821755b admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:39.357345 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884617f-734c-45eb-9366-b5ab3821755b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:39.359342 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884617f-734c-45eb-9366-b5ab3821755b admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:39.385901 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1292/2582] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:51:39 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:51:39.390620 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494aec77-e0f0-4629-b4df-627388068a99 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:39.400583 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494aec77-e0f0-4629-b4df-627388068a99 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:39.457390 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28da53f-d8f6-490a-9a3e-729368cf0a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:39.458022 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28da53f-d8f6-490a-9a3e-729368cf0a35 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:39.458307 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28da53f-d8f6-490a-9a3e-729368cf0a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:39.458582 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28da53f-d8f6-490a-9a3e-729368cf0a35 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:39.459208 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28da53f-d8f6-490a-9a3e-729368cf0a35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:39.461120 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28da53f-d8f6-490a-9a3e-729368cf0a35 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:39.481616 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1291/2583] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:51:39 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:51:39.485607 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884617f-734c-45eb-9366-b5ab3821755b admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:39.495970 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884617f-734c-45eb-9366-b5ab3821755b admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:39.501096 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ff061-bb30-4fb7-99f5-e63234f2807d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:39.501685 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ff061-bb30-4fb7-99f5-e63234f2807d admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:39.502004 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ff061-bb30-4fb7-99f5-e63234f2807d admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:39.502277 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ff061-bb30-4fb7-99f5-e63234f2807d admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:39.502914 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ff061-bb30-4fb7-99f5-e63234f2807d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:39.504510 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ff061-bb30-4fb7-99f5-e63234f2807d admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:39.514849 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1293/2584] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:51:39.518556 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28da53f-d8f6-490a-9a3e-729368cf0a35 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:39.528259 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28da53f-d8f6-490a-9a3e-729368cf0a35 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:39.532997 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b8a79-60f2-432a-a6e1-66651404d986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:39.533588 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b8a79-60f2-432a-a6e1-66651404d986 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:39.533903 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b8a79-60f2-432a-a6e1-66651404d986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:39.534183 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b8a79-60f2-432a-a6e1-66651404d986 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:39.534827 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b8a79-60f2-432a-a6e1-66651404d986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:39.536411 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b8a79-60f2-432a-a6e1-66651404d986 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:39.547088 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1292/2585] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:51:39.551038 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ff061-bb30-4fb7-99f5-e63234f2807d admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:39.561232 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ff061-bb30-4fb7-99f5-e63234f2807d admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:39.565710 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b2262-f7ec-463b-9702-ad3397ea1cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:39.566378 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b2262-f7ec-463b-9702-ad3397ea1cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:39.566657 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b2262-f7ec-463b-9702-ad3397ea1cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:39.566927 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b2262-f7ec-463b-9702-ad3397ea1cc5 admin admin] PATH_INFO: `/v3/projects/906935770d6643a3ae94c0bc0e0aba8f/users/ae97700870724a5a95bfa5cb6b276781/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:39.581634 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b2262-f7ec-463b-9702-ad3397ea1cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=906935770d6643a3ae94c0bc0e0aba8f, user_id=ae97700870724a5a95bfa5cb6b276781, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:39.584353 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b2262-f7ec-463b-9702-ad3397ea1cc5 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:39.596599 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1294/2586] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:51:39 2022] PUT /identity/v3/projects/906935770d6643a3ae94c0bc0e0aba8f/users/ae97700870724a5a95bfa5cb6b276781/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:39.607052 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca953892-aabb-4a65-99d9-6a48cd87c104 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:39.607342 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca953892-aabb-4a65-99d9-6a48cd87c104 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:39.607650 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca953892-aabb-4a65-99d9-6a48cd87c104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:39.636137 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-ca953892-aabb-4a65-99d9-6a48cd87c104 None None] MFA Rules not processed for user `ae97700870724a5a95bfa5cb6b276781`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:51:39.637282 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-ca953892-aabb-4a65-99d9-6a48cd87c104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:39.663169 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:39.703464 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1293/2587] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:51:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:51:39.707943 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b2262-f7ec-463b-9702-ad3397ea1cc5 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:39.769892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b2262-f7ec-463b-9702-ad3397ea1cc5 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:39.774452 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317f598-2500-42f7-9728-72935f751b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:39.775051 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317f598-2500-42f7-9728-72935f751b6b admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:39.775324 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317f598-2500-42f7-9728-72935f751b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:39.775592 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317f598-2500-42f7-9728-72935f751b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:39.776207 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317f598-2500-42f7-9728-72935f751b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:39.778255 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317f598-2500-42f7-9728-72935f751b6b admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:39.804050 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1295/2588] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:51:39 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:51:39.808083 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca953892-aabb-4a65-99d9-6a48cd87c104 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:39.819496 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca953892-aabb-4a65-99d9-6a48cd87c104 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:39.876741 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e6f75-e695-4887-acaa-e25a4f6b2674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:39.877337 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e6f75-e695-4887-acaa-e25a4f6b2674 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:39.877614 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e6f75-e695-4887-acaa-e25a4f6b2674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:39.877908 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e6f75-e695-4887-acaa-e25a4f6b2674 admin admin] PATH_INFO: `/v3/users` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:39.878540 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e6f75-e695-4887-acaa-e25a4f6b2674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:39.880444 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e6f75-e695-4887-acaa-e25a4f6b2674 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:39.901067 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1294/2589] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:51:39 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:51:39.905089 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317f598-2500-42f7-9728-72935f751b6b admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:39.915414 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317f598-2500-42f7-9728-72935f751b6b admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:39.920728 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c1cdb-71f1-42a5-a6b2-830de7181c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:39.922187 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c1cdb-71f1-42a5-a6b2-830de7181c2d admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:39.922187 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c1cdb-71f1-42a5-a6b2-830de7181c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:39.922187 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c1cdb-71f1-42a5-a6b2-830de7181c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:39.923870 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c1cdb-71f1-42a5-a6b2-830de7181c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:39.924123 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c1cdb-71f1-42a5-a6b2-830de7181c2d admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:39.935310 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1296/2590] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 14:51:39.939563 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e6f75-e695-4887-acaa-e25a4f6b2674 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:39.949273 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e6f75-e695-4887-acaa-e25a4f6b2674 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:39.953977 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac82f5-182b-434a-a66c-d93611ff2a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:39.954599 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac82f5-182b-434a-a66c-d93611ff2a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:39.954883 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac82f5-182b-434a-a66c-d93611ff2a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:39.955162 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac82f5-182b-434a-a66c-d93611ff2a6a admin admin] PATH_INFO: `/v3/projects/f10ad3b5f4e747369340e7bee3df7115/users/9f03b4f7670544e7bc9de6ff87e64c7c/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:39.969503 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac82f5-182b-434a-a66c-d93611ff2a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f10ad3b5f4e747369340e7bee3df7115, user_id=9f03b4f7670544e7bc9de6ff87e64c7c, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:39.972271 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac82f5-182b-434a-a66c-d93611ff2a6a admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:39.985376 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1295/2591] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:51:39 2022] PUT /identity/v3/projects/f10ad3b5f4e747369340e7bee3df7115/users/9f03b4f7670544e7bc9de6ff87e64c7c/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:39.989376 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c1cdb-71f1-42a5-a6b2-830de7181c2d admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:40.000754 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c1cdb-71f1-42a5-a6b2-830de7181c2d admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:40.013613 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:40.059981 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab70158-e3f6-4197-bb02-3eef1413bf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:40.060590 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab70158-e3f6-4197-bb02-3eef1413bf7e admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:40.060873 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab70158-e3f6-4197-bb02-3eef1413bf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:40.061145 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab70158-e3f6-4197-bb02-3eef1413bf7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:40.061777 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab70158-e3f6-4197-bb02-3eef1413bf7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:40.063451 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab70158-e3f6-4197-bb02-3eef1413bf7e admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:40.073084 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1297/2592] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:51:40.077492 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac82f5-182b-434a-a66c-d93611ff2a6a admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:40.087534 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac82f5-182b-434a-a66c-d93611ff2a6a admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:40.092899 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8d322-0556-4746-847a-8742dd934e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:40.093547 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8d322-0556-4746-847a-8742dd934e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:40.093828 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8d322-0556-4746-847a-8742dd934e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:40.094130 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8d322-0556-4746-847a-8742dd934e5a admin admin] PATH_INFO: `/v3/projects/f10ad3b5f4e747369340e7bee3df7115/users/9f03b4f7670544e7bc9de6ff87e64c7c/roles/fe3ee5741c6143adb5459b5de54450c8` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:40.096072 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8d322-0556-4746-847a-8742dd934e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f10ad3b5f4e747369340e7bee3df7115, user_id=9f03b4f7670544e7bc9de6ff87e64c7c, role_id=fe3ee5741c6143adb5459b5de54450c8)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:40.098775 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8d322-0556-4746-847a-8742dd934e5a admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:40.109649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1296/2593] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:51:40 2022] PUT /identity/v3/projects/f10ad3b5f4e747369340e7bee3df7115/users/9f03b4f7670544e7bc9de6ff87e64c7c/roles/fe3ee5741c6143adb5459b5de54450c8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:40.121115 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37862c-285a-4b60-a14c-52ed798ec8f6 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:40.121616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37862c-285a-4b60-a14c-52ed798ec8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:40.121727 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37862c-285a-4b60-a14c-52ed798ec8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:40.149260 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-1b37862c-285a-4b60-a14c-52ed798ec8f6 None None] MFA Rules not processed for user `9f03b4f7670544e7bc9de6ff87e64c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:51:40.150497 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-1b37862c-285a-4b60-a14c-52ed798ec8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:40.218835 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1298/2594] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:51:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:51:40.229240 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8d322-0556-4746-847a-8742dd934e5a admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:40.230956 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-50d8d322-0556-4746-847a-8742dd934e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:40.288963 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8d322-0556-4746-847a-8742dd934e5a admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:40.292554 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76428ad-e934-42ef-b02d-c3fa0f8b39a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1f0806ae4544d7b99d4d6e3b5069b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:40.293220 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76428ad-e934-42ef-b02d-c3fa0f8b39a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:40.293497 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76428ad-e934-42ef-b02d-c3fa0f8b39a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:40.293763 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76428ad-e934-42ef-b02d-c3fa0f8b39a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:40.303102 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76428ad-e934-42ef-b02d-c3fa0f8b39a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:40.304506 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76428ad-e934-42ef-b02d-c3fa0f8b39a4 service cinder] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:40.313738 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1297/2595] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:51:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:51:40.445605 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37862c-285a-4b60-a14c-52ed798ec8f6 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:40.506288 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37862c-285a-4b60-a14c-52ed798ec8f6 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:40.510795 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bdd79-3b3f-4772-bd59-04d0f92598ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:40.511418 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bdd79-3b3f-4772-bd59-04d0f92598ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:40.511730 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bdd79-3b3f-4772-bd59-04d0f92598ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:40.512005 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bdd79-3b3f-4772-bd59-04d0f92598ed admin admin] PATH_INFO: `/v3/users/ae97700870724a5a95bfa5cb6b276781` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:40.513122 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bdd79-3b3f-4772-bd59-04d0f92598ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae97700870724a5a95bfa5cb6b276781)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:40.515570 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bdd79-3b3f-4772-bd59-04d0f92598ed admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:40.556033 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:40.563189 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-196bdd79-3b3f-4772-bd59-04d0f92598ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae97700870724a5a95bfa5cb6b276781'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:40.570187 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-196bdd79-3b3f-4772-bd59-04d0f92598ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae97700870724a5a95bfa5cb6b276781'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:40.582940 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-196bdd79-3b3f-4772-bd59-04d0f92598ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae97700870724a5a95bfa5cb6b276781'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:40.583614 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-196bdd79-3b3f-4772-bd59-04d0f92598ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae97700870724a5a95bfa5cb6b276781'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:40.590170 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-196bdd79-3b3f-4772-bd59-04d0f92598ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae97700870724a5a95bfa5cb6b276781'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:40.596563 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1299/2596] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:51:40 2022] DELETE /identity/v3/users/ae97700870724a5a95bfa5cb6b276781 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:40.601039 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d093e01-af90-4d41-b533-78693733488c None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:40.601325 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d093e01-af90-4d41-b533-78693733488c None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:40.601626 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d093e01-af90-4d41-b533-78693733488c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:40.620474 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-3d093e01-af90-4d41-b533-78693733488c None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:51:40.621649 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-3d093e01-af90-4d41-b533-78693733488c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:40.637621 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:40.679958 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1298/2597] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:51:40.690433 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bdd79-3b3f-4772-bd59-04d0f92598ed admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:40.691769 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-196bdd79-3b3f-4772-bd59-04d0f92598ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:40.748857 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bdd79-3b3f-4772-bd59-04d0f92598ed admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:40.752834 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d497f-4e2b-430f-afbd-c3e436f58eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:40.753453 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d497f-4e2b-430f-afbd-c3e436f58eea service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:40.753734 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d497f-4e2b-430f-afbd-c3e436f58eea service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:40.754038 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d497f-4e2b-430f-afbd-c3e436f58eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:40.764616 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d497f-4e2b-430f-afbd-c3e436f58eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:40.766105 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d497f-4e2b-430f-afbd-c3e436f58eea service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:40.775831 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1300/2598] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:51:41.041157 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d093e01-af90-4d41-b533-78693733488c None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:41.042630 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-3d093e01-af90-4d41-b533-78693733488c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:41.054570 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d093e01-af90-4d41-b533-78693733488c None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:41.059185 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edf07f-0ef8-4c92-8eef-1d6206ca9355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:41.059812 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edf07f-0ef8-4c92-8eef-1d6206ca9355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:41.060095 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edf07f-0ef8-4c92-8eef-1d6206ca9355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:41.060867 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edf07f-0ef8-4c92-8eef-1d6206ca9355 admin admin] PATH_INFO: `/v3/projects/906935770d6643a3ae94c0bc0e0aba8f` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:41.062023 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edf07f-0ef8-4c92-8eef-1d6206ca9355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=906935770d6643a3ae94c0bc0e0aba8f)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:41.063922 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edf07f-0ef8-4c92-8eef-1d6206ca9355 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:41.110908 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e8edf07f-0ef8-4c92-8eef-1d6206ca9355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '906935770d6643a3ae94c0bc0e0aba8f', 'request_id': 'req-e8edf07f-0ef8-4c92-8eef-1d6206ca9355'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:41.117813 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e8edf07f-0ef8-4c92-8eef-1d6206ca9355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '906935770d6643a3ae94c0bc0e0aba8f', 'request_id': 'req-e8edf07f-0ef8-4c92-8eef-1d6206ca9355'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:41.124332 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e8edf07f-0ef8-4c92-8eef-1d6206ca9355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '906935770d6643a3ae94c0bc0e0aba8f', 'request_id': 'req-e8edf07f-0ef8-4c92-8eef-1d6206ca9355'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:41.135366 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e8edf07f-0ef8-4c92-8eef-1d6206ca9355 admin admin] The token cache is being invalidate because project 906935770d6643a3ae94c0bc0e0aba8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:51:41.135651 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e8edf07f-0ef8-4c92-8eef-1d6206ca9355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:41.136274 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e8edf07f-0ef8-4c92-8eef-1d6206ca9355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:41.137726 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1299/2599] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:51:41 2022] DELETE /identity/v3/projects/906935770d6643a3ae94c0bc0e0aba8f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:41.142286 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d497f-4e2b-430f-afbd-c3e436f58eea service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:41.151886 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d497f-4e2b-430f-afbd-c3e436f58eea service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:41.209159 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7e0fb-30aa-467e-985d-a51ebeecf826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:41.209783 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7e0fb-30aa-467e-985d-a51ebeecf826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:41.210097 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7e0fb-30aa-467e-985d-a51ebeecf826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:41.210367 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7e0fb-30aa-467e-985d-a51ebeecf826 admin admin] PATH_INFO: `/v3/users/9f03b4f7670544e7bc9de6ff87e64c7c` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:41.211463 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7e0fb-30aa-467e-985d-a51ebeecf826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f03b4f7670544e7bc9de6ff87e64c7c)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:41.213375 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7e0fb-30aa-467e-985d-a51ebeecf826 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:41.258687 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-10b7e0fb-30aa-467e-985d-a51ebeecf826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f03b4f7670544e7bc9de6ff87e64c7c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:41.266128 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-10b7e0fb-30aa-467e-985d-a51ebeecf826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f03b4f7670544e7bc9de6ff87e64c7c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:41.270513 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:41.281224 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-10b7e0fb-30aa-467e-985d-a51ebeecf826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f03b4f7670544e7bc9de6ff87e64c7c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:41.282282 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-10b7e0fb-30aa-467e-985d-a51ebeecf826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f03b4f7670544e7bc9de6ff87e64c7c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:41.289479 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-10b7e0fb-30aa-467e-985d-a51ebeecf826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f03b4f7670544e7bc9de6ff87e64c7c'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:41.295346 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1301/2600] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:51:41 2022] DELETE /identity/v3/users/9f03b4f7670544e7bc9de6ff87e64c7c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:41.555580 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edf07f-0ef8-4c92-8eef-1d6206ca9355 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:41.557130 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-e8edf07f-0ef8-4c92-8eef-1d6206ca9355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:41.571569 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edf07f-0ef8-4c92-8eef-1d6206ca9355 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:41.630056 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10519b18-5f18-40ad-a01b-12c19171d591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:41.630694 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10519b18-5f18-40ad-a01b-12c19171d591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:41.630977 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10519b18-5f18-40ad-a01b-12c19171d591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:41.631251 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10519b18-5f18-40ad-a01b-12c19171d591 admin admin] PATH_INFO: `/v3/projects/f10ad3b5f4e747369340e7bee3df7115` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:41.632362 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10519b18-5f18-40ad-a01b-12c19171d591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f10ad3b5f4e747369340e7bee3df7115)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:41.634400 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10519b18-5f18-40ad-a01b-12c19171d591 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:41.678961 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:41.680231 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-10519b18-5f18-40ad-a01b-12c19171d591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f10ad3b5f4e747369340e7bee3df7115', 'request_id': 'req-10519b18-5f18-40ad-a01b-12c19171d591'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:41.688609 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-10519b18-5f18-40ad-a01b-12c19171d591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f10ad3b5f4e747369340e7bee3df7115', 'request_id': 'req-10519b18-5f18-40ad-a01b-12c19171d591'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:41.694779 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-10519b18-5f18-40ad-a01b-12c19171d591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f10ad3b5f4e747369340e7bee3df7115', 'request_id': 'req-10519b18-5f18-40ad-a01b-12c19171d591'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:41.706477 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-10519b18-5f18-40ad-a01b-12c19171d591 admin admin] The token cache is being invalidate because project f10ad3b5f4e747369340e7bee3df7115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:51:41.706763 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-10519b18-5f18-40ad-a01b-12c19171d591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:41.707390 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-10519b18-5f18-40ad-a01b-12c19171d591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:41.708850 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1300/2601] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:51:41 2022] DELETE /identity/v3/projects/f10ad3b5f4e747369340e7bee3df7115 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:41.713718 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd193b53-3e01-48a2-bfad-531458389e05 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:41.714049 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd193b53-3e01-48a2-bfad-531458389e05 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:41.714328 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd193b53-3e01-48a2-bfad-531458389e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:41.734423 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-dd193b53-3e01-48a2-bfad-531458389e05 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:51:41.735611 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-dd193b53-3e01-48a2-bfad-531458389e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:41.793522 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1302/2602] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:51:41.802075 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdd6a0-0c6b-4915-a5db-fc266be445d5 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:41.802277 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdd6a0-0c6b-4915-a5db-fc266be445d5 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:41.802567 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdd6a0-0c6b-4915-a5db-fc266be445d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:41.821732 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-edcdd6a0-0c6b-4915-a5db-fc266be445d5 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:51:41.822944 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-edcdd6a0-0c6b-4915-a5db-fc266be445d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:41.830643 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1301/2603] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:51:41.834656 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd193b53-3e01-48a2-bfad-531458389e05 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:41.845211 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd193b53-3e01-48a2-bfad-531458389e05 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:41.849751 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce635b-27e0-4a9f-8cbe-002b3027d671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:41.850396 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce635b-27e0-4a9f-8cbe-002b3027d671 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:41.850678 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce635b-27e0-4a9f-8cbe-002b3027d671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:41.850951 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce635b-27e0-4a9f-8cbe-002b3027d671 admin admin] PATH_INFO: `/v3/domains` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:41.851595 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce635b-27e0-4a9f-8cbe-002b3027d671 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81801) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 14:51:41.851897 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce635b-27e0-4a9f-8cbe-002b3027d671 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:41.853549 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce635b-27e0-4a9f-8cbe-002b3027d671 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:41.865727 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1303/2604] 10.222.0.17 () {58 vars in 1153 bytes} [Thu Oct 20 14:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 14:51:41.870191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdd6a0-0c6b-4915-a5db-fc266be445d5 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:41.879272 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdd6a0-0c6b-4915-a5db-fc266be445d5 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:41.883773 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513d874-a453-4fd9-a085-2fe1c99b65c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:41.884354 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513d874-a453-4fd9-a085-2fe1c99b65c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:41.884627 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513d874-a453-4fd9-a085-2fe1c99b65c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:41.884895 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513d874-a453-4fd9-a085-2fe1c99b65c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:41.885525 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513d874-a453-4fd9-a085-2fe1c99b65c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:41.887420 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513d874-a453-4fd9-a085-2fe1c99b65c0 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:41.914179 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1302/2605] 10.222.0.17 () {60 vars in 1153 bytes} [Thu Oct 20 14:51:41 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 14:51:41.918157 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce635b-27e0-4a9f-8cbe-002b3027d671 admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:41.929932 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce635b-27e0-4a9f-8cbe-002b3027d671 admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:41.987944 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e407c-55e4-4fa9-8be0-26f8ce08e06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:41.988583 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e407c-55e4-4fa9-8be0-26f8ce08e06b admin admin] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:41.988857 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e407c-55e4-4fa9-8be0-26f8ce08e06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:41.989125 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e407c-55e4-4fa9-8be0-26f8ce08e06b admin admin] PATH_INFO: `/v3/users` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:41.989753 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e407c-55e4-4fa9-8be0-26f8ce08e06b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:41.991705 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e407c-55e4-4fa9-8be0-26f8ce08e06b admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:42.012600 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1304/2606] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Oct 20 14:51:41 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 14:51:42.017351 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513d874-a453-4fd9-a085-2fe1c99b65c0 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:42.027363 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513d874-a453-4fd9-a085-2fe1c99b65c0 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:42.032587 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d44781-afed-47fd-8d3a-8674cb70eac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:42.033173 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d44781-afed-47fd-8d3a-8674cb70eac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:42.033449 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d44781-afed-47fd-8d3a-8674cb70eac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:42.033719 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d44781-afed-47fd-8d3a-8674cb70eac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:42.034381 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d44781-afed-47fd-8d3a-8674cb70eac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:42.035955 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d44781-afed-47fd-8d3a-8674cb70eac1 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:42.045593 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1303/2607] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:51:42.049569 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e407c-55e4-4fa9-8be0-26f8ce08e06b admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:42.059633 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e407c-55e4-4fa9-8be0-26f8ce08e06b admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:42.064430 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c3949-9be1-4d4d-81de-14ce193b5602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:42.065029 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c3949-9be1-4d4d-81de-14ce193b5602 admin admin] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:42.065311 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c3949-9be1-4d4d-81de-14ce193b5602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:42.065589 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c3949-9be1-4d4d-81de-14ce193b5602 admin admin] PATH_INFO: `/v3/roles` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:42.066269 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c3949-9be1-4d4d-81de-14ce193b5602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:42.067886 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c3949-9be1-4d4d-81de-14ce193b5602 admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:42.079088 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1305/2608] 10.222.0.17 () {58 vars in 1122 bytes} [Thu Oct 20 14:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 14:51:42.083404 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d44781-afed-47fd-8d3a-8674cb70eac1 admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:42.093412 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d44781-afed-47fd-8d3a-8674cb70eac1 admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:42.097925 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247167ea-ef1d-4b31-842e-a646c04dcfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:42.098560 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247167ea-ef1d-4b31-842e-a646c04dcfbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:42.098837 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247167ea-ef1d-4b31-842e-a646c04dcfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:42.099105 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247167ea-ef1d-4b31-842e-a646c04dcfbb admin admin] PATH_INFO: `/v3/projects/916cfd9bfec44684adf913553737b3fa/users/5ce026aefce74aecb14c8e8f037907f7/roles/59cd13c6b53b4329b0af96ce23f01e5e` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:42.114371 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247167ea-ef1d-4b31-842e-a646c04dcfbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=916cfd9bfec44684adf913553737b3fa, user_id=5ce026aefce74aecb14c8e8f037907f7, role_id=59cd13c6b53b4329b0af96ce23f01e5e)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:42.117018 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247167ea-ef1d-4b31-842e-a646c04dcfbb admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:42.130397 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1304/2609] 10.222.0.17 () {60 vars in 1483 bytes} [Thu Oct 20 14:51:42 2022] PUT /identity/v3/projects/916cfd9bfec44684adf913553737b3fa/users/5ce026aefce74aecb14c8e8f037907f7/roles/59cd13c6b53b4329b0af96ce23f01e5e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:42.141633 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327e814-5e4c-4f4d-9655-26415ca5ff19 None None] REQUEST_METHOD: `POST` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:42.141955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327e814-5e4c-4f4d-9655-26415ca5ff19 None None] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:42.142230 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327e814-5e4c-4f4d-9655-26415ca5ff19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:42.173955 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.auth.core [None req-f327e814-5e4c-4f4d-9655-26415ca5ff19 None None] MFA Rules not processed for user `5ce026aefce74aecb14c8e8f037907f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81801) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:51:42.175315 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-f327e814-5e4c-4f4d-9655-26415ca5ff19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:42.208279 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:42.242765 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1306/2610] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:51:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:51:42.255382 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247167ea-ef1d-4b31-842e-a646c04dcfbb admin admin] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:42.257054 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-247167ea-ef1d-4b31-842e-a646c04dcfbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:42.312624 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247167ea-ef1d-4b31-842e-a646c04dcfbb admin admin] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:42.316090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0687d2-9165-453e-ba60-f93556d1c6eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '077f50ca034b4d12817543377815393b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:42.316687 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0687d2-9165-453e-ba60-f93556d1c6eb service glance] REQUEST_METHOD: `GET` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:42.316962 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0687d2-9165-453e-ba60-f93556d1c6eb service glance] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:42.317232 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0687d2-9165-453e-ba60-f93556d1c6eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:42.325191 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0687d2-9165-453e-ba60-f93556d1c6eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:42.326636 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0687d2-9165-453e-ba60-f93556d1c6eb service glance] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:42.335090 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1305/2611] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:51:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:51:52.239823 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=12 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:52.331222 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=60,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:57.843840 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327e814-5e4c-4f4d-9655-26415ca5ff19 None None] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:57.905408 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327e814-5e4c-4f4d-9655-26415ca5ff19 None None] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:57.910158 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b22f4-51e1-46ce-be05-47f38fbf909f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:57.910784 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b22f4-51e1-46ce-be05-47f38fbf909f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:57.911061 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b22f4-51e1-46ce-be05-47f38fbf909f admin admin] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:57.911334 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b22f4-51e1-46ce-be05-47f38fbf909f admin admin] PATH_INFO: `/v3/users/5ce026aefce74aecb14c8e8f037907f7` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:57.912466 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b22f4-51e1-46ce-be05-47f38fbf909f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ce026aefce74aecb14c8e8f037907f7)` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:57.914405 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b22f4-51e1-46ce-be05-47f38fbf909f admin admin] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:57.962412 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-db6b22f4-51e1-46ce-be05-47f38fbf909f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ce026aefce74aecb14c8e8f037907f7'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:57.969796 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-db6b22f4-51e1-46ce-be05-47f38fbf909f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ce026aefce74aecb14c8e8f037907f7'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:57.981819 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-db6b22f4-51e1-46ce-be05-47f38fbf909f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ce026aefce74aecb14c8e8f037907f7'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:57.982530 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-db6b22f4-51e1-46ce-be05-47f38fbf909f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ce026aefce74aecb14c8e8f037907f7'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:57.993258 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.notifications [None req-db6b22f4-51e1-46ce-be05-47f38fbf909f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ce026aefce74aecb14c8e8f037907f7'} {{(pid=81801) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:57.999347 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1307/2612] 10.222.0.17 () {58 vars in 1224 bytes} [Thu Oct 20 14:51:57 2022] DELETE /identity/v3/users/5ce026aefce74aecb14c8e8f037907f7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:51:58.003894 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a227e-5d8b-4caa-ad12-0a57ec0e1043 None None] REQUEST_METHOD: `POST` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:58.004380 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a227e-5d8b-4caa-ad12-0a57ec0e1043 None None] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:58.004490 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a227e-5d8b-4caa-ad12-0a57ec0e1043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:58.022772 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.auth.core [None req-a90a227e-5d8b-4caa-ad12-0a57ec0e1043 None None] MFA Rules not processed for user `f686928c27964f8785160333577196ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81802) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 14:51:58.023952 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a90a227e-5d8b-4caa-ad12-0a57ec0e1043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:58.083046 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1306/2613] 10.222.0.17 () {58 vars in 958 bytes} [Thu Oct 20 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 14:51:58.092492 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b22f4-51e1-46ce-be05-47f38fbf909f admin admin] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:58.094049 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-db6b22f4-51e1-46ce-be05-47f38fbf909f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:58.150671 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b22f4-51e1-46ce-be05-47f38fbf909f admin admin] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:58.154346 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0a02b-e6db-41ad-9a7c-7dfb4846d4d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '359e9d904b0d43acae86337c1eb6a71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:58.154960 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0a02b-e6db-41ad-9a7c-7dfb4846d4d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:58.155242 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0a02b-e6db-41ad-9a7c-7dfb4846d4d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:58.155562 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0a02b-e6db-41ad-9a7c-7dfb4846d4d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:58.165067 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0a02b-e6db-41ad-9a7c-7dfb4846d4d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:58.166775 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0a02b-e6db-41ad-9a7c-7dfb4846d4d0 service neutron] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:58.177163 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1308/2614] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:51:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:51:58.442062 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a227e-5d8b-4caa-ad12-0a57ec0e1043 None None] Authenticating user token {{(pid=81802) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:51:58.443484 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.fernet_utils [None req-a90a227e-5d8b-4caa-ad12-0a57ec0e1043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81802) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:51:58.455376 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a227e-5d8b-4caa-ad12-0a57ec0e1043 None None] Validating token access rules against request {{(pid=81802) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:51:58.460098 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59261fd-9209-43a8-80cd-569e07b8cfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f686928c27964f8785160333577196ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7ff2453910940f2bc733ed16c90677b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81802) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:51:58.460736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59261fd-9209-43a8-80cd-569e07b8cfe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:51:58.460971 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59261fd-9209-43a8-80cd-569e07b8cfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:51:58.461243 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59261fd-9209-43a8-80cd-569e07b8cfe2 admin admin] PATH_INFO: `/v3/projects/916cfd9bfec44684adf913553737b3fa` {{(pid=81802) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:51:58.462362 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59261fd-9209-43a8-80cd-569e07b8cfe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=916cfd9bfec44684adf913553737b3fa)` {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:51:58.464243 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59261fd-9209-43a8-80cd-569e07b8cfe2 admin admin] RBAC: Authorization granted {{(pid=81802) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:51:58.512824 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e59261fd-9209-43a8-80cd-569e07b8cfe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '916cfd9bfec44684adf913553737b3fa', 'request_id': 'req-e59261fd-9209-43a8-80cd-569e07b8cfe2'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:58.520137 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e59261fd-9209-43a8-80cd-569e07b8cfe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '916cfd9bfec44684adf913553737b3fa', 'request_id': 'req-e59261fd-9209-43a8-80cd-569e07b8cfe2'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:58.525673 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e59261fd-9209-43a8-80cd-569e07b8cfe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '916cfd9bfec44684adf913553737b3fa', 'request_id': 'req-e59261fd-9209-43a8-80cd-569e07b8cfe2'} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:58.536682 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e59261fd-9209-43a8-80cd-569e07b8cfe2 admin admin] The token cache is being invalidate because project 916cfd9bfec44684adf913553737b3fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81802) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 14:51:58.536974 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e59261fd-9209-43a8-80cd-569e07b8cfe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:58.537600 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG keystone.notifications [None req-e59261fd-9209-43a8-80cd-569e07b8cfe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81802) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 14:51:58.539099 dv-cinder-779233-7-smb devstack@keystone.service[81802]: [pid: 81802|app: 0|req: 1307/2615] 10.222.0.17 () {58 vars in 1233 bytes} [Thu Oct 20 14:51:58 2022] DELETE /identity/v3/projects/916cfd9bfec44684adf913553737b3fa => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 14:52:08.172735 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:52:08.533736 dv-cinder-779233-7-smb devstack@keystone.service[81802]: DEBUG dbcounter [-] [81802] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:54:15.083803 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0a02b-e6db-41ad-9a7c-7dfb4846d4d0 service neutron] Authenticating user token {{(pid=81801) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 14:54:15.085320 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-d0a0a02b-e6db-41ad-9a7c-7dfb4846d4d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:54:15.154780 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0a02b-e6db-41ad-9a7c-7dfb4846d4d0 service neutron] Validating token access rules against request {{(pid=81801) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 14:54:15.214892 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf0df3-11c6-48e6-9857-86160e000641 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e94a60e43914cf38a5f2f88b182083f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88613722e7dc4950b5e47a1d92331575', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81801) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 14:54:15.215500 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf0df3-11c6-48e6-9857-86160e000641 service placement] REQUEST_METHOD: `GET` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 14:54:15.215779 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf0df3-11c6-48e6-9857-86160e000641 service placement] SCRIPT_NAME: `/identity` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 14:54:15.216051 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf0df3-11c6-48e6-9857-86160e000641 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81801) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 14:54:15.217764 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.fernet_utils [None req-a7cf0df3-11c6-48e6-9857-86160e000641 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81801) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 14:54:15.229459 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf0df3-11c6-48e6-9857-86160e000641 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 14:54:15.231075 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf0df3-11c6-48e6-9857-86160e000641 service placement] RBAC: Authorization granted {{(pid=81801) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 14:54:15.241058 dv-cinder-779233-7-smb devstack@keystone.service[81801]: [pid: 81801|app: 0|req: 1309/2616] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Oct 20 14:54:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 14:54:25.236835 dv-cinder-779233-7-smb devstack@keystone.service[81801]: DEBUG dbcounter [-] [81801] Writing DB stats keystone:SELECT=58 {{(pid=81801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}